STRATA · Pipeline
Live state of the 132 sources on automated fetch - a subset of the full source catalogue, the rest being curated, vendored or refreshed by hand. Which caches are present and which parse cleanly into records, generated by the strata probe.
Data pipeline · source fleet
Sources
132
Healthy
131
Broken
0
Un-fetched
1
Records parsed
2,531,030
131 + 0 + 1 = 132 sources. 35 facility · 97 commodity · 101 parse-verified · 24 large · 3 staging-only · 0 empty-cache. Generated 2026-09-15 16:15 UTC.
Facility domain · 35 sources
| Source | Vintage | Status | Records | Size |
|---|---|---|---|---|
| brightquery_global | 2026-06 | Un-fetched | - | - |
| asx_substantial probe timed out after 120s (live re-validation?) | 2026-08-15 | Present (live) | - | 25.6 MB |
| anm_sigmine | 2026 | Present (large) | - |
Commodity domain · 97 sources
| Source | Vintage | Status | Records | Size |
|---|---|---|---|---|
| sec_edgar_ex96 probe timed out after 120s (live re-validation?) | 2026-06-16 | Present (live) | - | 163 KB |
| usmin_critical_deposits probe timed out after 120s (live re-validation?) | 2024 | Present (live) | - | 583 KB |
| anm_cfem | 2026 | Present (large) |
Provenance
per-source cache state + a fetch()->parse() smoke-test counting emitted records on every source with a cached artifact <= 150 MB; larger artifacts are confirmed present but not re-parsed inline. Staging-only lanes emit no record by design, so they are reported as such rather than smoke-tested. A source is facility-domain iff every record kind it emits is in the facility canonical store; otherwise it is commodity-domain. This view is generated by strata sources health and regenerated with pnpm health:refresh - never hand-edited.
| 622 MB |
| blm_mining_claims | 2026 | Present (large) | - | 363 MB |
| brightquery | 2026-05-10 | Present (large) | - | 159 MB |
| cn_cninfo_equity | 2026-08-16 | Present (large) | - | 528 MB |
| companies_house_psc | 2026-09-13 | Present (large) | - | 2.1 GB |
| edinet | 2026-08-11 | Present (large) | - | 713 MB |
| eea | 2026-02-20 | Present (large) | - | 804 MB |
| epa_frs | 2026-09-13 | Present (large) | - | 4.7 GB |
| gleif | 2026-09-13 | Present (large) | - | 9.4 GB |
| pl_krs | 2026-08-11 | Present (large) | - | 367 MB |
| receita_qsa | 2026-07 | Present (large) | - | 1.9 GB |
| sec_edgar_13dg | 2026-09-14 | Present (large) | - | 515 MB |
| sec_edgar_corpwatch | 2025-09-13 | Present (large) | - | 9.4 GB |
| usgs_mrds_facilities_2016 | 2016-03-15 | Present (large) | - | 545 MB |
| wikidata | 2026-05-07 | Present (large) | - | 921 MB |
| msha | 2026-09-11 | Parse-verified | 1,023,493 | 44.5 MB |
| pe_ingemmet_geocatmin | 2026 | Parse-verified | 266,926 | 34.5 MB |
| ca_bc_mineral_titles | 2026 | Parse-verified | 169,872 | 70.1 MB |
| pe_ingemmet_dermin | 2020-11 | Parse-verified | 97,371 | 28.9 MB |
| anm_scm | 2026 | Parse-verified | 66,264 | 48.0 MB |
| icmm_global_mining | 2025 | Parse-verified | 44,850 | 735 KB |
| mn_mrpam_licenses | 2026 | Parse-verified | 14,092 | 2.8 MB |
| kr_dart_majorstock | 2026-08-15 | Parse-verified | 6,255 | 36.8 MB |
| nrel_naatbattvendored | 2026 | Parse-verified | 5,380 | 8.4 MB |
| sec_edgar_sic_filervendored | 2026-06-21 | Parse-verified | 4,758 | 1.1 MB |
| cvm_fre | 2026 | Parse-verified | 3,487 | 7.7 MB |
| wikidata_ownership | 2026-08-15 | Parse-verified | 3,328 | 1.3 MB |
| hkex_di | 2026-08-14 | Parse-verified | 1,481 | 73.2 MB |
| afm_deelnemingen | 2026-09-13 | Parse-verified | 859 | 105 MB |
| bafin_anteile | 2026-08-15 | Parse-verified | 650 | 213 KB |
| blm_srp_holdersvendored | 2026 | Parse-verified | 364 | 26.0 KB |
| fca_nsm | 2026-08-14 | Parse-verified | 110 | 67.9 MB |
| myb_lifecycle_eventsvendored | myb2018_2023 | Parse-verified | 58 | 1.5 MB |
| - |
| 307 MB |
| ar_arca_customsvendored | 2026 | Present (large) | - | 3.2 GB |
| argonne_greet_2025vendored | 2025 | Present (large) | - | 189 MB |
| baci_v202601_hs22 | V202601 | Present (large) | - | 288 MB |
| cl_aduana_customsvendored | 2026 | Present (large) | - | 1000 MB |
| co_dian_customsvendored | 2026 | Present (large) | - | 860 MB |
| pe_sunat_customsvendored | 2026 | Present (large) | - | 9.3 GB |
| unctad_trains_hs2012_2024vendored | hs2012_researcher_2024 | Present (large) | - | 152 MB |
| usgs_ngdb | 2024 | Present (large) | - | 303 MB |
| usgs_mrds_2016vendored | 2016 | Parse-verified | 339,966 | 24.6 MB |
| faostat_rfn_2025 | 2025 | Parse-verified | 100,912 | 35.5 MB |
| yale_ystafdb_2019vendored | 2019 | Parse-verified | 77,475 | 1020 KB |
| oecd_export_restrictions_2022vendored | 2022_snapshot | Parse-verified | 60,797 | 6.8 MB |
| bgs_wms_2025vendored | 2025_snapshot | Parse-verified | 59,541 | 3.6 MB |
| usgs_myb_vol3_2019 | 2019 | Parse-verified | 24,850 | 3.2 MB |
| usgs_cmdb | 2020 | Parse-verified | 21,649 | 1.2 MB |
| eurostat_eol_2026 | 2026 | Parse-verified | 20,632 | 584 KB |
| usgs_ardf | 2005 | Parse-verified | 18,604 | 2.5 MB |
| ga_cmmi_geochem_2026_05 | 2026-05-03 | Parse-verified | 16,570 | 40.7 MB |
| usgs_myb_2025_08_22 | 2025-08-22 | Parse-verified | 9,621 | 7.1 MB |
| usgs_mcs_2025vendored | 2025 | Parse-verified | 8,655 | 828 KB |
| usgs_mcs_2026 | 2026 | Parse-verified | 8,581 | 3.1 MB |
| usgs_myb_chapter | rolling | Parse-verified | 8,222 | 9.0 MB |
| usgs_ds140_2017vendored | 2017-01 | Parse-verified | 6,564 | 13.9 MB |
| usgs_deposit_gtvendored | 2012 | Parse-verified | 6,197 | 1.5 MB |
| usgs_mineral_facilitiesvendored | 2026 | Parse-verified | 6,189 | 2.6 MB |
| comtrade_hs22vendored | 2026-06-17 | Parse-verified | 3,693 | 673 KB |
| usgs_cmiovendored | 2025 | Parse-verified | 3,048 | 918 KB |
| usgs_critmin_deposits_v3 | 2025 | Parse-verified | 2,836 | 266 KB |
| usgs_pp1802_global | 2017 | Parse-verified | 2,345 | 165 KB |
| usgs_world_phosphate | 2002 | Parse-verified | 2,293 | 234 KB |
| usgs_mine_wastevendored | 2026 | Parse-verified | 2,167 | 142 KB |
| gem_coal_minesvendored | 2026-05 | Parse-verified | 1,314 | 2.5 MB |
| sec_edgar_ex96_pdfvendored | 2026-06-16 | Parse-verified | 1,193 | 19.6 MB |
| usgs_porcuvendored | 2008 | Parse-verified | 1,078 | 238 KB |
| iea_cmo_2025vendored | 2025 | Parse-verified | 814 | 667 KB |
| world_bank_pink_sheet_2026_08vendored | 2026-08 | Parse-verified | 670 | 573 KB |
| anm_amb_2025 | 2024 | Parse-verified | 638 | 662 KB |
| cochilco_consumption_2025vendored | 2025 | Parse-verified | 564 | 12.6 KB |
| irena_capacity_2025vendored | 2025 | Parse-verified | 396 | 20.4 KB |
| gem_powervendored | 2026-02 | Parse-verified | 388 | 20.5 MB |
| statcan_minerals_2025 | 2025 | Parse-verified | 357 | 5.2 MB |
| usgs_earth_mri_geochem | v12-20250401 | Parse-verified | 272 | 33.6 MB |
| jrc_foresight_2023vendored | 2023 | Parse-verified | 268 | 294 KB |
| cd_ctcpm_miningvendored | 2026 | Parse-verified | 253 | 94.8 MB |
| jrc_wind_deep_dive_2025vendored | 2025 | Parse-verified | 208 | 187 KB |
| mn_eiti_coalvendored | 2023 | Parse-verified | 173 | 4.6 MB |
| usgs_myb_pgm | rolling | Parse-verified | 156 | 246 KB |
| usgs_wmo_2025vendored | 2025 | Parse-verified | 130 | 188 KB |
| usgs_mis_2025q3vendored | 2025q3 | Parse-verified | 112 | 179 KB |
| nuss_eckelman_2014vendored | 2014 | Parse-verified | 104 | 3.3 KB |
| eu_hydrogen_observatory_2025_12 | 2025-12 | Parse-verified | 103 | 214 KB |
| mcsa_factsvendored | 2024 | Parse-verified | 72 | 378 KB |
| iea_ev_outlook_2026vendored | 2026 | Parse-verified | 69 | 8.5 KB |
| usgs_byproduct_map_2025vendored | 2025 | Parse-verified | 64 | 4.3 KB |
| usgs_coalqualvendored | 2015 | Parse-verified | 58 | 4.4 MB |
| uranium_wna_eiavendored | 2025 | Parse-verified | 54 | 4.7 KB |
| worldsteel_production_2026vendored | 2026 | Parse-verified | 51 | 1.1 KB |
| eu_crm_act_2024vendored | 2024 | Parse-verified | 47 | 3.4 KB |
| gem_iron_steelvendored | 2026-03 | Parse-verified | 45 | 855 KB |
| gn_mmg_bauxitevendored | 2026 | Parse-verified | 45 | 27.3 MB |
| ga_aimr_2025 | 2025 | Parse-verified | 41 | 512 KB |
| jm_pgm_supplyvendored | 2026-05 | Parse-verified | 40 | 2.2 KB |
| jm_pgm_demandvendored | 2026-05 | Parse-verified | 31 | 100 KB |
| gh_chamber_mineralsvendored | 2023 | Parse-verified | 26 | 1.4 MB |
| gh_gheiti_goldvendored | 2022 | Parse-verified | 24 | 3.3 MB |
| iea_h2_projects_2025vendored | 2025 | Parse-verified | 20 | 10.1 KB |
| public_lca_reportsvendored | 2026-07 | Parse-verified | 20 | 25.6 KB |
| doe_cma_2023vendored | 2023 | Parse-verified | 18 | 753 B |
| bo_ine_customsvendored | 2026 | Parse-verified | 14 | 32.8 MB |
| icda_chromiumvendored | 2025 | Parse-verified | 12 | 1.9 KB |
| eu_h2o_electrolyser_cost_2025 | 2026-04 | Parse-verified | 10 | 171 KB |
| iea_grids_2023vendored | 2023 | Parse-verified | 10 | 1.2 KB |
| ilzsg_zinc_factbook_2024vendored | 2024 | Parse-verified | 10 | 1.4 KB |
| br_comexstat_customsvendored | 2026 | Parse-verified | 9 | 150 MB |
| cochilco_molyvendored | 2025 | Parse-verified | 9 | 831 B |
| eu_h2o_electrolyser_mfg_2025_12 | 2025-12 | Parse-verified | 9 | 171 KB |
| hev_sales_2025vendored | 2025 | Parse-verified | 4 | 2.0 KB |
| nrel_rempd_v1_1vendored | v1.1 | Parse-verified | 4 | 1.6 MB |
| ce_device_units_2024vendored | 2024 | Parse-verified | 2 | 8.5 KB |
| eia_qcrvendored | 2026-q1 | Parse-verified | 2 | 13.9 KB |
| ilzsg_lead_factbook_2023vendored | 2023 | Parse-verified | 2 | 1.4 KB |
| nrel_h2new_2024vendored | 2024 | Parse-verified | 2 | 3.2 MB |
| nrel_naatbatt_cellsvendored | 2026 | Parse-verified | 2 | 8.4 MB |
| imni_annual_reviewvendored | 2025 | Parse-verified | 1 | 741 B |
| jraia_ac_2025vendored | 2025 | Parse-verified | 1 | 258 B |
| oica_production_2024vendored | 2024 | Parse-verified | 1 | 417 B |
| opec_asb_2025vendored | 2025 | Parse-verified | 1 | 227 B |
| unep_gsr_2025vendored | 2025 | Parse-verified | 1 | 337 B |
| usgs_tungsten_2025vendored | 2025 | Parse-verified | 1 | 193 B |
| wfo_casting_2023vendored | 2023 | Parse-verified | 1 | 242 B |
| worldstainless_meltshop_2025vendored | 2025 | Parse-verified | 1 | 290 B |
| ibama_enforcement | 2026-07 | Staging only | - | 160 MB |
| msha_control_history | 2026-09 | Staging only | - | 4.3 MB |
| msha_workforce | 2026-09 | Staging only | - | 172 MB |