STRATA · Pipeline
Live state of the 68-source fetcher fleet: which caches are present and which parse cleanly into records. Generated by the strata probe - this page is the home for fetcher health (the hand-written report is retired).
Data pipeline · source fleet
Sources
68
Healthy
63
Broken
4
Records parsed
2,079,924
15 facility · 53 commodity · 51 parse-verified · 10 large · 1 un-fetched · 4 empty-cache. Generated 2026-06-20 17:55 UTC.
Facility domain · 15 sources
| Source | Vintage | Status | Records | Size |
|---|---|---|---|---|
| brightquery_global | 2026-06 | Un-fetched | - | - |
| brightquery probe timed out after 120s (live re-validation?) | 2026-05-10 | Present (live) | - | 12.8 MB |
| anm_sigmine | 2026 | Present (large) | - |
Commodity domain · 53 sources
| Source | Vintage | Status | Records | Size |
|---|---|---|---|---|
| comtrade_hs22vendored | 2026-06-17 | Empty cache | - | - |
| iea_h2_projects_2025vendored | 2025 | Empty cache | - | - |
| irena_capacity_2025vendored | 2025 |
Provenance
per-source cache state + a fetch()->parse() smoke-test counting emitted records on every source with a cached artifact <= 150 MB; larger artifacts are confirmed present but not re-parsed inline. A source is facility-domain iff every record kind it emits is in the facility canonical store; otherwise it is commodity-domain. This view is generated by strata sources health and regenerated with pnpm health:refresh - never hand-edited.
| 611 MB |
| blm_mining_claims | 2026 | Present (large) | - | 354 MB |
| eea | 2026-02-20 | Present (large) | - | 804 MB |
| epa_frs | 2026-05-03 | Present (large) | - | 4.7 GB |
| gleif | 2026-05-09 | Present (large) | - | 9.0 GB |
| sec_edgar_corpwatch | 2025-09-13 | Present (large) | - | 9.4 GB |
| usgs_mrds_facilities_2016 | 2016-03-15 | Present (large) | - | 545 MB |
| wikidata | 2026-05-07 | Present (large) | - | 921 MB |
| msha | 2026-05-01 | Parse-verified | 1,019,687 | 44.3 MB |
| pe_ingemmet_geocatmin | 2026 | Parse-verified | 259,094 | 33.4 MB |
| ca_bc_mineral_titles | 2026 | Parse-verified | 40,000 | 9.0 MB |
| icmm_global_mining | 2025 | Parse-verified | 39,124 | 735 KB |
| blm_srp_holdersvendored | 2026 | Parse-verified | 364 | 26.0 KB |
| Empty cache |
| - |
| - |
| unctad_trains_hs2012_2024vendored | hs2012_researcher_2024 | Empty cache | - | - |
| sec_edgar_ex96 probe timed out after 120s (live re-validation?) | 2026-06-16 | Present (live) | - | 163 KB |
| baci_v202601_hs22 | V202601 | Present (large) | - | 288 MB |
| usgs_ngdb | 2024 | Present (large) | - | 303 MB |
| usgs_mrds_2016vendored | 2016 | Parse-verified | 255,560 | 24.6 MB |
| faostat_rfn_2025 | 2025 | Parse-verified | 101,621 | 35.5 MB |
| yale_ystafdb_2019vendored | 2019 | Parse-verified | 77,475 | 1020 KB |
| oecd_export_restrictions_2022vendored | 2022_snapshot | Parse-verified | 60,797 | 6.8 MB |
| bgs_wms_2025vendored | 2025_snapshot | Parse-verified | 55,119 | 3.6 MB |
| usgs_myb_vol3_2019 | 2019 | Parse-verified | 24,850 | 3.2 MB |
| usgs_cmdb | 2020 | Parse-verified | 21,649 | 1.2 MB |
| eurostat_eol_2026 | 2026 | Parse-verified | 20,632 | 584 KB |
| ga_cmmi_geochem_2026_05 | 2026-05-03 | Parse-verified | 16,570 | 40.7 MB |
| usgs_ardf | 2005 | Parse-verified | 14,111 | 2.5 MB |
| usgs_myb_2025_08_22 | 2025-08-22 | Parse-verified | 9,621 | 7.1 MB |
| usgs_mcs_2025vendored | 2025 | Parse-verified | 8,654 | 828 KB |
| usgs_mcs_2026 | 2026 | Parse-verified | 8,581 | 3.1 MB |
| usgs_myb_chapter | rolling | Parse-verified | 8,222 | 9.0 MB |
| usgs_ds140_2017vendored | 2017-01 | Parse-verified | 6,564 | 13.9 MB |
| usgs_deposit_gtvendored | 2012 | Parse-verified | 6,197 | 1.5 MB |
| usgs_mineral_facilitiesvendored | 2026 | Parse-verified | 6,189 | 2.6 MB |
| usgs_cmiovendored | 2025 | Parse-verified | 3,048 | 918 KB |
| usmin_critical_deposits | 2024 | Parse-verified | 2,347 | 583 KB |
| usgs_pp1802_global | 2017 | Parse-verified | 2,345 | 165 KB |
| usgs_world_phosphate | 2002 | Parse-verified | 2,292 | 234 KB |
| usgs_mine_wastevendored | 2026 | Parse-verified | 2,167 | 142 KB |
| sec_edgar_ex96_pdfvendored | 2026-06-16 | Parse-verified | 1,193 | 19.6 MB |
| usgs_porcuvendored | 2008 | Parse-verified | 1,078 | 238 KB |
| usgs_critmin_deposits_v2 | 2024 | Parse-verified | 965 | 103 KB |
| iea_cmo_2025vendored | 2025 | Parse-verified | 814 | 667 KB |
| world_bank_pink_sheet_2026_05vendored | 2026-05 | Parse-verified | 670 | 575 KB |
| anm_amb_2025 | 2024 | Parse-verified | 638 | 662 KB |
| statcan_minerals_2025 | 2025 | Parse-verified | 357 | 5.2 MB |
| jrc_foresight_2023vendored | 2023 | Parse-verified | 268 | 294 KB |
| jrc_wind_deep_dive_2025vendored | 2025 | Parse-verified | 208 | 187 KB |
| usgs_myb_pgm | rolling | Parse-verified | 156 | 246 KB |
| usgs_wmo_2025vendored | 2025 | Parse-verified | 130 | 188 KB |
| usgs_mis_2025q3vendored | 2025q3 | Parse-verified | 112 | 179 KB |
| eu_hydrogen_observatory_2025_12 | 2025-12 | Parse-verified | 103 | 214 KB |
| nuss_eckelman_2014vendored | 2014 | Parse-verified | 100 | 3.3 KB |
| usgs_byproduct_map_2025vendored | 2025 | Parse-verified | 63 | 4.3 KB |
| usgs_coalqualvendored | 2015 | Parse-verified | 58 | 4.4 MB |
| eu_crm_act_2024vendored | 2024 | Parse-verified | 47 | 3.4 KB |
| ga_aimr_2025 | 2025 | Parse-verified | 41 | 512 KB |
| doe_cma_2023vendored | 2023 | Parse-verified | 18 | 753 B |
| eu_h2o_electrolyser_cost_2025 | 2026-04 | Parse-verified | 10 | 171 KB |
| eu_h2o_electrolyser_mfg_2025_12 | 2025-12 | Parse-verified | 9 | 171 KB |
| nrel_rempd_v1_1vendored | v1.1 | Parse-verified | 4 | 1.6 MB |
| nrel_h2new_2024vendored | 2024 | Parse-verified | 2 | 3.2 MB |
| argonne_greet_2025vendored | 2025 | Parse-verified | 0 | 64.5 MB |
