prop/lib/microwaveprop/workers
Graham McIntire 57578dff4d Add native HRRR duct detection to hourly propagation scoring
The PropagationGridWorker now fetches native hybrid-sigma levels
(TMP, SPFH, HGT, PRES × 50 levels) alongside the standard surface
and pressure products. Native data provides 10-50m vertical spacing
vs 250m from pressure levels, detecting thin surface ducts invisible
to the standard product.

Key design: cell-by-cell reducer in Wgrib2.extract_grid_from_file_mapped
processes each of the 95k CONUS cells through a duct analysis function
inline, keeping only scalar metrics per cell. Peak memory ~86 MB
instead of ~1.8 GB for the full grid map.

Per-cell output: native_min_gradient, best_duct_freq_ghz,
max_duct_thickness_m, duct_count. The scorer prefers the native
gradient over the pressure-level gradient when available.

Native fetch is optional — if it fails, scoring continues with
pressure-level data only.
2026-04-11 13:30:48 -05:00
..
admin_task_worker.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
asos_adjustment_worker.ex Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
backfill_enqueue_worker.ex Add ERA5 to backfill dashboard and enrichment pipeline 2026-04-07 12:24:18 -05:00
contact_weather_enqueue_worker.ex Dedupe ERA5 fetch jobs by (lat, lon, valid_time) 2026-04-08 15:52:53 -05:00
era5_fetch_worker.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_month_batch_worker.ex Move Era5MonthBatchWorker to its own queue 2026-04-09 14:12:31 -05:00
hrrr_fetch_worker.ex Show dead tuple counts on backfill dashboard, fix table visibility during vacuum 2026-04-04 10:45:06 -05:00
hrrr_native_grid_worker.ex Reduce memory pressure: Stream large collections, GC between phases 2026-04-10 16:45:50 -05:00
iemre_fetch_worker.ex Store stub records on empty weather fetches to prevent infinite backfill retries 2026-04-06 16:10:39 -05:00
nexrad_worker.ex Fix NexradWorker UUID type: use generate() not bingenerate() for insert_all 2026-04-10 14:13:38 -05:00
propagation_grid_worker.ex Add native HRRR duct detection to hourly propagation scoring 2026-04-11 13:30:48 -05:00
propagation_prune_worker.ex Decouple propagation_scores pruning from the compute worker 2026-04-09 12:30:10 -05:00
rtma_fetch_worker.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
solar_index_worker.ex Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
terrain_profile_worker.ex Mark terrain status complete when profile already exists 2026-04-06 16:54:29 -05:00
weather_fetch_worker.ex Store stub records on empty weather fetches to prevent infinite backfill retries 2026-04-06 16:10:39 -05:00