prop/lib/microwaveprop/weather
Graham McIntire 57578dff4d Add native HRRR duct detection to hourly propagation scoring
The PropagationGridWorker now fetches native hybrid-sigma levels
(TMP, SPFH, HGT, PRES × 50 levels) alongside the standard surface
and pressure products. Native data provides 10-50m vertical spacing
vs 250m from pressure levels, detecting thin surface ducts invisible
to the standard product.

Key design: cell-by-cell reducer in Wgrib2.extract_grid_from_file_mapped
processes each of the 95k CONUS cells through a duct analysis function
inline, keeping only scalar metrics per cell. Peak memory ~86 MB
instead of ~1.8 GB for the full grid map.

Per-cell output: native_min_gradient, best_duct_freq_ghz,
max_duct_thickness_m, duct_count. The scorer prefers the native
gradient over the pressure-level gradient when available.

Native fetch is optional — if it fails, scoring continues with
pressure-level data only.
2026-04-11 13:30:48 -05:00
..
grib2 Add native HRRR duct detection to hourly propagation scoring 2026-04-11 13:30:48 -05:00
era5_batch_client.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_client.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_profile.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
frontal_analysis.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_client.ex Reduce memory pressure: Stream large collections, GC between phases 2026-04-10 16:45:50 -05:00
hrrr_climatology.ex Phase 3 spike (parked) + Phase 6: temperature anomaly 2026-04-10 08:47:11 -05:00
hrrr_native_client.ex Add native HRRR duct detection to hourly propagation scoring 2026-04-11 13:30:48 -05:00
hrrr_native_profile.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_profile.ex Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
iem_client.ex Add real-time ASOS adjustments between hourly HRRR updates 2026-03-31 09:10:12 -05:00
iemre_observation.ex Add IEM precipitation data to QSO weather pipeline 2026-03-30 13:18:11 -05:00
metar_5min_observation.ex Phase 8: 5-minute METAR ingestion pipeline 2026-04-10 08:53:54 -05:00
ncei_metar_client.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
nexrad_client.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
nexrad_observation.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
rtma_client.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
rtma_observation.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
solar_client.ex Add QSO import, solar indices, Oban workers, LiveView UI, and parallel weather import 2026-03-29 13:04:55 -05:00
solar_index.ex Add QSO import, solar indices, Oban workers, LiveView UI, and parallel weather import 2026-03-29 13:04:55 -05:00
sounding.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
sounding_params.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
station.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
surface_observation.ex Add IEM precipitation data to QSO weather pipeline 2026-03-30 13:18:11 -05:00
theta_e.ex Guard against zero specific humidity in theta-e computation 2026-04-11 12:52:32 -05:00
weather_layers.ex Add WeatherLayers module for deriving upper-air map fields from HRRR profiles 2026-04-03 16:49:17 -05:00