graham/prop
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
prop/lib/microwaveprop/weather
History
Graham McIntire e7a7ae073d Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 
Task 9.3 - Weight recalibration via gradient descent:
- Recalibrator module fits logistic regression weights using Nx
- Trains on QSO positives vs random baseline negatives
- Cross-validates by month, normalizes weights to sum to 1.0
- Mix task: mix recalibrate_scorer --sample 5000 --epochs 2000

Task 9.4 - Side-by-side scorer comparison:
- ScorerDiff.compare/3 re-scores grid with old vs new weights
- Reports mean diff, regressions, improvements, per-band breakdown
- Mix task: mix scorer_diff --new-weights '{...}'

Phase 3 - NEXRAD ingestion pipeline:
- NexradClient fetches IEM n0q composite PNGs, extracts per-point
  box statistics (mean/max dBZ, texture variance)
- NexradObservation schema with unique (lat, lon, observed_at)
- NexradWorker on :nexrad queue for background processing
- nexrad_texture backtest feature in Features module
- mix nexrad_backfill --limit 200

All tasks added to AdminTaskWorker and Release for production use.
1116 tests, 0 failures.
2026-04-10 12:48:36 -05:00
..
grib2 Fix wgrib2 -lola binary parsing and add native_surface_refractivity 2026-04-10 08:13:33 -05:00
era5_batch_client.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_client.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_profile.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
frontal_analysis.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_client.ex Phase 1 tasks 1.1-1.5: HRRR native hybrid-sigma ingestion 2026-04-09 16:23:51 -05:00
hrrr_climatology.ex Phase 3 spike (parked) + Phase 6: temperature anomaly 2026-04-10 08:47:11 -05:00
hrrr_native_client.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_native_profile.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_profile.ex Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
iem_client.ex Add real-time ASOS adjustments between hourly HRRR updates 2026-03-31 09:10:12 -05:00
iemre_observation.ex Add IEM precipitation data to QSO weather pipeline 2026-03-30 13:18:11 -05:00
metar_5min_observation.ex Phase 8: 5-minute METAR ingestion pipeline 2026-04-10 08:53:54 -05:00
ncei_metar_client.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
nexrad_client.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
nexrad_observation.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
rtma_client.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
rtma_observation.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
solar_client.ex Add QSO import, solar indices, Oban workers, LiveView UI, and parallel weather import 2026-03-29 13:04:55 -05:00
solar_index.ex Add QSO import, solar indices, Oban workers, LiveView UI, and parallel weather import 2026-03-29 13:04:55 -05:00
sounding.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
sounding_params.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
station.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
surface_observation.ex Add IEM precipitation data to QSO weather pipeline 2026-03-30 13:18:11 -05:00
theta_e.ex Phase 2 tasks 2.1-2.4: BL turbulence feature computations 2026-04-10 08:21:23 -05:00
weather_layers.ex Add WeatherLayers module for deriving upper-air map fields from HRRR profiles 2026-04-03 16:49:17 -05:00