graham/prop
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
prop/lib/microwaveprop/workers
History
Graham McIntire e7a7ae073d Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 
Task 9.3 - Weight recalibration via gradient descent:
- Recalibrator module fits logistic regression weights using Nx
- Trains on QSO positives vs random baseline negatives
- Cross-validates by month, normalizes weights to sum to 1.0
- Mix task: mix recalibrate_scorer --sample 5000 --epochs 2000

Task 9.4 - Side-by-side scorer comparison:
- ScorerDiff.compare/3 re-scores grid with old vs new weights
- Reports mean diff, regressions, improvements, per-band breakdown
- Mix task: mix scorer_diff --new-weights '{...}'

Phase 3 - NEXRAD ingestion pipeline:
- NexradClient fetches IEM n0q composite PNGs, extracts per-point
  box statistics (mean/max dBZ, texture variance)
- NexradObservation schema with unique (lat, lon, observed_at)
- NexradWorker on :nexrad queue for background processing
- nexrad_texture backtest feature in Features module
- mix nexrad_backfill --limit 200

All tasks added to AdminTaskWorker and Release for production use.
1116 tests, 0 failures.
2026-04-10 12:48:36 -05:00
..
admin_task_worker.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
asos_adjustment_worker.ex Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
backfill_enqueue_worker.ex Add ERA5 to backfill dashboard and enrichment pipeline 2026-04-07 12:24:18 -05:00
contact_weather_enqueue_worker.ex Dedupe ERA5 fetch jobs by (lat, lon, valid_time) 2026-04-08 15:52:53 -05:00
era5_fetch_worker.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_month_batch_worker.ex Move Era5MonthBatchWorker to its own queue 2026-04-09 14:12:31 -05:00
hrrr_fetch_worker.ex Show dead tuple counts on backfill dashboard, fix table visibility during vacuum 2026-04-04 10:45:06 -05:00
hrrr_native_grid_worker.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
iemre_fetch_worker.ex Store stub records on empty weather fetches to prevent infinite backfill retries 2026-04-06 16:10:39 -05:00
nexrad_worker.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
propagation_grid_worker.ex Decouple propagation_scores pruning from the compute worker 2026-04-09 12:30:10 -05:00
propagation_prune_worker.ex Decouple propagation_scores pruning from the compute worker 2026-04-09 12:30:10 -05:00
rtma_fetch_worker.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
solar_index_worker.ex Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
terrain_profile_worker.ex Mark terrain status complete when profile already exists 2026-04-06 16:54:29 -05:00
weather_fetch_worker.ex Store stub records on empty weather fetches to prevent infinite backfill retries 2026-04-06 16:10:39 -05:00