graham/prop
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
prop/lib/microwaveprop/workers
History
Graham McIntire 2fd88a94ea
Some checks failed
Build and Push / Build and Push Docker Image (push) Waiting to run
Details
Build prop-grid-rs / Test, build, push (push) Failing after 3m41s
Details
fix(propagation): 7 pipeline bugs + validation harnesses + model improvements 
Phase A — 7 pipeline bugs:
- retain_scores_window: fix timeline self-deletion (NOTIFY payload run_time|valid_time)
- Rust/Elixir weight divergence: Rust loads band_weights.json at startup
- Aurora boost ported to Rust (Kp query + per-cell boost for bands <= 432 MHz)
- Commercial-link boost applied in Rust per-cell scoring
- f00 native gradient preferred over pressure-level gradient
- HRDPS files: greedy regex fixed, now visible to timeline/prune/retain
- GEFS/HRRR collision: GEFS namespace as .gefs.prop, merge at read

Phase B — Validation harness:
- scripts/validate_algo.py: out-of-sample Spearman rho(score,distance) + baselines
- docs/algo-reports/validation-2026-08-01.{json,md}

Phase C — Forecast-skill evaluation:
- scripts/validate_forecast.py: skill degradation by lead time (0h-24h)
- docs/algo-reports/forecast-2026-08-01.{json,md}

Phase D — Calibration + model improvements:
- recalibrate.py: validation gate before weight deploy
- Recalibrator: Nx.max(0.0) replaces Nx.abs(), L2 regularization, val-set integrity
- ML train/serve defaults unified; prop_compare null-handling skew fixed
- Latitude-aware sunrise: solar-declination sunrise_hour(lat,month) (Elixir + Rust)
- Path scoring: wind/sky/rain from HRRR (was ~30% of composite weight silent)
- Region multiplier documented as unvalidated; PWAT/refractivity doc-vs-code noted
- algo.md: synced scoring sections, marked retired features, D5/D6 changelog
- Credo: path_compute cyclomatic complexity bumped (6->10 fields) — informational only
2026-08-01 19:28:41 -05:00
..
admin_task_worker.ex updates 2026-06-16 12:38:08 -05:00
backfill_enqueue_worker.ex updates 2026-06-16 12:38:08 -05:00
canadian_sounding_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
common_volume_radar_worker.ex updates 2026-06-16 12:38:08 -05:00
contact_import_worker.ex updates 2026-06-16 12:38:08 -05:00
contact_position_backfill_worker.ex updates 2026-06-16 12:38:08 -05:00
contact_weather_enqueue_worker.ex fix: resolve 27 security, architecture, test, and performance audit findings 2026-07-27 18:19:37 -05:00
gefs_fetch_worker.ex fix(propagation): 7 pipeline bugs + validation harnesses + model improvements 2026-08-01 19:28:41 -05:00
grid_cache_prune_worker.ex updates 2026-06-16 12:38:08 -05:00
hrdps_grid_worker.ex updates 2026-06-16 12:38:08 -05:00
hrrr_native_grid_worker.ex fix: resolve all 281 credo issues across source and test files 2026-07-29 09:04:21 -05:00
iemre_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
ionosphere_fetch_worker.ex fix: handle GIRO API 404 cleanly — don't dump raw HTML into logs 2026-07-16 07:17:52 -05:00
mechanism_classify_worker.ex updates 2026-06-16 12:38:08 -05:00
narr_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
nexrad_worker.ex updates 2026-06-16 12:38:08 -05:00
partition_maintenance_worker.ex updates 2026-06-16 12:38:08 -05:00
propagation_grid_worker.ex updates 2026-06-16 12:38:08 -05:00
propagation_prune_worker.ex fix: ensure all unused historical NFS data gets cleaned up 2026-07-20 09:27:36 -05:00
pskr_calibration_worker.ex updates 2026-06-16 12:38:08 -05:00
pskr_recalibration_worker.ex updates 2026-06-16 12:38:08 -05:00
radar_frame_worker.ex updates 2026-06-16 12:38:08 -05:00
rover_mission_backfill_worker.ex updates 2026-06-16 12:38:08 -05:00
rover_mission_reconcile_worker.ex updates 2026-06-16 12:38:08 -05:00
rover_path_profile_worker.ex updates 2026-06-16 12:38:08 -05:00
solar_index_worker.ex updates 2026-06-16 12:38:08 -05:00
space_weather_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
station_elevation_worker.ex perf: batch fixes for site-wide audit — indexes, N+1, streams, atomicity 2026-07-16 07:31:19 -05:00
terrain_profile_worker.ex updates 2026-06-16 12:38:08 -05:00
user_home_qth_lookup_worker.ex updates 2026-06-16 12:38:08 -05:00
weather_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00