prop/lib/mix/tasks
Graham McIntire 02b354f5f7
Purge legacy is_grid_point=true rows from hrrr_profiles
The grid worker stopped writing HRRR profiles to the DB on April 14
when the forecast grid moved to /data/scores binary files, but the
24/72h-windowed prune left every is_grid_point=true row older than
72 hours sitting in the table (billions of rows across every
partition back to 2016, ~90% of the 146 GB table size). Nothing
reads them anymore.

Replace prune_old_grid_profiles/0 with purge_grid_point_profiles/0,
which walks every hrrr_profiles partition directly and deletes
is_grid_point=true rows regardless of age. Per-partition DELETEs
avoid a parent-table full scan. QSO-linked rows (is_grid_point=false)
are untouched — those still back contact enrichment and /path.

Call the new purge from the grid worker's end-of-chain hook so any
grid-point row that somehow slips back in gets cleaned up within the
next hour. Add `mix hrrr.purge_grid_points` for a one-shot historical
cleanup.
2026-04-15 12:14:20 -05:00
..
backtest.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
era5_backfill.ex Pause Oban queues in all mix tasks 2026-04-10 09:13:30 -05:00
hrrr_backfill.ex Fix credo warnings: struct specs, length/1, and test patterns 2026-04-12 10:26:53 -05:00
hrrr_climatology.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_native_backfill.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_native_derive.ex Fix all 12 dialyzer warnings 2026-04-11 18:08:18 -05:00
hrrr_purge_grid_points.ex Purge legacy is_grid_point=true rows from hrrr_profiles 2026-04-15 12:14:20 -05:00
import_contest_logs.ex Fix all remaining credo --strict issues (0 issues) 2026-04-12 10:26:53 -05:00
nexrad_backfill.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
notebook.ex Add bin/notebook script to start Phoenix + Livebook together 2026-04-07 11:15:49 -05:00
propagation_grid.ex Fix all remaining credo --strict issues (0 issues) 2026-04-12 10:26:53 -05:00
recalibrate_scorer.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
reset_enrichment.ex Pause Oban queues in all mix tasks 2026-04-10 09:13:30 -05:00