prop/lib/microwaveprop/workers
Graham McInitre 4ac606e682 fix: ensure all unused historical NFS data gets cleaned up
Close 6 cleanup gaps on the shared /data NFS mount:

- HRDPS .hrdps.prop score files: parse_valid_time regex now matches
  the .hrdps.prop extension, so these files are found and pruned
- HRDPS scalar dirs (weather_scalars/{iso}.hrdps/): strip .hrdps suffix
  before DateTime.from_iso8601 in list_valid_time_dirs
- ScalarFile: prune_older_than was defined but never called from
  Propagation.prune_old_scores - now called alongside Scores/Profiles
- Orphan .tmp.* files: sweep all three base dirs (scores/profiles/scalars)
  for .tmp.* files left by crashed atomic-write processes
- Building cache (/data/buildings/): add MsFootprints.prune_older_than
  with 30-day mtime cutoff
- Canopy cache (/data/canopy/ + staging/): add Canopy.prune_older_than
  with 30-day cutoff, cleanup empty staging dir

All cleanup is cutoff-based (older than X time) so if the prune worker
is missed for any period it catches up fully on the next run.

PropagationPruneWorker updated to call all new cleanup functions.
2026-07-20 09:27:36 -05:00
..
admin_task_worker.ex updates 2026-06-16 12:38:08 -05:00
backfill_enqueue_worker.ex updates 2026-06-16 12:38:08 -05:00
canadian_sounding_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
common_volume_radar_worker.ex updates 2026-06-16 12:38:08 -05:00
contact_import_worker.ex updates 2026-06-16 12:38:08 -05:00
contact_position_backfill_worker.ex updates 2026-06-16 12:38:08 -05:00
contact_weather_enqueue_worker.ex refactor: extract ProfileLookup module from weather.ex (2072→1696 lines, -376) 2026-07-16 07:47:47 -05:00
gefs_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
grid_cache_prune_worker.ex updates 2026-06-16 12:38:08 -05:00
hrdps_grid_worker.ex updates 2026-06-16 12:38:08 -05:00
hrrr_native_grid_worker.ex updates 2026-06-16 12:38:08 -05:00
iemre_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
ionosphere_fetch_worker.ex fix: handle GIRO API 404 cleanly — don't dump raw HTML into logs 2026-07-16 07:17:52 -05:00
mechanism_classify_worker.ex updates 2026-06-16 12:38:08 -05:00
narr_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
nexrad_worker.ex updates 2026-06-16 12:38:08 -05:00
partition_maintenance_worker.ex updates 2026-06-16 12:38:08 -05:00
propagation_grid_worker.ex updates 2026-06-16 12:38:08 -05:00
propagation_prune_worker.ex fix: ensure all unused historical NFS data gets cleaned up 2026-07-20 09:27:36 -05:00
pskr_calibration_worker.ex updates 2026-06-16 12:38:08 -05:00
pskr_recalibration_worker.ex updates 2026-06-16 12:38:08 -05:00
radar_frame_worker.ex updates 2026-06-16 12:38:08 -05:00
rover_mission_backfill_worker.ex updates 2026-06-16 12:38:08 -05:00
rover_mission_reconcile_worker.ex updates 2026-06-16 12:38:08 -05:00
rover_path_profile_worker.ex updates 2026-06-16 12:38:08 -05:00
solar_index_worker.ex updates 2026-06-16 12:38:08 -05:00
space_weather_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00
station_elevation_worker.ex perf: batch fixes for site-wide audit — indexes, N+1, streams, atomicity 2026-07-16 07:31:19 -05:00
terrain_profile_worker.ex updates 2026-06-16 12:38:08 -05:00
user_home_qth_lookup_worker.ex updates 2026-06-16 12:38:08 -05:00
weather_fetch_worker.ex updates 2026-06-16 12:38:08 -05:00