prop/test/microwaveprop
Graham McIntire 900685aa06 Phase 1 tasks 1.1-1.5: HRRR native hybrid-sigma ingestion
- Spike docs at docs/research/hrrr_native_levels.md confirming files
  are on AWS S3 for 5+ years, 50 hybrid levels, and include TKE and
  SPFH needed for Phase 2 turbulence features. Architectural finding:
  per-point on-demand fetching is impractical (~530 MB/file), so
  the ingestion worker batches per (date, hour) instead.
- hrrr_native_profiles schema: arrays per level plus cached surface
  scalars and placeholder columns for Phase 2/4 derived fields.
  Strictly additive — the existing hrrr_profiles table is untouched.
- HrrrNativeClient: pure URL/message-list helpers, build_native_profile/1
  that turns a parsed wgrib2 map into the schema shape (TDD'd).
- Exposed HrrrClient.download_grib_ranges/2 so the native client
  reuses the existing parallel byte-range download + disk cache.
- HrrrNativeGridWorker: Oban worker keyed on {year, month, day, hour},
  unique at :infinity, pulls distinct (lat, lon) points from contacts
  in the ±30 min window, downloads the native grib2, extracts per
  point, bulk-upserts.
- mix hrrr_native_backfill --limit N enqueues the top-N hours by
  contact count.

Phase 1 gate still pending Task 1.6 (sanity-check backtest after
live data lands).
2026-04-09 16:23:51 -05:00
..
backtest Phase 0: backtest harness 2026-04-09 16:10:54 -05:00
beacons Per-HRRR-cell beacon reception plot 2026-04-08 13:43:01 -05:00
commercial Add commercial link monitoring via SNMP polling 2026-03-30 13:02:59 -05:00
propagation Add 902-5760 MHz bands, centralize band options 2026-04-07 16:39:25 -05:00
radio CSV upload preview with duplicate detection before commit 2026-04-09 12:30:10 -05:00
terrain Rename qsos table to contacts, qso_id to contact_id 2026-04-02 15:52:19 -05:00
weather Phase 1 tasks 1.1-1.5: HRRR native hybrid-sigma ingestion 2026-04-09 16:23:51 -05:00
workers Phase 1 tasks 1.1-1.5: HRRR native hybrid-sigma ingestion 2026-04-09 16:23:51 -05:00
accounts_test.exs Add is_admin flag, auto-grant to graham@mcintire.me 2026-04-08 11:43:52 -05:00
backtest_test.exs Phase 0: backtest harness 2026-04-09 16:10:54 -05:00
beacon_monitors_test.exs Add beacon monitor registration and fix prod SMTP 2026-04-08 11:30:28 -05:00
beacons_test.exs Add beacon bearing, beamwidth, and weak-signal keyings 2026-04-09 08:59:16 -05:00
commercial_test.exs Add commercial link monitoring via SNMP polling 2026-03-30 13:02:59 -05:00
markdown_test.exs Add Tier 1 test coverage: EnrichmentStatus, Markdown, health, RemoteIp, Maidenhead 2026-04-06 10:15:38 -05:00
propagation_test.exs Add 902-5760 MHz bands, centralize band options 2026-04-07 16:39:25 -05:00
radio_test.exs Replace boolean enrichment flags with enum status fields 2026-04-02 12:07:51 -05:00
terrain_test.exs Rename qsos table to contacts, qso_id to contact_id 2026-04-02 15:52:19 -05:00
weather_grid_test.exs Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
weather_test.exs Reduce dead tuples by using conditional upserts and skip-on-conflict 2026-04-04 17:32:57 -05:00