Commit graph

575 commits

Author SHA1 Message Date
3cc4301855 Auto-deploy analysis notebook as Livebook app
Add app_settings metadata to notebook and set LIVEBOOK_APPS_PATH
so it shows up under Apps on the Livebook home page.
2026-04-07 11:15:49 -05:00
548e277bec Add bin/notebook script to start Phoenix + Livebook together
Starts Phoenix with a named node and Livebook attached to it on
port 8081. Single command, Ctrl-C stops both.
2026-04-07 11:15:49 -05:00
44f0ff26e5 Add mix notebook task for Livebook attached to dev node
Run `mix notebook` for instructions to start Livebook at localhost:8081
connected to the running Phoenix node with full Repo/Scorer access.
2026-04-07 11:15:49 -05:00
6252aff728 Rewrite analysis notebook to attach to running node
Uses Repo, Scorer, BandConfig, Weather directly instead of raw SQL.
Scores all historical contacts with the real composite_score/2 and
includes factor heatmaps and weight sensitivity analysis.
2026-04-07 11:15:48 -05:00
7f0e1f4182 Add Livebook notebook for propagation algorithm analysis
Connects to local dev DB to analyze contacts, HRRR conditions,
terrain impact, commercial link correlation, and score sensitivity.
Ready for use once prod data is imported locally.
2026-04-07 11:15:48 -05:00
FluxCD
f8f2450ec1 chore: update prop image to git.mcintire.me/graham/prop:main-1775566243-7f457e4 [skip ci] 2026-04-07 12:51:39 +00:00
214b706ba8 Remove icons from navigation links in map control panels 2026-04-07 07:50:39 -05:00
976cd1a4c5 Remove icons from navigation links in map control panels 2026-04-07 07:50:36 -05:00
d1e42dd8a0 Smooth viewshed boundary to remove SRTM elevation spikes
Apply 5-point circular moving average to reach_km values before
rendering the boundary polygon. Eliminates sharp spikes caused by
isolated terrain anomalies in SRTM data.
2026-04-07 07:42:35 -05:00
FluxCD
114f25a461 chore: update prop image to git.mcintire.me/graham/prop:main-1775565490-61e4196 [skip ci] 2026-04-07 07:42:35 -05:00
FluxCD
f17dfc7270 chore: update prop image to git.mcintire.me/graham/prop:main-1775565429-f0340a2 [skip ci] 2026-04-07 07:42:35 -05:00
a774e98350 Smooth viewshed boundary to remove SRTM elevation spikes
Apply 5-point circular moving average to reach_km values before
rendering the boundary polygon. Eliminates sharp spikes caused by
isolated terrain anomalies in SRTM data.
2026-04-07 07:42:32 -05:00
FluxCD
05fcb6f5be chore: update prop image to git.mcintire.me/graham/prop:main-1775565490-61e4196 [skip ci] 2026-04-07 12:39:36 +00:00
FluxCD
d409c190d5 chore: update prop image to git.mcintire.me/graham/prop:main-1775565429-f0340a2 [skip ci] 2026-04-07 12:38:36 +00:00
970bc29afe Remove stale propagation scores maintenance banner 2026-04-07 07:38:12 -05:00
721d59ed77 Remove stale propagation scores maintenance banner 2026-04-07 07:38:03 -05:00
51c73a3cbd Add periodic enrichment backfill cron and terrain reconciliation
Runs BackfillEnqueueWorker every 30 minutes to pick up contacts with
pending/queued/failed enrichment status and enqueue missing jobs.
Before enqueueing, reconciles terrain contacts stuck in "queued" by
checking the terrain_profiles FK directly.
2026-04-07 07:37:08 -05:00
FluxCD
ec82f4ae71 chore: update prop image to git.mcintire.me/graham/prop:main-1775513079-b5a87e0 [skip ci] 2026-04-07 07:37:08 -05:00
e03b9fbc0e Add periodic enrichment backfill cron and terrain reconciliation
Runs BackfillEnqueueWorker every 30 minutes to pick up contacts with
pending/queued/failed enrichment status and enqueue missing jobs.
Before enqueueing, reconciles terrain contacts stuck in "queued" by
checking the terrain_profiles FK directly.
2026-04-07 07:36:57 -05:00
FluxCD
8e39cfcc4c chore: update prop image to git.mcintire.me/graham/prop:main-1775513079-b5a87e0 [skip ci] 2026-04-06 22:05:15 +00:00
5bd2516c15 Bump terrain queue concurrency to 3 per pod 2026-04-06 17:04:38 -05:00
FluxCD
5583fb6167 chore: update prop image to git.mcintire.me/graham/prop:main-1775512945-6ab4ba7 [skip ci] 2026-04-06 17:04:37 -05:00
d63653e9a1 Bump terrain queue concurrency to 3 per pod 2026-04-06 17:04:26 -05:00
FluxCD
7c7dc80acf chore: update prop image to git.mcintire.me/graham/prop:main-1775512945-6ab4ba7 [skip ci] 2026-04-06 22:03:25 +00:00
f2e6512974 Re-enable hourly propagation grid scoring in production 2026-04-06 17:02:18 -05:00
c68e1ba108 Re-enable hourly propagation grid scoring in production 2026-04-06 17:02:12 -05:00
FluxCD
da4979751d chore: update prop image to git.mcintire.me/graham/prop:main-1775512477-be9b890 [skip ci] 2026-04-06 17:02:12 -05:00
FluxCD
25df2e6766 chore: update prop image to git.mcintire.me/graham/prop:main-1775509847-dcf5190 [skip ci] 2026-04-06 17:02:12 -05:00
FluxCD
c6c4214a91 chore: update prop image to git.mcintire.me/graham/prop:main-1775512477-be9b890 [skip ci] 2026-04-06 21:56:05 +00:00
79130a39e8 Mark terrain status complete when profile already exists
TerrainProfileWorker early-exited with :ok when a profile existed
but never updated the contact status, leaving contacts stuck at queued.
2026-04-06 16:54:29 -05:00
25d7ec317a Mark terrain status complete when profile already exists
TerrainProfileWorker early-exited with :ok when a profile existed
but never updated the contact status, leaving contacts stuck at queued.
2026-04-06 16:54:23 -05:00
FluxCD
00bacae2c2 chore: update prop image to git.mcintire.me/graham/prop:main-1775499376-15ec8af [skip ci] 2026-04-06 16:54:23 -05:00
FluxCD
366258e329 chore: update prop image to git.mcintire.me/graham/prop:main-1775509847-dcf5190 [skip ci] 2026-04-06 21:11:31 +00:00
646467cf4d Store stub records on empty weather fetches to prevent infinite backfill retries
When ASOS/RAOB/IEMRE APIs return empty data, store a stub record so
dedup checks (has_surface_observations?, has_sounding?, has_iemre_observation?)
see coverage and don't recreate the same jobs on future backfill runs.
2026-04-06 16:10:39 -05:00
1f7e9e18a4 Store stub records on empty weather fetches to prevent infinite backfill retries
When ASOS/RAOB/IEMRE APIs return empty data, store a stub record so
dedup checks (has_surface_observations?, has_sounding?, has_iemre_observation?)
see coverage and don't recreate the same jobs on future backfill runs.
2026-04-06 16:10:28 -05:00
FluxCD
a6ae6ce973 chore: update prop image to git.mcintire.me/graham/prop:main-1775499376-15ec8af [skip ci] 2026-04-06 18:17:26 +00:00
c3819112fe Persist checkbox and limit state across backfill enqueue submissions 2026-04-06 12:46:08 -05:00
FluxCD
ef44109351 chore: update prop image to git.mcintire.me/graham/prop:main-1775494893-2fd0175 [skip ci] 2026-04-06 17:02:37 +00:00
98289ec16e Fix format_number reversing digits
Enum.reverse/1 was reversing each chunk's characters, scrambling the
displayed numbers (e.g. 58,363 displayed as 85,363).
2026-04-06 12:01:25 -05:00
FluxCD
f9e2ba294d chore: update prop image to git.mcintire.me/graham/prop:main-1775494509-975e6c9 [skip ci] 2026-04-06 16:56:34 +00:00
9ffeba3fc9 Suppress health check request logs
/health gets hit constantly by k8s probes, drowning out useful logs.
2026-04-06 11:55:01 -05:00
FluxCD
88783765f1 chore: update prop image to git.mcintire.me/graham/prop:main-1775494141-8768175 [skip ci] 2026-04-06 16:50:32 +00:00
4ba7269e57 Prioritize pending contacts over queued in backfill
Queued contacts just need reconciliation (check if data exists),
while pending contacts need actual HRRR fetches. Process pending
first so real work happens before reconciliation.
2026-04-06 11:48:55 -05:00
FluxCD
89eafcb1b0 chore: update prop image to git.mcintire.me/graham/prop:main-1775493753-3737842 [skip ci] 2026-04-06 16:43:31 +00:00
e99e585b66 Add type filter to backfill enqueue
Backfill dashboard now has checkboxes to select which enrichment types
to process (HRRR, Weather, Terrain, IEMRE). Prevents weather jobs from
flooding the queue when only HRRR needs work.
2026-04-06 11:42:26 -05:00
FluxCD
ca6e836bd9 chore: update prop image to git.mcintire.me/graham/prop:main-1775491184-a80a981 [skip ci] 2026-04-06 16:00:21 +00:00
89ade2e8cc Bump HRRR queue concurrency from 1 to 5 per pod
15 concurrent HRRR fetches across 3 pods to process the 16,870
contacts that need fresh HRRR data from NOAA.
2026-04-06 10:54:45 -05:00
FluxCD
023fef4d8c chore: update prop image to git.mcintire.me/graham/prop:main-1775490031-fda468c [skip ci] 2026-04-06 15:41:17 +00:00
0e885001bc Widen HRRR profile spatial matching from 0.05° to 0.07°
The propagation grid stores profiles at 0.125° intervals, so contacts
up to 0.0625° from a grid point would miss with the old 0.05° tolerance.
This caused has_hrrr_profile? and find_nearest_hrrr to fail matching
against existing data, leaving contacts incorrectly stuck as pending.
2026-04-06 10:40:25 -05:00
FluxCD
a8f6a3b0e8 chore: update prop image to git.mcintire.me/graham/prop:main-1775489105-fbfd9ea [skip ci] 2026-04-06 15:26:12 +00:00