aacf51637e
Add session affinity to service for stable LiveView websockets
2026-04-06 09:48:24 -05:00
2de94e2318
Add Erlang clustering via libcluster and expose LiveDashboard
...
- libcluster with Kubernetes IP strategy for pod discovery
- RBAC for pod list/get, POD_IP from downward API, shared cookie
- LiveDashboard at /dashboard for all environments
2026-04-06 09:46:48 -05:00
FluxCD
f118452035
chore: update prop image to git.mcintire.me/graham/prop:main-1775486348-7654146 [skip ci]
2026-04-06 14:40:34 +00:00
8cca7461d4
Reduce DB pool size to 20 for 3-replica deployment
...
3 replicas × 50 connections exceeded max_connections during rollout.
20 per replica = 60 steady-state, 120 during rolling deploy.
2026-04-06 09:38:59 -05:00
FluxCD
cef08fe1e3
chore: update prop image to git.mcintire.me/graham/prop:main-1775486208-faa7055 [skip ci]
2026-04-06 14:37:33 +00:00
69cfda7e8c
Scale to 3 replicas spread across physical hosts
...
- 3 replicas with pod anti-affinity on physical-host topology key
- Tolerate control-plane taint so pods can schedule on cp nodes
2026-04-06 09:36:37 -05:00
FluxCD
be0dfd898d
chore: update prop image to git.mcintire.me/graham/prop:main-1775485649-949ed16 [skip ci]
2026-04-06 14:30:31 +00:00
05159c540a
Trigger CI build
2026-04-06 09:27:21 -05:00
a11a3ec775
Add k8s manifests and Forgejo CI for cluster deployment
2026-04-06 09:25:24 -05:00
99470a6b23
Remove analyze_all_tables migration
2026-04-06 09:11:35 -05:00
5bee273442
Combine active jobs and completed cards on backfill dashboard
2026-04-06 09:03:44 -05:00
bb32e12c6a
Fix backfill progress layout - wider card, no text wrapping
2026-04-06 09:02:32 -05:00
95d7fc0c39
Show per-type enrichment progress bars on backfill dashboard
2026-04-06 08:59:38 -05:00
f4d3773e2b
Fix backfill progress to use exact counts instead of pg_stat estimates
2026-04-06 08:54:30 -05:00
0b68cb2d29
Disable propagation grid worker and add maintenance banner to map
2026-04-05 17:08:40 -05:00
2f65ec8dff
Reduce HRRR worker concurrency to 3
2026-04-05 16:20:23 -05:00
94d1ce2809
Increase DB pool size to 50 to prevent connection exhaustion under load
2026-04-05 12:54:21 -05:00
8d008ba934
Add logging to WeatherFetchWorker for ASOS and RAOB fetches
2026-04-05 10:26:10 -05:00
7fd8f3165c
Add deterministic tiebreaker to contacts sort order
2026-04-05 09:27:34 -05:00
d1b1b4cc7e
Show flag emoji on contacts list for flagged_invalid contacts
2026-04-05 09:15:02 -05:00
ad1b01807c
Batch is_grid_point backfill and reduce HRRR workers to 5
...
- Split migration backfill into 50k-row batches to avoid container timeout
- Reduce prod HRRR worker concurrency from 10 to 5
2026-04-05 08:06:20 -05:00
16883591b4
Database performance fixes and async backfill enqueue
...
- Fix score_pressure crash on nil pressure_mb (coastal HRRR points)
- Set 10-min timeout on grid score upsert transaction (was :infinity)
- Single DELETE for prune_old_scores instead of N queries in a loop
- Remove dead load_hrrr_refractivity that loaded 95k rows into nil map
- Pass selected_time to point_detail to skip latest_valid_time sub-query
- Batch station existence checks (1 query per path point, not per station)
- Batch solar index upserts via insert_all in chunks of 500
- Batch backfill_distances via single UPDATE FROM VALUES statement
- Add is_grid_point boolean + partial index to hrrr_profiles (replaces
non-sargable modular arithmetic filter on every weather map query)
- Add partial index on contacts(qso_timestamp) WHERE pos1 IS NOT NULL
- Move backfill enqueue to Oban worker so UI returns immediately
2026-04-04 19:19:18 -05:00
a209fc65ae
Restrict enrichment enqueue to T-Mobile CGNAT subnet (172.56.0.0/13)
...
Store remote_ip in session, check subnet in LiveView mount before
enqueuing weather/HRRR/terrain/solar enrichment jobs.
2026-04-04 18:55:42 -05:00
dc66252fdc
Reduce dead tuples by using conditional upserts and skip-on-conflict
...
- HRRR, IEMRE, terrain: on_conflict: :nothing (immutable data)
- Surface obs, soundings, solar: conditional WHERE (only update when values differ)
- set_enrichment_status!: skip rows already at target status
2026-04-04 17:32:57 -05:00
383c18e50a
Show IEMRE gridded reanalysis data on contact detail page
2026-04-04 11:35:30 -05:00
da490f7c59
Add tooltip to enrichment badge showing per-type status
2026-04-04 11:26:35 -05:00
2a3309ca13
Migrate healthchecks from CHECKS to app.json
2026-04-04 11:24:56 -05:00
6d2f1fb4c3
Fix swapped Submitted/Enriched column headers
2026-04-04 11:22:06 -05:00
72b272cf5c
Add enrichment status badge column to contacts table
2026-04-04 11:15:18 -05:00
915e8bdccf
Add UTC labels to Timestamp and Added column headers
2026-04-04 11:11:01 -05:00
95a2afaa01
Add inserted_at column to contacts table
2026-04-04 10:51:39 -05:00
e107706915
Show dead tuple counts on backfill dashboard, fix table visibility during vacuum
...
Removed n_live_tup > 0 filter that hid tables when pg_stats reports 0 rows
during VACUUM. Added dead tuple column with warning highlight to monitor
vacuum progress. Also includes Styler reformatting and unused dep cleanup.
2026-04-04 10:45:06 -05:00
23aa2786ab
Skip updating unchanged scores to reduce dead tuples, tune autovacuum
...
ON CONFLICT now only replaces score/factors when the score actually changed,
avoiding dead tuple generation for the ~80% of grid points that don't change
between consecutive HRRR runs.
Migration sets aggressive autovacuum on propagation_scores: zero cost delay,
2000 cost limit, 1% scale factor. The table was at 72GB with 108M dead rows
because default autovacuum couldn't keep pace with 14M upserts per hour.
2026-04-04 09:53:45 -05:00
4759c65809
Support two-callsign search on contacts page to find contacts between a pair
2026-04-04 09:29:32 -05:00
f411045242
Add layer descriptions to weather map control panel
2026-04-03 17:21:02 -05:00
bf8c6d4789
Add color scales and detail panel entries for upper-air weather layers
2026-04-03 16:54:13 -05:00
08844d3515
Add grouped upper-air and ducting layer buttons to weather map
2026-04-03 16:53:22 -05:00
9cbf8b91f4
Derive upper-air weather layers from HRRR profiles in weather grid queries
2026-04-03 16:52:01 -05:00
489a886b0e
Add WeatherLayers module for deriving upper-air map fields from HRRR profiles
2026-04-03 16:49:17 -05:00
109558f7cc
Add weather map link to propagation map sidebar
2026-04-03 15:16:05 -05:00
b176390b7b
Add WeatherMap JS hook with canvas heatmap and 6 weather layers
2026-04-03 15:15:23 -05:00
1796ee4cb7
Add WeatherMapLive LiveView with layer pill buttons
2026-04-03 15:11:55 -05:00
10390f3d07
Broadcast weather:updated PubSub after HRRR profiles stored
2026-04-03 15:10:16 -05:00
0dd695c574
Add weather grid query functions for /weather map page
2026-04-03 15:08:21 -05:00
411951147a
Use ON CONFLICT DO NOTHING for HRRR backfill to prevent table bloat
2026-04-03 13:29:15 -05:00
1c7c980cf4
Debounce backfill dashboard updates to once per second
2026-04-03 10:52:24 -05:00
8d84bd2d18
Prune propagation scores per valid_time to avoid massive single DELETE
2026-04-03 10:46:17 -05:00
33490d37d0
Chunk batch inserts to avoid Postgres parameter limit, add ANALYZE migration
2026-04-03 09:34:02 -05:00
b4012baf89
Increase Oban queue concurrency for backfill throughput
2026-04-03 09:15:04 -05:00
ebeaaa06e4
Use batch insert for HRRR profiles, tune Postgres for 16GB host
2026-04-03 09:12:24 -05:00
