Graham McIntire
b984794571
PropagationGridWorker.merge_commercial_link_data/2 called
Commercial.link_degradation_at twice per grid cell (once to count,
once to merge), and each call re-ran enabled_links plus two sample
queries per in-range link. That was ~500k SQL queries per forecast
hour — fine for the DB but catastrophic for log volume in dev
iex sessions trying to watch a chain step run.
Split into two new functions:
* build_link_lookup/2 does all the DB work up front — one
enabled_links query + one link_degradation per enabled link
(~10 queries total).
* link_degradation_from_lookup/3 is pure: takes a (lat, lon)
and the precomputed lookup, returns the aggregate or nil.
The worker now calls build_link_lookup once per forecast hour and
the per-cell path is haversine-only. Net: 500k queries → ~10.
PipelineStatus freshness detection moves off oban_jobs.completed_at
onto ScoresFile.latest_valid_time(). The on-disk files ARE the data
the map renders from, so the chip's "Up to date · Nm ago" and the
2h stale threshold now track actual data presence. Running-state
detection still comes from oban_jobs since the chain step is still
an Oban row. Tests updated to seed a ScoresFile instead of a
completed Oban row for the idle/stale cases.
|
||
|---|---|---|
| .. | ||
| asos_nudge_test.exs | ||
| band_config_test.exs | ||
| duct_test.exs | ||
| grid_score_test.exs | ||
| grid_test.exs | ||
| inversion_test.exs | ||
| model_test.exs | ||
| pipeline_status_test.exs | ||
| recalibrator_test.exs | ||
| region_test.exs | ||
| score_cache_test.exs | ||
| scorer_diff_test.exs | ||
| scorer_test.exs | ||
| scores_file_test.exs | ||