graham/prop
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Mark Era5* queues as DEPRECATED (replaced by NARR)

Browse source
This commit is contained in:
Graham McIntire 2026-04-15 18:49:39 -05:00
parent 4aa23ae67f
commit 6169b31726
No known key found for this signature in database
GPG key ID: F4ABF488E6029E59
1 changed files with 9 additions and 7 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
config/runtime.exs
View file

@ -169,13 +169,15 @@ if config_env() == :prod do
terrain: 3,
iemre: 3,
narr: 6,
# ERA5 queues are TEMPORARILY PAUSED while we diagnose the
# zero-ingestion pipeline. Every poll in prod has been hitting
# either CDS-rejected or long-running states; no `ERA5Batch:
# stored` log line has ever fired. Pausing keeps the existing
# oban_jobs and era5_cds_jobs rows in place for inspection
# instead of deleting them. Flip `paused: true` to `paused:
# false` (or remove the key) once the root cause is fixed.
# ERA5 queues are DEPRECATED in favor of NARR via NarrFetchWorker
# (see docs/plans/2026-04-15-merra2-historical-backfill.md). The
# CDS pipeline never produced a single era5_profiles row in prod
# — every poll hit either CDS-rejected or long-running stuck
# states. NARR fetches anonymously from NCEI with no quota, no
# job queue, and the same era5_profiles table on the receiving
# side. These queues stay paused while the dead Era5* workers
# and the era5_cds_jobs table are slated for deletion in a
# follow-up PR.
era5: [local_limit: 2, paused: true],
era5_submit: [
local_limit: 4,