graham/prop
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
997 commits 1 branch 0 tags 8.1 MiB
Commit graph

263 commits

Author SHA1 Message Date
FluxCD
bc7f3f4137 chore: update prop image to git.mcintire.me/graham/prop:main-1776360998-36adf87 [skip ci] 2026-04-16 17:37:37 +00:00
FluxCD
90df646c94 chore: update prop image to git.mcintire.me/graham/prop:main-1776360352-11a50bf [skip ci] 2026-04-16 17:27:34 +00:00
FluxCD
5e5663fbb1 chore: update prop image to git.mcintire.me/graham/prop:main-1776360188-01d554f [skip ci] 2026-04-16 17:24:33 +00:00
FluxCD
1a8e55dfb0 chore: update prop image to git.mcintire.me/graham/prop:main-1776355088-bbeb95f [skip ci] 2026-04-16 15:59:59 +00:00
FluxCD
824143ad64 chore: update prop image to git.mcintire.me/graham/prop:main-1776351221-be6f1a1 [skip ci] 2026-04-16 14:55:32 +00:00
FluxCD
c1cac4f394 chore: update prop image to git.mcintire.me/graham/prop:main-1776350332-f005ddc [skip ci] 2026-04-16 14:40:29 +00:00
FluxCD
a2cdee7a31 chore: update prop image to git.mcintire.me/graham/prop:main-1776349903-55d4f28 [skip ci] 2026-04-16 14:33:27 +00:00
FluxCD
f5132a991d chore: update prop image to git.mcintire.me/graham/prop:main-1776349371-3604896 [skip ci] 2026-04-16 14:24:23 +00:00
FluxCD
9e94759f7a chore: update prop image to git.mcintire.me/graham/prop:main-1776347847-7857d3b [skip ci] 2026-04-16 13:59:17 +00:00
FluxCD
17271b264a chore: update prop image to git.mcintire.me/graham/prop:main-1776347392-1d740ca [skip ci] 2026-04-16 13:50:15 +00:00
FluxCD
437eeb1c47 chore: update prop image to git.mcintire.me/graham/prop:main-1776346020-1f2a729 [skip ci] 2026-04-16 13:31:10 +00:00
FluxCD
d70444dd06 chore: update prop image to git.mcintire.me/graham/prop:main-1776297271-6169b31 [skip ci] 2026-04-15 23:58:22 +00:00
FluxCD
8320becee7 chore: update prop image to git.mcintire.me/graham/prop:main-1776291073-13180d5 [skip ci] 2026-04-15 22:12:52 +00:00
FluxCD
7c5cbcfdcd chore: update prop image to git.mcintire.me/graham/prop:main-1776290697-26015ce [skip ci] 2026-04-15 22:05:50 +00:00
FluxCD
04c8a92db8 chore: update prop image to git.mcintire.me/graham/prop:main-1776287079-9a78f8c [skip ci] 2026-04-15 21:06:23 +00:00
FluxCD
b5fb158fa4 chore: update prop image to git.mcintire.me/graham/prop:main-1776284076-529102d [skip ci] 2026-04-15 20:16:11 +00:00
FluxCD
ba23ca2b3e chore: update prop image to git.mcintire.me/graham/prop:main-1776283206-6d69989 [skip ci] 2026-04-15 20:04:08 +00:00
FluxCD
fa2c9643c9 chore: update prop image to git.mcintire.me/graham/prop:main-1776282948-923c8a4 [skip ci] 2026-04-15 19:57:06 +00:00
FluxCD
6a33866133 chore: update prop image to git.mcintire.me/graham/prop:main-1776282553-83ea123 [skip ci] 2026-04-15 19:51:05 +00:00
FluxCD
33524ece3d chore: update prop image to git.mcintire.me/graham/prop:main-1776282255-f632ea8 [skip ci] 2026-04-15 19:46:04 +00:00
FluxCD
8afbe1932f chore: update prop image to git.mcintire.me/graham/prop:main-1776281892-361b9de [skip ci] 2026-04-15 19:42:03 +00:00
FluxCD
139f9f72ea chore: update prop image to git.mcintire.me/graham/prop:main-1776280977-91c8cc9 [skip ci] 2026-04-15 19:23:59 +00:00
FluxCD
1d0aa2848e chore: update prop image to git.mcintire.me/graham/prop:main-1776280381-118ad4e [skip ci] 2026-04-15 19:13:57 +00:00
FluxCD
ffc81b789e chore: update prop image to git.mcintire.me/graham/prop:main-1776279469-725a7e6 [skip ci] 2026-04-15 18:58:50 +00:00
FluxCD
cacce902d3 chore: update prop image to git.mcintire.me/graham/prop:main-1776278588-790eef1 [skip ci] 2026-04-15 18:44:46 +00:00
FluxCD
b889761a8e chore: update prop image to git.mcintire.me/graham/prop:main-1776273287-02b354f [skip ci] 2026-04-15 17:16:19 +00:00
FluxCD
fe9fb2a66f chore: update prop image to git.mcintire.me/graham/prop:main-1776272300-c3616b3 [skip ci] 2026-04-15 17:00:14 +00:00
FluxCD
84ffdcd261 chore: update prop image to git.mcintire.me/graham/prop:main-1776269371-7fcb271 [skip ci] 2026-04-15 16:11:01 +00:00
FluxCD
b76080bb0c chore: update prop image to git.mcintire.me/graham/prop:main-1776268032-e227978 [skip ci] 2026-04-15 15:48:57 +00:00
FluxCD
30b4baf792 chore: update prop image to git.mcintire.me/graham/prop:main-1776267507-222d0fd [skip ci] 2026-04-15 15:39:51 +00:00
FluxCD
c6d6d3f097 chore: update prop image to git.mcintire.me/graham/prop:main-1776265627-a9fa1d8 [skip ci] 2026-04-15 15:07:44 +00:00
FluxCD
ad31f6763d chore: update prop image to git.mcintire.me/graham/prop:main-1776265421-1a9df52 [skip ci] 2026-04-15 15:04:43 +00:00
FluxCD
4c1ef56537 chore: update prop image to git.mcintire.me/graham/prop:main-1776261922-11617e7 [skip ci] 2026-04-15 14:06:31 +00:00
FluxCD
9d2d67305e chore: update prop image to git.mcintire.me/graham/prop:main-1776260243-32fdb25 [skip ci] 2026-04-15 13:38:26 +00:00
FluxCD
3273a578b9 chore: update prop image to git.mcintire.me/graham/prop:main-1776259784-0c5cbbd [skip ci] 2026-04-15 13:35:24 +00:00
Graham McIntire
0c5cbbdc54
Bump prop pod memory limit 4Gi → 6Gi 
Even with the narrow HRRR grid pressure levels (4fa6798), pods are
still OOMKilled partway through the propagation chain. After the
HRRR fetch, the grid worker pipes 92k grid points through native
duct metric merge (~100 MB held for ~2 minutes), builds the full
weather grid cache (92k rows × ~40 fields), runs compute_scores
(460k score maps across 5 bands materialized in a list), and
writes five .ntms files — all while ERA5Submit workers keep
churning through CDS backfill in background processes.

Nodes have ~42% memory headroom on limits; the 2 Gi bump fits
comfortably. Shrinking the in-process allocations is a better
long-term fix but needs a proper pass through compute_scores and
persist_profiles. This gets prod unstuck in the meantime so the
forecast timeline can actually populate.
 2026-04-15 08:29:09 -05:00
FluxCD
38f6c37194 chore: update prop image to git.mcintire.me/graham/prop:main-1776259195-4fa6798 [skip ci] 2026-04-15 13:20:21 +00:00
FluxCD
e3fc09eee3 chore: update prop image to git.mcintire.me/graham/prop:main-1776206578-2d9e5a2 [skip ci] 2026-04-14 22:44:07 +00:00
FluxCD
1a394fa7ae chore: update prop image to git.mcintire.me/graham/prop:main-1776205868-572c285 [skip ci] 2026-04-14 22:32:04 +00:00
FluxCD
f57ea7b0c9 chore: update prop image to git.mcintire.me/graham/prop:main-1776205589-30c1018 [skip ci] 2026-04-14 22:28:03 +00:00
FluxCD
9f5b427116 chore: update prop image to git.mcintire.me/graham/prop:main-1776204813-92ef6c6 [skip ci] 2026-04-14 22:15:00 +00:00
FluxCD
7c5d187ac5 chore: update prop image to git.mcintire.me/graham/prop:main-1776204001-d9ec8a9 [skip ci] 2026-04-14 22:01:55 +00:00
FluxCD
63f2eca27f chore: update prop image to git.mcintire.me/graham/prop:main-1776203809-d5480ba [skip ci] 2026-04-14 21:58:55 +00:00
FluxCD
dc7bb5e110 chore: update prop image to git.mcintire.me/graham/prop:main-1776203569-7f1a7fb [skip ci] 2026-04-14 21:53:54 +00:00
FluxCD
28b6ca0ac4 chore: update prop image to git.mcintire.me/graham/prop:main-1776203013-e3ddf10 [skip ci] 2026-04-14 21:44:51 +00:00
FluxCD
c454fab83e chore: update prop image to git.mcintire.me/graham/prop:main-1776202569-1d99efb [skip ci] 2026-04-14 21:39:49 +00:00
FluxCD
0a8b5db6fe chore: update prop image to git.mcintire.me/graham/prop:main-1776202261-130e062 [skip ci] 2026-04-14 21:32:48 +00:00
FluxCD
2b4756e921 chore: update prop image to git.mcintire.me/graham/prop:main-1776201355-c9179b3 [skip ci] 2026-04-14 21:17:45 +00:00
FluxCD
b68dcddbc6 chore: update prop image to git.mcintire.me/graham/prop:main-1776198451-ab76d44 [skip ci] 2026-04-14 20:30:35 +00:00
FluxCD
c12868e0d3 chore: update prop image to git.mcintire.me/graham/prop:main-1776197620-07ff4f8 [skip ci] 2026-04-14 20:17:32 +00:00