Commit graph

134 commits

Author SHA1 Message Date
FluxCD
c3f1875df8 chore: update prop image to git.mcintire.me/graham/prop:main-1777145135-77bc894 [skip ci] 2026-04-25 19:35:19 +00:00
FluxCD
2ae9befd7f chore: update prop image to git.mcintire.me/graham/prop:main-1777144814-fb0c4f7 [skip ci] 2026-04-25 19:23:15 +00:00
FluxCD
5a0bd3bbf5 chore: update prop image to git.mcintire.me/graham/prop:main-1777141855-b34b186 [skip ci] 2026-04-25 18:41:06 +00:00
FluxCD
e255fcf3b6 chore: update prop image to git.mcintire.me/graham/prop:main-1777141619-be11749 [skip ci] 2026-04-25 18:29:01 +00:00
FluxCD
7ca9381ba6 chore: update prop image to git.mcintire.me/graham/prop:main-1777139917-9e776a0 [skip ci] 2026-04-25 18:02:52 +00:00
FluxCD
0f21821ca5 chore: update prop image to git.mcintire.me/graham/prop:main-1777137248-e40ade3 [skip ci] 2026-04-25 17:16:34 +00:00
FluxCD
6fa65657ee chore: update prop image to git.mcintire.me/graham/prop:main-1777132397-6aa91e7 [skip ci] 2026-04-25 15:56:16 +00:00
FluxCD
15050bd2d8 chore: update prop image to git.mcintire.me/graham/prop:main-1777129865-90bf44c [skip ci] 2026-04-25 15:15:58 +00:00
FluxCD
0ebe0e2111 chore: update prop image to git.mcintire.me/graham/prop:main-1777129708-c17f912 [skip ci] 2026-04-25 15:10:50 +00:00
FluxCD
ff5b0acf98 chore: update prop image to git.mcintire.me/graham/prop:main-1777129494-1399658 [skip ci] 2026-04-25 15:07:35 +00:00
FluxCD
8fae4d30bb chore: update prop image to git.mcintire.me/graham/prop:main-1777128883-938af4d [skip ci] 2026-04-25 14:56:57 +00:00
FluxCD
b525a4c34e chore: update prop image to git.mcintire.me/graham/prop:main-1777128564-3e458fb [skip ci] 2026-04-25 14:51:55 +00:00
FluxCD
82a83977ca chore: update prop image to git.mcintire.me/graham/prop:main-1777125492-0e0529c [skip ci] 2026-04-25 14:00:28 +00:00
FluxCD
64d4297a88 chore: update prop image to git.mcintire.me/graham/prop:main-1777125078-f0fa9e0 [skip ci] 2026-04-25 13:53:27 +00:00
FluxCD
5ac8340ba4 chore: update prop image to git.mcintire.me/graham/prop:main-1777079868-2e5b61f [skip ci] 2026-04-25 01:21:33 +00:00
FluxCD
46000e7d4d chore: update prop image to git.mcintire.me/graham/prop:main-1777077860-3b25add [skip ci] 2026-04-25 00:46:24 +00:00
FluxCD
41510840fb chore: update prop image to git.mcintire.me/graham/prop:main-1777076889-3ac6963 [skip ci] 2026-04-25 00:34:20 +00:00
FluxCD
f6ddf38071 chore: update prop image to git.mcintire.me/graham/prop:main-1777074592-4f82bd6 [skip ci] 2026-04-24 23:52:47 +00:00
FluxCD
2db8717d37 chore: update prop image to git.mcintire.me/graham/prop:main-1777066814-e192ca3 [skip ci] 2026-04-24 21:43:10 +00:00
FluxCD
36049808a4 chore: update prop image to git.mcintire.me/graham/prop:main-1777065178-560be6c [skip ci] 2026-04-24 21:14:57 +00:00
FluxCD
d6c6d1548d chore: update prop image to git.mcintire.me/graham/prop:main-1777063737-03c91f4 [skip ci] 2026-04-24 20:51:32 +00:00
FluxCD
609f04f649 chore: update prop image to git.mcintire.me/graham/prop:main-1777063515-13fad93 [skip ci] 2026-04-24 20:47:29 +00:00
FluxCD
b81b482119 chore: update prop image to git.mcintire.me/graham/prop:main-1777063066-ea69712 [skip ci] 2026-04-24 20:40:25 +00:00
FluxCD
3965404107 chore: update prop image to git.mcintire.me/graham/prop:main-1777057754-a6c5c40 [skip ci] 2026-04-24 19:12:02 +00:00
FluxCD
760024de38 chore: update prop image to git.mcintire.me/graham/prop:main-1777056798-32e7ccc [skip ci] 2026-04-24 18:55:51 +00:00
FluxCD
0e877f889a chore: update prop image to git.mcintire.me/graham/prop:main-1777055945-fa7052b [skip ci] 2026-04-24 18:41:48 +00:00
FluxCD
aab3ceddd7 chore: update prop image to git.mcintire.me/graham/prop:main-1777055130-525d9c4 [skip ci] 2026-04-24 18:27:52 +00:00
FluxCD
d8cdefbb7e chore: update prop image to git.mcintire.me/graham/prop:main-1777054811-74f6283 [skip ci] 2026-04-24 18:24:09 +00:00
FluxCD
6dbf6f1b03 chore: update prop image to git.mcintire.me/graham/prop:main-1777053964-e466879 [skip ci] 2026-04-24 18:08:06 +00:00
FluxCD
8c75ca640a chore: update prop image to git.mcintire.me/graham/prop:main-1777053457-95c9ac3 [skip ci] 2026-04-24 18:00:43 +00:00
FluxCD
78f9bfc1e1 chore: update prop image to git.mcintire.me/graham/prop:main-1777052679-c073c6a [skip ci] 2026-04-24 17:48:17 +00:00
FluxCD
37efaaa96d chore: update prop image to git.mcintire.me/graham/prop:main-1777052040-100be89 [skip ci] 2026-04-24 17:42:07 +00:00
100be89c06
chore: drop OpenTelemetry
Removes the six OTel packages (opentelemetry, _api, _exporter,
_phoenix, _oban, _bandit) and their 9 transitive deps. Tracing was
only wired for Phoenix/Bandit/Oban auto-instrumentation — PromEx
already covers the metrics we actually use on the status page +
Grafana. Also drops the OTEL_EXPORTER_OTLP_ENDPOINT env var and
its comment block from both deployment manifests.
2026-04-24 12:33:38 -05:00
FluxCD
85f402b8dd chore: update prop image to git.mcintire.me/graham/prop:main-1777050827-98aab76 [skip ci] 2026-04-24 17:17:37 +00:00
FluxCD
4a4de2a336 chore: update prop image to git.mcintire.me/graham/prop:main-1777050231-d100e56 [skip ci] 2026-04-24 17:06:30 +00:00
FluxCD
dcec2b3b37 chore: update prop image to git.mcintire.me/graham/prop:main-1777046003-0bc8af2 [skip ci] 2026-04-24 15:57:12 +00:00
0bc8af22dd
fix(k8s): narrow backfill anti-affinity to tier=hot to unblock rollouts
Root cause of the deadlock prod hit today:

- prop-backfill's podAntiAffinity matched `app: prop`, which applies to
  backfill pods themselves as well as hot pods.
- The hot Deployment runs maxSurge=1/maxUnavailable=1 with HPA min 2 /
  max 5; when HPA was pegged at max and a rollout began, the old
  ReplicaSet's requiredDuringScheduling/IgnoredDuringExecution rule
  stayed pinned on every already-running hot pod.
- backfill's rule then excluded new hot pods from every physical host
  that had an app=prop pod on it, which was all of them, and the
  rollout couldn't progress because no old hot pod could come down
  until a new one went Ready first.

Narrowing the selector to `{app: prop, tier: hot}` means:
- backfill never constrains itself (it carries tier=backfill).
- Hot pods carry no anti-affinity of their own, so HPA can continue
  past the 4-physical-host count by co-locating when it has to.
- Backfill still lands on whichever physical host hot pods haven't
  filled up, which is the original intent.
2026-04-24 10:53:05 -05:00
FluxCD
b2766c8a90 chore: update prop image to git.mcintire.me/graham/prop:main-1777044777-080257f [skip ci] 2026-04-24 15:36:24 +00:00
FluxCD
35a064b1a4 chore: update prop image to git.mcintire.me/graham/prop:main-1777043748-d88bdd7 [skip ci] 2026-04-24 15:17:56 +00:00
FluxCD
825d2baa10 chore: update prop image to git.mcintire.me/graham/prop:main-1777041055-2900b9a [skip ci] 2026-04-24 14:33:44 +00:00
FluxCD
b057b45fe7 chore: update prop image to git.mcintire.me/graham/prop:main-1777039919-d7d865d [skip ci] 2026-04-24 14:16:37 +00:00
FluxCD
a1ccbeb3e5 chore: update prop image to git.mcintire.me/graham/prop:main-1777038907-5d9f02d [skip ci] 2026-04-24 14:07:30 +00:00
FluxCD
141cb6faf4 chore: update prop image to git.mcintire.me/graham/prop:main-1777037259-5564b67 [skip ci] 2026-04-24 13:30:18 +00:00
FluxCD
0f46d4361a chore: update prop image to git.mcintire.me/graham/prop:main-1776987814-f99d07b [skip ci] 2026-04-23 23:45:30 +00:00
FluxCD
53dc08d659 chore: update prop image to git.mcintire.me/graham/prop:main-1776981668-109c4e1 [skip ci] 2026-04-23 22:04:43 +00:00
FluxCD
731c095840 chore: update prop image to git.mcintire.me/graham/prop:main-1776979115-bd107ee [skip ci] 2026-04-23 21:21:30 +00:00
FluxCD
e33116f759 chore: update prop image to git.mcintire.me/graham/prop:main-1776977813-a7250c3 [skip ci] 2026-04-23 20:59:24 +00:00
FluxCD
d66ac0b2a2 chore: update prop image to git.mcintire.me/graham/prop:main-1776971976-54cabdb [skip ci] 2026-04-23 19:22:42 +00:00
FluxCD
8435d95900 chore: update prop image to git.mcintire.me/graham/prop:main-1776971633-56e6a35 [skip ci] 2026-04-23 19:16:38 +00:00
FluxCD
eb0eaa2416 chore: update prop image to git.mcintire.me/graham/prop:main-1776971365-41573d4 [skip ci] 2026-04-23 19:12:16 +00:00