Graham McIntire
1a1ba460e4
Ecto auto-instrumentation created one span per query, so Oban jobs running thousands of DB ops produced traces with 8k+ child spans. Tempo's compactor couldn't ingest them — it stalled long enough to miss heartbeats, got auto-forgotten from the ring, and crash-looped. The Elixir grpcbox exporter then blew up trying to reconnect. Stops the cascade: OTLP endpoint removed from prop and prop-backfill Deployments, opentelemetry_ecto removed from deps, Phoenix/Oban/Bandit auto-instrumentation retained. Rust workers still export to Tempo. |
||
|---|---|---|
| .. | ||
| deployment-backfill.yaml | ||
| deployment-grid-rs.yaml | ||
| deployment-hrrr-point-rs.yaml | ||
| deployment.yaml | ||
| flux.yaml | ||
| kustomization.yaml | ||
| metrics-service.yaml | ||
| namespace.yaml | ||
| rbac.yaml | ||
| service.yaml | ||