Commit graph

15 commits

Author SHA1 Message Date
234fc2010f
Implement critical performance optimizations and error handling
This commit introduces several major performance improvements and adds
robust error handling for malformed HTTP requests:

Performance Optimizations:
- Add database migration with BRIN indexes for time-series data and partial
  indexes for recent queries, significantly improving query performance
- Create global StreamingPacketsPubSub system for real-time packet distribution
  with geographic bounds filtering using ETS for fast lookups
- Refactor PacketConsumer to use Stream module for memory-efficient processing,
  preventing memory accumulation during batch operations
- Implement dedicated BroadcastTaskSupervisor pool for async broadcast operations,
  preventing GenServer blocking on I/O
- Increase database connection pool from 25 to 45 (production) and 15 to 30 (dev)
  for better concurrency support

Error Handling:
- Add SentryFilter to prevent Bandit.HTTPError from missing Host headers from
  cluttering Sentry (common with bots/scanners)
- Configure custom 400 Bad Request error handling
- Filter out common bot/scanner paths from error reporting

All changes include comprehensive test coverage following TDD practices.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-18 18:19:49 -05:00
4b159ba0b7
cleanup 2025-07-18 14:44:52 -05:00
8d5bfe127e
add email 2025-07-18 10:15:09 -05:00
53c88d2262
postgres optimization 2025-07-15 09:06:40 -05:00
38f240b3eb
fix info/neighbor page loading 2025-07-10 14:43:00 -05:00
711d92ebb6
performance improvements 2025-07-08 10:03:52 -05:00
eafa0feff5
js tweak 2025-07-05 13:16:37 -05:00
172da7d393
upgrade more with modern phoenix 2025-07-05 08:04:06 -05:00
91cd2688f7
db timeout increase 2025-06-25 08:57:45 -05:00
ce7c50caa1
refactor to use external parser 2025-06-24 14:22:09 -05:00
f6f1ad1e2f
updates 2025-06-21 11:55:30 -05:00
369ce05f1a
typescript 2025-06-18 12:26:13 -05:00
506e5550b4
postgis 2025-06-16 09:58:17 -05:00
ff9eb9c614 update everything 2025-01-22 12:12:39 -06:00
d40567dfeb initial 2023-01-26 13:20:23 -06:00