aprs.me/lib/aprsme
Graham McIntire 584402274c
fix: Remove all non-schema fields from parsed packets to fix database insertion
The updated APRS parser (commit 69d0ab5) adds several fields that don't exist in our database schema:
- type, digipeaters, daodatumbyte, mbits, message (duplicate of message_text)
- phg (we store individual PHG fields), wx (weather object)
- resultcode, resultmsg, gpsfixstatus

Created a centralized helper function to remove all non-schema fields before database insertion.
Also enhanced error logging to capture sample packet data for easier debugging.

This fixes the production issue where packets were failing to save to the database.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-08-04 09:33:37 -05:00
..
accounts add callsign to users 2025-07-10 16:07:05 -05:00
cluster fix: Group handle_info clauses together in LeaderElection 2025-08-01 17:49:04 -05:00
is clean up warnings 2025-07-16 08:55:46 -05:00
packets feat: Implement comprehensive performance optimizations 2025-07-30 14:14:00 -05:00
performance Fix packet buffer overflow and system load adjustment issues 2025-07-15 08:16:11 -05:00
telemetry fix: Resolve GenServer errors in tests 2025-07-30 14:33:11 -05:00
workers Fix comprehensive crash prevention and add missing RF path station markers 2025-07-28 11:56:00 -05:00
accounts.ex Fix comprehensive crash prevention and add missing RF path station markers 2025-07-28 11:56:00 -05:00
application.ex perf: Implement performance optimizations without caching 2025-08-02 09:36:50 -05:00
aprs_is_connection.ex Fix comprehensive crash prevention and add missing RF path station markers 2025-07-28 11:56:00 -05:00
archiver.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
bad_packet.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
broadcast_task_supervisor.ex Implement critical performance optimizations and error handling 2025-07-18 18:19:49 -05:00
cache.ex Add Redis-based distributed caching and rate limiting 2025-07-26 15:29:38 -05:00
callsign.ex more permissive callsign parsing 2025-07-12 09:10:49 -05:00
circuit_breaker.ex clean up warnings 2025-07-16 08:55:46 -05:00
cleanup_scheduler.ex format 2025-07-27 11:16:16 -05:00
connection_monitor.ex fix: Resolve majority of dialyzer type errors 2025-07-30 13:30:21 -05:00
convert.ex more i18n 2025-07-06 10:28:27 -05:00
data_extended.ex update deps 2025-07-16 08:20:20 -05:00
db_optimizer.ex Fix dialyzer warnings and improve type safety 2025-07-27 11:18:55 -05:00
deployment_notifier.ex Fix code formatting 2025-07-28 13:24:16 -05:00
device_cache.ex perf: Implement performance optimizations without caching 2025-08-02 09:36:50 -05:00
device_identification.ex feat: Implement comprehensive performance optimizations 2025-07-30 14:14:00 -05:00
device_parser.ex Fix Access behavior error in DeviceParser 2025-07-15 11:10:50 -05:00
devices.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
devices_seeder.ex Fix potential crashes and unsafe operations throughout the app 2025-07-28 08:35:12 -05:00
dynamic_supervisor.ex Add distributed Erlang clustering for single APRS-IS connection 2025-07-25 10:30:29 -05:00
encoding.ex format 2025-07-27 11:16:16 -05:00
encoding_utils.ex fix: Show all packets for tracked callsigns including non-position data 2025-07-30 14:02:44 -05:00
error_handler.ex clean up warnings 2025-07-16 08:55:46 -05:00
geo_utils.ex Increase GPS drift threshold from 15m to 50m 2025-07-21 11:23:37 -05:00
log_sanitizer.ex performance improvements 2025-07-08 10:03:52 -05:00
mailer.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
migration_lock.ex format 2025-07-27 11:16:16 -05:00
packet.ex feat: Update code to handle improved APRS parser features 2025-08-01 18:16:44 -05:00
packet_consumer.ex fix: Remove all non-schema fields from parsed packets to fix database insertion 2025-08-04 09:33:37 -05:00
packet_consumer_pool.ex Fix packet buffer overflow with parallel consumer pool 2025-07-19 14:49:52 -05:00
packet_counter.ex performance improvements 2025-07-14 16:35:58 -05:00
packet_pipeline_setup.ex add packet batcher 2025-06-24 15:06:09 -05:00
packet_pipeline_supervisor.ex Fix packet buffer overflow with parallel consumer pool 2025-07-19 14:49:52 -05:00
packet_producer.ex Revert all packet processing optimizations to fix buffer overflow 2025-07-15 08:44:26 -05:00
packet_replay.ex clean up warnings 2025-07-16 08:55:46 -05:00
packet_replay_behaviour.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
packets.ex updates with parser updates 2025-08-03 09:19:31 -05:00
packets_behaviour.ex refactor: Remove CachedQueries and rename optimized functions 2025-07-30 13:17:56 -05:00
passcode.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
postgres_notifier.ex Improve info page live updates and fix APRS parser 2025-07-28 15:14:33 -05:00
postgres_types.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
presence.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
rate_limiter.ex update deps 2025-07-16 08:20:20 -05:00
rate_limiter_wrapper.ex Add Redis-based distributed caching and rate limiting 2025-07-26 15:29:38 -05:00
redis_cache.ex Fix comprehensive crash prevention and add missing RF path station markers 2025-07-28 11:56:00 -05:00
redis_rate_limiter.ex Fix code formatting in redis_rate_limiter.ex 2025-07-28 12:07:45 -05:00
regex_cache.ex perf: Implement performance optimizations without caching 2025-08-02 09:36:50 -05:00
release.ex Add deployment notification system to update timestamp in LiveViews 2025-07-28 13:19:38 -05:00
repo.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
schema.ex refactor to use external parser 2025-06-24 14:22:09 -05:00
sentry_filter.ex Fix Sentry.Event struct access error in SentryFilter 2025-07-24 19:21:23 -05:00
shutdown_handler.ex Fix ShutdownHandler terminating during normal startup 2025-07-26 15:55:56 -05:00
signal_handler.ex fix: Resolve majority of dialyzer type errors 2025-07-30 13:30:21 -05:00
spatial_pubsub.ex Implement critical performance optimizations and error handling 2025-07-18 18:19:49 -05:00
streaming_packets_pubsub.ex Fix CI test failures 2025-07-28 12:32:16 -05:00
system_monitor.ex Fix packet buffer overflow and system load adjustment issues 2025-07-15 08:16:11 -05:00