Commit graph

1392 commits

Author SHA1 Message Date
3b0487fd75
add 100% test coverage for Towerops.Accounts
- add 23 new ExUnit tests covering all previously uncovered code paths
- fix touch_changeset bug: DateTime.utc_now() -> DateTime.utc_now(:second)
  to avoid microsecond errors with :utc_datetime fields
- add defensive coverage tests using PostgreSQL triggers to exercise
  Multi transaction catch-all clauses and partial insert_all paths
- coverage: 88.67% -> 100.00% (169 -> 192 tests)
2026-03-11 10:37:03 -05:00
41708651a0
refactor: collapse inactive billing providers into expandable disclosure
When a billing provider is active, all other billing providers are
hidden from the main list and collected into a compact <details>
disclosure element showing provider names and descriptions.
2026-03-11 10:09:27 -05:00
031427a247
feat: collapse and dim inactive billing integrations
When a billing provider is active (enabled), the other billing providers
are dimmed and collapsed to a single row showing a lock icon and which
provider is active. This reinforces the mutually exclusive constraint.

Also fixes status emoji accumulating in page title (JS regex needed
unicode flag) and adds missing page_title to 8 LiveViews.
2026-03-11 10:00:38 -05:00
f2608e8f16
fix: status emoji accumulating in page title and add missing page titles
Fix JS regex in StatusTitle hook to use unicode flag so emoji are
properly matched and replaced instead of accumulating. Add page_title
to 8 LiveViews that were missing it, which caused "TowerOps | TowerOps"
duplication from the live_title suffix.
2026-03-11 09:54:18 -05:00
198f2c3cbc
feat: add API key setup help to integration configuration panels
Add setup_help info boxes to each integration provider showing where
to create API keys, step-by-step instructions, required permissions,
and example URL patterns.
2026-03-11 09:46:22 -05:00
5e5da89f3a
fix: correct SNMP OIDs for 7 vendor modules to match MIB definitions
Cambium PTP: Rx Power .12.6→.12.12 (rawReceivePower), Tx Power
.12.3→.12.4, data rates from .12 subtree→.20 subtree, renamed
Link Loss→Signal Strength Ratio, added aggregate rate

Ceragon: TX/RX power OIDs from .10.4.1.11→.10.5.1.1 subtree
(genEquipRfuStatusTxLevel/RxLevel), removed SNR and link status

Aviat: RSL→.9.15 (RXPERFORMANCE-MIB), Tx Power/SNR→.9.33
(RXPERFORMANCE-EX-MIB), capacity→.9.3 (MODEM-MIB), removed
temperature

DragonWave: SNR column .2.3→.2.8, RSL column .2.2→.2.4, removed
temperature

Exalt: frequencies .1.7/.1.8→.57.4/.57.5 (ExtendAirG2), Tx Power
.1.9→.57.1, RSL .2.1→.2.4.3.1.3 (locCurrentRSL), removed SNR

Teltonika: RSSI column 7→12, RSRP 8→20, SINR 9→19, RSRQ 10→21,
Connection Type 3→16, SIM Status 2→9, temperature .1.7→.2.2.1.17

SIAE: Tx Power/RSSI/Frequency→.39.2.1 subtree (Alfo80hd MIB),
added Tx/Rx rate from .15.4.1.17/.18, removed SNR
2026-03-10 17:07:43 -05:00
835b38c4de
fix: correct airos SNMP OIDs to match UBNT-AirMAX-MIB definitions
8 of 13 OIDs were pointing to wrong MIB columns:
- RSSI: was reading ubntWlStatSignal(.5), now ubntWlStatRssi(.6)
- Quality: was reading ubntWlStatSignal(.5), now ubntAirMaxQuality(.6.1.3)
- Tx Rate: was reading ubntWlStatSsid(.2), now ubntWlStatTxRate(.9)
- Rx Rate: was reading ubntWlStatHideSsid(.3), now ubntWlStatRxRate(.10)
- Capacity: was reading ubntWlStatTxRate(.9), now ubntAirMaxCapacity(.6.1.4)
- Distance: was reading ubntWlStatSecurity(.11), now ubntRadioDistance(.1.1.7)
- Utilization: was reading WDS/Repeater booleans(.12/.13), now ubntAirMaxAirtime(.6.1.7)
- Added Signal Level sensor from ubntWlStatSignal(.5)
2026-03-10 16:53:08 -05:00
9b3ffa874a
fix: correct airfiber SNMP OIDs to match MIB table definitions
All 7 OIDs were reading from wrong SNMP table/columns. Frequency and
power config values pointed at the status table instead of the config
table, and capacity/signal columns pointed at unrelated fields like
radio temperature and boolean flags.

Corrected OIDs to match UBNT-AirFIBER-MIB structure:
- Frequency/power: config table (.3.1) entries 5, 6, 9
- Signal: status table (.3.2) entries 11, 14
- Capacity: status table (.3.2) entries 5, 6 with 1M divisor
2026-03-10 16:41:14 -05:00
91a051f14d
Refactor duplicate site API logic 2026-03-10 16:27:35 -05:00
48270f5e35
chore: remove staged deletions from previous work 2026-03-10 16:20:41 -05:00
532d88ffb9
perf: disable Req retry for faster error tests
- Add retry: false to VISP Client HTTP requests
- Add retry: false to ReleaseChecker GitHub API requests
- Remove unused Plug.Conn import from RemoteIpLogger
- Remove unused default parameter from req_get/2

Results:
- VISP sync test: 7007ms → 113ms (62x faster)
- ReleaseChecker test: 7004ms → 17ms (402x faster)
- UserResetPasswordLive test: 1495ms → 284ms (5x faster)

Req's default retry behavior (1s, 2s, 4s exponential backoff) was
causing 7-second delays for HTTP 500/503 error responses in tests.
For these clients, immediate failure is preferred over retries.
2026-03-10 16:19:31 -05:00
495b1a75b2
Add GeoIP import HTTP tests 2026-03-10 16:02:49 -05:00
b4ef6b2020
Improve topology discovery matching 2026-03-10 15:44:46 -05:00
232915e3e4
fix: filter out ARP entries with empty MAC addresses from SNMP
- Added guard clause to return nil for empty binary MAC addresses
- Filter rejects entries with nil IP or MAC addresses
- Prevents 'can't be blank' validation errors on upsert
- Root cause: some SNMP devices return incomplete ARP entries
2026-03-10 15:33:52 -05:00
7525bfd9a3
fix: show ARP error samples in log message text instead of metadata
- Changed error logging to include sample errors directly in message string
- Ensures error details are visible regardless of logger metadata config
- Extracted format_error_samples/1 helper to reduce nesting (Credo)
- Helps diagnose ARP upsert failures in staging/production
2026-03-10 15:12:09 -05:00
e026930f25
logging fix and some other codex fixes 2026-03-10 15:04:28 -05:00
3e70f0ba48
fix: add detailed error logging for ARP upsert failures
Previously just logged a count without any details, making debugging
impossible. Now logs first 3 sample errors with IP, MAC, and validation
errors to help identify root cause.

Sample output:
  290 ARP upsert failures for device X
  sample_errors: [
    %{ip: nil, mac: "00:11:22:33:44:55", errors: %{ip_address: ["can't be blank"]}},
    %{ip: "10.0.0.1", mac: nil, errors: %{mac_address: ["can't be blank"]}},
    ...
  ]
2026-03-10 14:46:45 -05:00
bbb5f886ec
fix: add alert_changed handlers to critical LiveViews
Proactively add catch-all handlers to device index/show pages to
prevent FunctionClauseError when StatusTitleComponent broadcasts
alert changes. These are the most frequently open pages where users
would encounter the crash.
2026-03-10 14:12:29 -05:00
48b6f390a8
fix: handle alert_changed messages in AgentLive.Index
The StatusTitleComponent (rendered in authenticated layout) subscribes
to organization:*:alerts PubSub topic. Since LiveComponents run in the
parent process, both the component and parent LiveView receive these
messages.

Added catch-all handler to prevent FunctionClauseError when alert
changes broadcast. The component already handles the message properly.
2026-03-10 14:10:10 -05:00
a52f5a8644
fix: handle nil SNMP community string in discovery logging
- Check if community string is nil before slicing
- Display '(none)' instead of crashing with FunctionClauseError
- Fixes discovery crashes when community string is not set

Error was: String.slice(nil, 0..3) causing discovery tasks to fail
2026-03-10 13:57:49 -05:00
bc1ac21f1e
fix: use correct auth check for API organization updates
- API auth uses current_user, not current_scope
- Check membership role directly instead of using owner?/1 helper
- Allow superusers to update organization settings
- Fixes KeyError: key :current_scope not found

Previous code assumed LiveView context with current_scope, but API
requests only have current_user and current_organization_id assigned.
2026-03-10 13:41:38 -05:00
03487b1f55
rename "Admin Dashboard" to "Dashboard" 2026-03-10 13:36:03 -05:00
5fb5fea25e
feat: require org owner permission to update organization settings
- Add authorization check in organization_controller.ex update action
- Only organization owners can modify organization settings via API
- Returns 403 Forbidden if user is not an owner
- Affects all organization settings including use_sites and name
- Organization name can now be updated via API (existing field)

This ensures critical organization settings are only changed by authorized users.
2026-03-10 13:32:38 -05:00
62eb7f9949
fix: infer device role during discovery and handle string price values
Device Type Fix:
- Add Topology.maybe_update_device_role() call after discovery completes
- Device types (AP, router, switch, etc.) now inferred immediately after discovery
- Previously devices showed 'unknown' until first polling cycle completed
- Role inference uses SNMP manufacturer, model, and system description

Billing Fix:
- Handle string values from Settings.get_setting() in default_price_per_device()
- Add case clause to convert string '2.00' to Decimal struct
- Fixes CaseClauseError crash on /orgs/:slug/settings page

All discovery tests passing.
2026-03-10 13:25:51 -05:00
67e15d1dc5
feat: make normalize_mac/1 public and fix subscriber matching tests
- Made normalize_mac/1 public with comprehensive documentation
- Enhanced normalize_mac to handle:
  - Binary MAC addresses (6 bytes) with proper hex conversion
  - Short MAC addresses with zero-padding (e.g., 'A:B' -> '0a:0b')
  - Colons, dashes, and no-separator formats

- Fixed refresh_links_for_device/1 to return :ok when device not found
  (was returning nil, causing test failures)

- Fixed site fallback test to use assigned_network_site_gaiia_id
  (string field) instead of network_site_id (FK)

- Simplified account lookup optimization test to remove
  non-existent Repo.query_count/1 dependency

All 19 subscriber matching tests now passing:
- 7 normalize_mac/1 tests (binary, colons, dashes, padding, etc.)
- 12 refresh_device_links/1 tests (all match methods, prioritization,
  cross-org isolation, etc.)
2026-03-10 12:52:42 -05:00
991001f95a
fix(critical): ensure all money math uses Decimal, never floating point
CRITICAL FINANCIAL BUGS FIXED:

1. Stripe price creation was sending dollars instead of cents
   - create_price() now converts $2.00 -> 200 cents
   - Was sending "2.00" to unit_amount_decimal (0.02 dollars!)
   - Now correctly sends "200.00" (2 dollars in cents)

2. VISP sync was using floating point arithmetic for MRR
   - calculate_total_mrr() was using 0.0 accumulator and float math
   - Now uses Decimal.new("0") and Decimal.add() throughout
   - Prevents precision loss when summing subscriber MRR

All money calculations now use Decimal library to avoid floating
point precision errors. Amounts are only converted to cents (integers)
at the boundary when sending to Stripe API.
2026-03-10 12:17:42 -05:00
e1cfc4ece1
feat: add observability logging for invalid MAC addresses
- Log when normalize_mac drops invalid MAC addresses from SNMP data
- Helps diagnose data quality issues from network equipment
2026-03-10 11:34:45 -05:00
1a9a6e0ef6
fix: critical subscriber matching and performance improvements
- Add missing wireless_mac and wireless_ip to schema validation
  (was causing highest-confidence matches to be rejected)
- Optimize account lookup to load once instead of 5x per refresh
  (eliminates N+1 query performance issue)
- Preserve all matching phases with proper signature updates
2026-03-10 11:33:47 -05:00
a19155f3de
fix: remove all compact_mode references from device index template 2026-03-10 11:22:40 -05:00
bbe7a8c4fa
fix: normalize MAC addresses with leading zeros for subscriber matching
When SNMP returns MAC addresses as strings (e.g., 'A:B:C:D:E:F'), they were
being converted to lowercase without padding hex digits with leading zeros.
This caused subscriber matching to fail because the normalize_mac function
expects properly padded MACs (e.g., '0a:0b:0c:0d:0e:0f').

Now properly normalizes string MACs by:
- Removing all separators
- Ensuring 12 hex characters
- Reformatting with colon separators and proper padding

This fixes subscriber matching for ePMP and some Ubiquiti devices that
return string-formatted MACs from SNMP.
2026-03-10 11:05:57 -05:00
f19fb958cb
refactor: remove non-functional compact view button from devices page
Removed:
- Compact view toggle button from the header
- toggle_compact_mode event handler
- @compact_mode assign

The button was not connected to any actual functionality.
2026-03-10 11:02:12 -05:00
1920c7bc5a
fix: show total discovered device count in tab badge instead of paginated count
The discovered tab badge was showing length(@discovered_devices) which is
the paginated list (20 items per page), not the total count. Now shows
@pagination.total_count to display the actual total (e.g., 876 devices).
2026-03-10 11:00:06 -05:00
6fd03ace16
feat: add comprehensive wireless client tracking and monitoring
Implements real-time wireless client monitoring with historical tracking,
LiveView UI, proactive alerting, and cross-browser e2e tests.

Phase 1: Historical Tracking
- Add TimescaleDB hypertable for wireless_client_readings
- Batch insert client metrics every 60 seconds from DevicePollerWorker
- 90-day retention with compression after 7 days
- Continuous aggregates for hourly (1 year) and daily (5 years) rollups

Phase 2: LiveView UI
- Add wireless tab to device detail page
- Real-time client list with PubSub updates
- Signal strength and SNR badges with 5-level thresholds
- Display MAC, IP, subscriber, TX/RX rates, distance, uptime
- Subscriber matching via device_subscriber_links
- Empty state handling

Phase 3: Proactive Alerting
- WirelessInsightWorker runs every 5 minutes via Oban cron
- 4 insight types with auto-resolution:
  * wireless_signal_weak: < -75 dBm (warning), < -85 dBm (critical)
  * wireless_snr_low: < 15 dB (warning), < 10 dB (critical)
  * wireless_ap_overloaded: > 50 clients (warning), > 75 clients (critical)
  * wireless_client_missing: expected subscribers not connecting
- Hysteresis thresholds prevent alert flapping
- Multi-organization isolation with proper deduplication

Code Quality:
- Refactored reload_current_tab_data to reduce cyclomatic complexity
- Combined double Enum.filter into single pass for efficiency
- Fixed length/1 comparison to use empty list check
- All Credo checks passing

Testing:
- 28 unit tests (ExUnit) - 100% passing
- 15 e2e tests (Playwright) - 100% passing across chromium/firefox/webkit
- Total: 73 tests, all passing

Files changed:
- lib/towerops/workers/wireless_insight_worker.ex (NEW)
- lib/towerops_web/live/device_live/show.ex (wireless tab + refactoring)
- lib/towerops_web/live/device_live/show.html.heex (wireless template)
- lib/towerops/snmp.ex (5 new query functions)
- lib/towerops/gaiia.ex (list_missing_subscribers)
- lib/towerops/preseem/insight.ex (5 new insight types)
- config/runtime.exs (Oban cron schedule)
- test/support/fixtures/snmp_fixtures.ex (NEW)
- test/towerops/workers/wireless_insight_worker_test.exs (NEW)
- test/towerops_web/live/device_live/show_test.exs (9 new tests)
- e2e/tests/wireless-clients.spec.ts (NEW - 15 cross-browser tests)
2026-03-10 09:57:12 -05:00
f09d1b296d feat: add historical wireless client tracking with TimescaleDB
- Create wireless_client_readings hypertable with compression and retention
- Add WirelessClientReading schema and batch insert function
- Update DevicePollerWorker to save historical readings
- Add signal_badge and snr_badge components to CoreComponents
2026-03-09 17:42:17 -05:00
108fb2b7dc
fix: add navigation and footer to changelog page
Wrapped ChangelogLive content in Layouts.authenticated component
to include standard navigation header and footer.
2026-03-09 15:59:13 -05:00
1dd6d687a7
feat: auto-grant superuser to owner email addresses
Security-hardened implementation that automatically grants superuser status
to graham@towerops.net and graham@mcintire.me during user registration.

Security measures:
- Only runs during NEW user creation (__meta__.state == :built check)
- Cannot be triggered via account updates (prevents privilege escalation)
- Case-insensitive comparison (prevents 'Graham@TOWEROPS.NET' bypass)
- Email must pass validation and uniqueness constraint first
- Explicit defense-in-depth with comprehensive security comments

Prevents scenarios where:
- Owner loses access to their own system
- Need to manually grant superuser via database manipulation
- Case variations could bypass the check

Test coverage includes:
- Both email addresses get superuser
- Case variations are handled correctly
- Similar/spoofed emails are rejected
- Other emails don't get superuser
2026-03-09 15:45:23 -05:00
4e3f732f21
ui: comprehensive button styling audit - convert all text-styled actions to proper buttons
Fixed 10 text-styled action buttons across 7 files:

Agent Management:
- Delete Agent buttons (2x) → danger variant
- View Setup links (already fixed) → secondary variant

Organization Settings:
- Remove Member button → danger variant

Admin Pages:
- Edit Overrides button → secondary variant
- Delete Organization button → danger variant
- Remove IP/CIDR button → danger variant
- Delete User button → danger variant

Device Management:
- Delete Backup button → danger variant

All action buttons now use proper .button component with appropriate
variants (danger for destructive actions, secondary for neutral actions).
This provides consistent visual hierarchy and makes destructive actions
more clearly identifiable.
2026-03-09 15:32:42 -05:00
c94ac6e650
ui: convert text-styled action links to proper buttons
- Login page: 'Sign up' link → full-width button
- Agent setup: 'View Setup' text links → secondary buttons

Makes primary actions more visually prominent and consistent
with button component design system.
2026-03-09 15:02:48 -05:00
34e9365520
fix: another Mix.env() call in device_live/index.ex
- Fixed debounce_ms/0 function still using Mix.env()
- Changed to Application.get_env(:towerops, :env)
- This was causing crashes in staging/production
2026-03-09 14:59:41 -05:00
d811bcb503
feat: add ErrorTrackerNotifier and fix PagerDuty notification handling
- Add error_tracker_notifier for email alerts on exceptions
  * Sends alerts to graham@towerops.net
  * Configured in production only (gracefully shuts down in dev/test)
  * Includes throttling to prevent duplicate error spam

- Fix AlertNotificationWorker when PagerDuty not configured
  * Worker now handles :not_configured gracefully instead of failing
  * Prevents unnecessary retries and error noise
  * Logs as debug when PagerDuty integration isn't set up

Files changed:
- mix.exs, mix.lock
- config/runtime.exs
- lib/towerops/application.ex
- lib/towerops/workers/alert_notification_worker.ex
- CHANGELOG.txt, priv/static/changelog.txt
2026-03-09 13:14:30 -05:00
4b11f74e39
fix: replace Mix.env() with Application.get_env() for production compatibility
Mix is not available in production releases. Use Application.get_env/3
to check environment at runtime instead of Mix.env().
2026-03-09 12:47:50 -05:00
fc63a4faaf
fix: properly disable Plug.Telemetry logging for health checks
Set conn.private.log to false to prevent Plug.Telemetry from logging
health check requests in addition to phoenix_log and plug_skip_telemetry.
2026-03-08 16:39:26 -05:00
5a63adacef
fix: align Send Invite button with form inputs
Add invisible label above button to match input field structure,
ensuring proper vertical alignment when using items-end grid alignment.
2026-03-08 16:14:44 -05:00
1987d84637
fix: handle FileSystem :ignore in ProfileWatcher for CI 2026-03-07 16:02:32 -06:00
1c222f8ff5
feat: add capacity insight worker, UI, and reporting views
Add CapacityInsightWorker (every 15 min) that generates critical/warning
insights when backhaul utilization exceeds 90%/75% and auto-resolves
when it drops below 70%.

Add capacity and utilization columns to the device ports tab with
set/clear capacity controls. Add organization-level /capacity page
with summary cards and per-site capacity table. Add capacity summary
card to site show page. Add Capacity link to nav menu.
2026-03-07 14:42:40 -06:00
76545ee31c
fix: handle alert_changed PubSub messages and primary owner ordering
- Add handle_info for {:alert_changed, org_id} in AlertLive.Index and DashboardLive
  to properly handle organization-level alert change broadcasts
- Fix get_primary_owner query to prioritize is_default memberships first,
  ensuring the organization creator is always returned when multiple owners exist

Resolves 5 test failures related to PubSub message handling and
deterministic primary owner selection.
2026-03-07 12:04:30 -06:00
3fa0ea383a
feat: improve organization invitation UX
- Show sender's full name in invitation emails
- Use relative time for "Sent" column (more readable)
- Use date format for "Expires" column (shorter)
- Make invitation table horizontally scrollable

Fixes display cropping issue where long timestamps caused
the pending invitations table to overflow its container.
2026-03-07 11:58:46 -06:00
3913981094
feat: add backhaul capacity analysis foundation
Add per-interface capacity tracking with manual override and automatic
detection from SNMP sensors. Includes capacity resolver with priority
cascade (manual > sensor > if_speed), throughput calculation from
interface stats, and site/organization-level capacity summaries.

- Migration: add configured_capacity_bps and capacity_source to snmp_interfaces
- Capacity.Resolver: multi-source capacity detection with vendor unit normalization
- Capacity context: throughput calculation, utilization percentages, site/org summaries
- Snmp context: set_manual_capacity/2 and clear_manual_capacity/1 functions
2026-03-06 17:54:32 -06:00
180bfa6de2
fix: convert binary UUID to text in activity feed sync query
Fixes Jason.EncodeError when rendering activity feed. PostgreSQL
array_agg was returning binary UUID which caused invalid UTF-8 bytes
when interpolated into 'sy-#{row.id}' string. Cast to ::text in the
fragment to ensure string representation.
2026-03-06 17:33:34 -06:00
d5b0f38ed6
feat: add remaining e2e tests and fix 'too many open files' error
- Added e2e tests for auth flows (registration, login, password reset, TOTP)
- Added e2e tests for onboarding and organization creation
- Added e2e tests for team collaboration (org switching, invitations)
- Added e2e tests for activity feed
- Added e2e tests for device graphs (sensors, time ranges, interfaces)
- Added e2e tests for MikroTik backup comparison
- Added e2e tests for sites map (geographic view)
- Added e2e tests for network trace tool

- Fixed 'too many open files' error by configuring Phoenix code reloader
  to ignore deps/, _build/, node_modules/, e2e/, and other non-source directories
- This prevents the file system watcher from monitoring unnecessary files
2026-03-06 17:08:27 -06:00