No description
Find a file
Graham McIntire 727a743c11 feat(llm): per-insight-type prompt hints + flake fixes
Generic prompts produce generic advice. This commit adds per-type
expert hints appended to the base system prompt, listing the metadata
field names the rule provides plus short domain heuristics so the
LLM has the context it needs to write a tight, specific recommendation.

Hints cover: ap_frequency_change, own_fleet_channel_conflict,
sector_overload, cpe_realign, wireless_signal_weak, wireless_snr_low,
backhaul_over_capacity, backhaul_near_capacity, qoe_degradation,
capacity_saturation. Unknown types fall back to the base prompt.

No change to rules, schema, or worker — this lifts every existing
insight's enrichment quality on the next cron run.

Also fixes two recurring flaky tests:

- agent_live_test.exs:567 now mirrors the companion show_test.exs
  pattern of accepting any of the valid update-flow flashes (Failed
  / Update command sent / No binary available). The previous
  Req.Test stub-and-allow approach was itself flaky because both
  test files stub the same module name and ownership tracking can
  leak under full-suite parallelism.
- telemetry_test.exs is now async: false. Its handle_endpoint_stop
  describe block mutates global Logger.level which races with other
  async tests; running this single module sync removes the race
  without sacrificing the per-test setup/restore pattern.
2026-05-09 17:36:07 -05:00
.claude perf: disable Req retry for faster error tests 2026-03-10 16:19:31 -05:00
.forgejo ci: cache slow runtime apt deps in a prebuilt base image 2026-05-05 11:19:49 -05:00
assets tests 2026-05-07 13:14:02 -05:00
bin docs: replace flux/fluxcd references with argocd 2026-04-29 11:15:53 -05:00
c_src fix: correct library linking order in Makefile 2026-01-30 13:24:25 -06:00
config feat(insights): AP frequency-change recommendation rule 2026-05-09 16:56:19 -05:00
docs feat(insights): LLM-powered insight enrichment 2026-05-09 16:41:48 -05:00
e2e feat(on_call): schedules list search + pagination + e2e refresh (chunk 4) 2026-04-28 14:12:57 -05:00
k8s feat(insights): SectorOverload + CpeRealign recommendation rules 2026-05-09 17:07:15 -05:00
lib feat(llm): per-insight-type prompt hints + flake fixes 2026-05-09 17:36:07 -05:00
mibs handle mib uploading 2026-01-18 16:29:24 -06:00
nix remove-gleam (#218) 2026-03-29 11:03:20 -05:00
policies Hide RF Links UI elements from network map (TOW-44) (#46) 2026-03-16 15:19:03 -05:00
priv feat(insights): RF-aware channel-conflict — multi-source noise + Preseem 2026-05-09 17:25:26 -05:00
rel fix: quote RELEASE_NODE to prevent word splitting 2026-02-17 13:19:15 -06:00
scripts complete overhaul of snmp engine 2026-01-30 10:41:07 -06:00
test feat(llm): per-insight-type prompt hints + flake fixes 2026-05-09 17:36:07 -05:00
tools fix: input validation, SSRF, API hardening, and cookie security 2026-03-14 14:48:59 -05:00
vendor deps: upgrade oban_pro to 1.7.0 2026-04-30 10:26:18 -05:00
.credo.exs no cluster unless in k8s, fix credo issues 2026-02-09 13:08:51 -06:00
.dialyzer_ignore.exs dialyzer: replace suppressions with real fixes where possible 2026-04-21 11:01:30 -05:00
.dockerignore nif ci fix complie in ci 2026-01-30 12:47:18 -06:00
.envrc.example feat: Add comprehensive Nix flakes integration 2026-02-07 12:26:54 -06:00
.formatter.exs format 2025-12-21 11:31:08 -06:00
.gitignore feat(insights): SectorOverload + CpeRealign recommendation rules 2026-05-09 17:07:15 -05:00
.stride.md update 2026-02-18 10:19:56 -06:00
.test-watch.exs add test watch 2026-01-03 12:35:26 -06:00
.tool-versions chore: rate_limit rewrite + on-call redesign plan + handoff_notifications_mode 2026-04-28 12:17:29 -05:00
AGENTS.md chore: remove sobelow dependency 2026-03-12 16:03:08 -05:00
CHANGELOG.txt feat(llm): per-insight-type prompt hints + flake fixes 2026-05-09 17:36:07 -05:00
CLAUDE.md ci: cache slow runtime apt deps in a prebuilt base image 2026-05-05 11:19:49 -05:00
Dockerfile Dockerfile: align Elixir/OTP/Debian versions with microwaveprop 2026-04-29 12:45:21 -05:00
flake.lock fix: Make Nix flake compatible with macOS 2026-02-07 12:30:48 -06:00
flake.nix fix: complete Nix Docker image build and untrack .claude/settings.local.json 2026-02-07 14:14:26 -06:00
Makefile complete overhaul of snmp engine 2026-01-30 10:41:07 -06:00
mix.exs test: lift coverage 84.08% → 84.99%; exclude declarative modules from coverage 2026-05-08 11:18:26 -05:00
mix.lock feat(metrics): expose Prometheus /metrics via PromEx on :9568 2026-05-08 10:25:25 -05:00
README.md encryption updates 2026-02-01 17:05:55 -06:00
renovate.json fix: code quality improvements and test reliability (#139) 2026-03-24 09:12:59 -05:00
setup_stripe_meter.exs feat: add Stripe meter ID configuration 2026-03-06 11:08:06 -06:00
setup_stripe_production.sh feat: allow script to work with both test and live Stripe keys 2026-03-06 11:08:07 -06:00
shell.nix feat: Add comprehensive Nix flakes integration 2026-02-07 12:26:54 -06:00
tail_logs.sh add logs helper script 2026-01-11 15:45:02 -06:00

TowerOps

Network monitoring and alerting platform built with Phoenix LiveView.

Features

  • Multi-tenant architecture - Organizations with role-based permissions
  • Site hierarchy - Organize equipment across multiple sites
  • Automated monitoring - Real-time ping monitoring with configurable intervals
  • Time-series data - Efficient storage with TimescaleDB (optional)
  • Real-time updates - LiveView dashboard with PubSub
  • Equipment tracking - Monitor network devices by IP address

Quick Start

Prerequisites

  • Elixir 1.14+
  • PostgreSQL 14+
  • (Optional) TimescaleDB for production-grade time-series performance

Setup

# Install dependencies
mix setup

# Start the server
mix phx.server

Visit localhost:4000 from your browser.

TimescaleDB (Production Only)

Development: Uses standard PostgreSQL (no TimescaleDB required).

Production: TimescaleDB is automatically enabled for optimal performance with time-series data.

# Production deployment - install TimescaleDB first
brew tap timescale/tap && brew install timescaledb  # macOS
# Then run migrations with MIX_ENV=prod
MIX_ENV=prod mix ecto.migrate

See TIMESCALEDB.md for detailed installation and configuration.

How it works: Migrations detect the environment (MIX_ENV) and only enable TimescaleDB features (hypertables, compression, retention policies, continuous aggregates) in production.

Encryption Setup (Production)

TowerOps uses AES-256-GCM encryption for sensitive data (SNMP communities, MikroTik API passwords, etc.).

Development/Test

Encryption keys are pre-configured in config/dev.exs and config/test.exs. No action required.

Production

Set the CLOAK_KEY environment variable with a base64-encoded 32-byte key:

# Generate encryption key
openssl rand -base64 32

Important:

  • Store the generated key securely in 1Password or your secrets manager
  • Never commit the production key to version control
  • Losing the encryption key makes encrypted data unrecoverable

Kubernetes Deployment

If secret doesn't exist yet (new deployment):

# Generate CLOAK_KEY (store in 1Password first!)
CLOAK_KEY=$(openssl rand -base64 32)

# Create towerops-secrets with all required keys
kubectl create secret generic towerops-secrets \
  --from-literal=RELEASE_COOKIE=$(openssl rand -base64 32) \
  --from-literal=SECRET_KEY_BASE=$(mix phx.gen.secret) \
  --from-literal=CLOAK_KEY="$CLOAK_KEY" \
  -n towerops

If secret already exists (add CLOAK_KEY to existing secret):

# Store new key in 1Password first!
# Bash/Zsh:
CLOAK_KEY=$(openssl rand -base64 32)

# Fish shell:
set CLOAK_KEY (openssl rand -base64 32)

# Method 1: Using kubectl create with dry-run and apply
kubectl create secret generic towerops-secrets \
  --from-literal=CLOAK_KEY="$CLOAK_KEY" \
  --dry-run=client -o yaml | \
  kubectl apply -f - -n towerops

# Method 2: Direct inline generation (works in all shells)
kubectl create secret generic towerops-secrets \
  --from-literal=CLOAK_KEY="$(openssl rand -base64 32)" \
  --dry-run=client -o yaml | \
  kubectl apply -f - -n towerops

# Restart pods to pick up new key
kubectl rollout restart deployment/towerops -n towerops

Development

Database

mix ecto.create       # Create database
mix ecto.migrate      # Run migrations
mix ecto.reset        # Drop, create, and migrate

Testing

mix test              # Run all tests
mix test --trace      # Run with detailed output

Code Quality

mix format            # Format code with Styler
mix compile --warnings-as-errors

Firmware Version Tracking

The system automatically checks for latest firmware versions daily (2 AM dev, 4 AM prod). To manually trigger a firmware check:

# Start IEx console
iex -S mix phx.server

# Manually trigger firmware version fetch
Oban.insert(Towerops.Workers.FirmwareVersionFetcherWorker.new(%{}))

The worker will:

  1. Fetch the latest MikroTik RouterOS version from RSS feed
  2. Store version information in the database
  3. Enable firmware update indicators on device detail pages

Check the logs for fetch results:

# View recent Oban jobs
Towerops.Repo.all(Oban.Job) |> Enum.take(5)

Learn more