graham/prop
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
prop/lib/microwaveprop/weather
History
Graham McIntire b42b777150 Use wgrib2 -lon for native profile extraction instead of -lola grid 
Points spread coast-to-coast created a ~476k cell bounding grid
(350 messages × 476k cells × 4 bytes ≈ 665 MB), causing OOM.

Switch to -lon which extracts values at specific lat/lon points
with text output. One wgrib2 call, one file scan, negligible
BEAM memory regardless of point geographic spread.
2026-04-10 17:12:11 -05:00
..
grib2 Use wgrib2 -lon for native profile extraction instead of -lola grid 2026-04-10 17:12:11 -05:00
era5_batch_client.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_client.ex Batch ERA5 fetches by month and 2° tile 2026-04-09 13:01:49 -05:00
era5_profile.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
frontal_analysis.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_client.ex Reduce memory pressure: Stream large collections, GC between phases 2026-04-10 16:45:50 -05:00
hrrr_climatology.ex Phase 3 spike (parked) + Phase 6: temperature anomaly 2026-04-10 08:47:11 -05:00
hrrr_native_client.ex Use wgrib2 -lon for native profile extraction instead of -lola grid 2026-04-10 17:12:11 -05:00
hrrr_native_profile.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
hrrr_profile.ex Database performance fixes and async backfill enqueue 2026-04-04 19:19:18 -05:00
iem_client.ex Add real-time ASOS adjustments between hourly HRRR updates 2026-03-31 09:10:12 -05:00
iemre_observation.ex Add IEM precipitation data to QSO weather pipeline 2026-03-30 13:18:11 -05:00
metar_5min_observation.ex Phase 8: 5-minute METAR ingestion pipeline 2026-04-10 08:53:54 -05:00
ncei_metar_client.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
nexrad_client.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
nexrad_observation.ex Phase 9.3, 9.4, and Phase 3 NEXRAD pipeline 2026-04-10 12:48:36 -05:00
rtma_client.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
rtma_observation.ex Add ERA5 reanalysis and RTMA data sources 2026-04-07 12:04:16 -05:00
solar_client.ex Add QSO import, solar indices, Oban workers, LiveView UI, and parallel weather import 2026-03-29 13:04:55 -05:00
solar_index.ex Add QSO import, solar indices, Oban workers, LiveView UI, and parallel weather import 2026-03-29 13:04:55 -05:00
sounding.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
sounding_params.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
station.ex Add weather data schema, context, sounding params, and IEM ingestion 2026-03-28 15:57:19 -05:00
surface_observation.ex Add IEM precipitation data to QSO weather pipeline 2026-03-30 13:18:11 -05:00
theta_e.ex Phase 2 tasks 2.1-2.4: BL turbulence feature computations 2026-04-10 08:21:23 -05:00
weather_layers.ex Add WeatherLayers module for deriving upper-air map fields from HRRR profiles 2026-04-03 16:49:17 -05:00