ammocpr

graham/ammocpr

Fork 0

Commit graph

Author	SHA1	Message	Date
Graham McIntire	872c94bea1	Fix bugs and performance: Oban chain, 0-cent prices, duplicate queries, regex fragility - Fix Oban self-scheduling chain silently dying (remove unique constraint so after block can schedule next job) - Fix Natchez and TrueShotAmmo extract_price defaulting to 0 for missing price data - Fix caliber_matcher redundant String.downcase inside Enum.find (pre-downcase outside loop) - Fix runner.ex double iteration (Enum.map + Enum.count merged into single Enum.reduce) - Fix price_stats_for_caliber firing 3 queries instead of 2 (merge all_time + thirty_day via FILTER) - Fix PSA duplicate Floki.find on same selector (merge extract_title + extract_url) - Fix PubSub broadcast carrying no caliber IDs (now includes IDs; clients skip irrelevant reloads) - Fix BulkAmmo ^ anchor skipping non-leading round counts - Fix TargetSportsUSA fragile exact text match 'Add To Cart' (use case-insensitive contains) - Fix SgAmmo dead destructure {_, _, _} = row - Fix text_detector brass/nickel detection order - Fix Natchez GraphQL string interpolation (add escape_gql_string) - Fix chart data triple Enum.map merged into single reduce - Change Oban scraping queue workers from 2 to 1 (only one needed with Process.sleep)	2026-06-21 18:14:49 -05:00
Graham McIntire	0171ef1570	Separate 5.56x45 NATO and .223 Remington into distinct calibers Previously combined as a single "556-223" caliber. Now tracked separately with dedicated scraper URLs per retailer. Also fixes broken URLs for Lucky Gunner, True Shot Ammo, and Palmetto State Armory.	2026-03-12 12:27:59 -05:00
Graham McIntire	9eb85faebd	Add 4 new retailer scrapers for broader price coverage Add True Shot Ammo (Shopify JSON), Palmetto State Armory (Magento HTML), Bulk Ammo (Magento HTML), and Natchez Shooters Supply (GraphQL API). Extends scraper infrastructure with HttpClient.post_json/3 and an optional fetch/2 callback on the Scraper behaviour for scrapers that need custom HTTP flows (e.g. GraphQL POST requests).	2026-03-12 10:00:59 -05:00

Author

SHA1

Message

Date

Graham McIntire

872c94bea1

Fix bugs and performance: Oban chain, 0-cent prices, duplicate queries, regex fragility

- Fix Oban self-scheduling chain silently dying (remove unique constraint so after block can schedule next job)
- Fix Natchez and TrueShotAmmo extract_price defaulting to 0 for missing price data
- Fix caliber_matcher redundant String.downcase inside Enum.find (pre-downcase outside loop)
- Fix runner.ex double iteration (Enum.map + Enum.count merged into single Enum.reduce)
- Fix price_stats_for_caliber firing 3 queries instead of 2 (merge all_time + thirty_day via FILTER)
- Fix PSA duplicate Floki.find on same selector (merge extract_title + extract_url)
- Fix PubSub broadcast carrying no caliber IDs (now includes IDs; clients skip irrelevant reloads)
- Fix BulkAmmo ^ anchor skipping non-leading round counts
- Fix TargetSportsUSA fragile exact text match 'Add To Cart' (use case-insensitive contains)
- Fix SgAmmo dead destructure {_, _, _} = row
- Fix text_detector brass/nickel detection order
- Fix Natchez GraphQL string interpolation (add escape_gql_string)
- Fix chart data triple Enum.map merged into single reduce
- Change Oban scraping queue workers from 2 to 1 (only one needed with Process.sleep)

2026-06-21 18:14:49 -05:00

Graham McIntire

0171ef1570

Separate 5.56x45 NATO and .223 Remington into distinct calibers

Previously combined as a single "556-223" caliber. Now tracked separately
with dedicated scraper URLs per retailer. Also fixes broken URLs for
Lucky Gunner, True Shot Ammo, and Palmetto State Armory.

2026-03-12 12:27:59 -05:00

Graham McIntire

9eb85faebd

Add 4 new retailer scrapers for broader price coverage

Add True Shot Ammo (Shopify JSON), Palmetto State Armory (Magento HTML),
Bulk Ammo (Magento HTML), and Natchez Shooters Supply (GraphQL API).

Extends scraper infrastructure with HttpClient.post_json/3 and an
optional fetch/2 callback on the Scraper behaviour for scrapers that
need custom HTTP flows (e.g. GraphQL POST requests).

2026-03-12 10:00:59 -05:00

3 commits