fix: infra cost optimizations round 2 — polling, TTLs, ACLED dedup#275
Merged
koala73 merged 6 commits intoFeb 24, 2026
Merged
Conversation
Add two layers of defence to avoid wasting Railway relay bandwidth on hidden tabs: 1. document.hidden guard in pollSnapshot() — skips fetch when tab is not visible (interval keeps ticking so first tick after focus polls immediately) 2. visibilitychange listener — pauses/resumes the interval timer entirely so no callbacks fire while backgrounded Co-Authored-By: Claude Opus 4.6 <[email protected]>
Climate anomalies: 30min → 3h Source: Open-Meteo Archive API uses ERA5 reanalysis data with a 2–7 day lag (https://open-meteo.com/en/docs/historical-weather-api). 30-min polling gains nothing against week-old data. Fire detections: 30min → 1h Source: NASA FIRMS VIIRS_SNPP_NRT refreshes approximately every 3 hours (https://firms.modaps.eosdis.nasa.gov/usfs/active_fire/). Polling twice per refresh cycle still catches every update. Combined: ~66% fewer Redis reads on these two endpoints. Co-Authored-By: Claude Opus 4.6 <[email protected]>
Three RPC handlers (conflict, unrest, intelligence) each made independent ACLED API calls with their own auth/timeout/parsing logic. Extract a shared fetchAcledCached() in server/_shared/acled.ts that: - Centralises auth, timeout, and error handling - Caches by query params so overlapping date ranges share results - Eliminates ~120 lines of duplicated fetch boilerplate - Reduces ACLED API calls when multiple handlers run concurrently Co-Authored-By: Claude Opus 4.6 <[email protected]>
|
@elzalem is attempting to deploy a commit to the Elie Team on Vercel. A member of the Team first needs to authorize it. |
17 tests covering: TTL alignment (climate 3h, fire 1h), ACLED shared cache layer (fetchAcledCached, cache key derivation, consumer imports, no duplicated ACLED_API_URL), and maritime AIS visibility guard (document.hidden check, pausePolling, resumePolling, visibilitychange listener wiring). Co-Authored-By: Claude Opus 4.6 <[email protected]>
Co-Authored-By: Claude Opus 4.6 <[email protected]>
koala73
pushed a commit
that referenced
this pull request
Feb 24, 2026
Reviewed all 9 changed files across 6 commits. Verified: - ACLED shared cache layer correctly deduplicates 3 upstream API paths - Cache TTL alignment matches upstream data source refresh rates - AIS visibility guard has proper two-layer defense with edge case handling - All 18 PR-specific tests pass, TypeScript compiles cleanly - 3 minor behavioral differences documented (event type format, timeout, auth) Verdict: APPROVE https://claude.ai/code/session_01DSYor9uV7a18fdpSBr8SZh
Owner
|
thank you ! |
koala73
added a commit
that referenced
this pull request
Feb 24, 2026
## What's Changed ### Performance - perf: defer YouTube/map init and stagger data loads to reduce blocking time (#287) ### Features - feat: universal country detection — CII scoring for all countries (#344) - feat: add Mexico as CII hotspot for cartel/security monitoring (#327) - feat: add Mexico and LatAm security feeds for instability coverage (#325) - feat: add category pills and search filter to Panels tab (#322) - feat: consolidate settings into unified tabbed modal (#319) - feat: add Island Times (Palau) RSS feed (#317) - feat: add AI Flow settings popup for web-only AI provider control (#314) - feat: optional channels with tab-based region browse UI (#295) - feat: custom channel management (#282) - feat: add Bild RSS feed scoped to German locale (#312) ### Bug Fixes - fix: suppress notification sound when popup alerts are disabled - fix: prevent entity conflation in pane summarization (#341) - fix: add Mexico to COUNTRY_BOUNDS and COUNTRY_ALIASES (#338) - fix: make OpenSky cache TTLs env-configurable (#333) - fix: serialize OpenSky requests with global 429 cooldown (#332) - fix: replace RSSHub feeds with native/Google News alternatives (#331) - fix: OpenSky auth resilience — retry, IPv4, no negative cache on auth fail (#329) - fix: add CARTO and OpenStreetMap attribution to map (#323) - fix: add drag cleanup handlers and suppress click after drag-drop (#315) - fix: replace HTML5 drag API with mouse events for WKWebView (#313) - fix: open channel settings as inline modal instead of separate window (#311) - fix: sync YouTube live panel mute state with native player controls (#285) - fix: strip Ollama reasoning tokens from summaries (#299) - fix: open external links in system browser on Tauri desktop (#297) - fix: add User-Agent and Cloudflare 403 detection to secret validation (#296) - fix: infra cost optimizations round 2 (#275) - fix: enforce military bbox filtering (#284) - fix: infrastructure cost optimizations across caching, polling, batching (#283) - fix: circuit breaker persistent cache with safety fixes (#281) - fix: immediately refresh stale services when tab regains focus (#277) ### Security - Security hardening: SSRF protection, auth gating, and token generation (#343) - Harden Railway relay auth, caching, and proxy routing (#320) - Build/runtime hardening and dependency security updates (#286) - fix: harden embed postMessage origin check (#302)
koala73
added a commit
that referenced
this pull request
Feb 25, 2026
## What's Changed ### Performance - perf: defer YouTube/map init and stagger data loads (#287) ### Features - feat: universal country detection — CII scoring for all countries (#344) - feat: add Mexico as CII hotspot (#327) - feat: add Mexico and LatAm security feeds (#325) - feat: add category pills and search filter to Panels tab (#322) - feat: consolidate settings into unified tabbed modal (#319) - feat: optional channels with tab-based region browse UI (#295) - feat: custom channel management (#282) ### Bug Fixes - fix: suppress notification sound when popup alerts are disabled - fix: prevent entity conflation in pane summarization (#341) - fix: add Mexico to COUNTRY_BOUNDS and COUNTRY_ALIASES (#338) - fix: OpenSky cache TTLs, serialization, and auth resilience (#329-#333) - fix: replace RSSHub feeds with native/Google News alternatives (#331) - fix: replace HTML5 drag API with mouse events for WKWebView (#313) - fix: sync YouTube mute state with native player controls (#285) - fix: strip Ollama reasoning tokens from summaries (#299) - fix: infra cost optimizations (#275, #283) - fix: circuit breaker persistent cache (#281) - fix: immediately refresh stale services on tab focus (#277) ### Security - Security hardening: SSRF protection, auth gating, token generation (#343) - Harden Railway relay auth, caching, and proxy routing (#320) - Build/runtime hardening and dependency security updates (#286)
koala73
added a commit
that referenced
this pull request
Feb 25, 2026
…346) * fix: suppress notification sound when popup alerts are disabled Badge playSound() was firing on new findings regardless of the "Pop up new alerts" toggle. Gate sound on popupEnabled so both the modal and audio respect the user preference. * chore: bump version to 2.5.7 with changelog ## What's Changed ### Performance - perf: defer YouTube/map init and stagger data loads (#287) ### Features - feat: universal country detection — CII scoring for all countries (#344) - feat: add Mexico as CII hotspot (#327) - feat: add Mexico and LatAm security feeds (#325) - feat: add category pills and search filter to Panels tab (#322) - feat: consolidate settings into unified tabbed modal (#319) - feat: optional channels with tab-based region browse UI (#295) - feat: custom channel management (#282) ### Bug Fixes - fix: suppress notification sound when popup alerts are disabled - fix: prevent entity conflation in pane summarization (#341) - fix: add Mexico to COUNTRY_BOUNDS and COUNTRY_ALIASES (#338) - fix: OpenSky cache TTLs, serialization, and auth resilience (#329-#333) - fix: replace RSSHub feeds with native/Google News alternatives (#331) - fix: replace HTML5 drag API with mouse events for WKWebView (#313) - fix: sync YouTube mute state with native player controls (#285) - fix: strip Ollama reasoning tokens from summaries (#299) - fix: infra cost optimizations (#275, #283) - fix: circuit breaker persistent cache (#281) - fix: immediately refresh stale services on tab focus (#277) ### Security - Security hardening: SSRF protection, auth gating, token generation (#343) - Harden Railway relay auth, caching, and proxy routing (#320) - Build/runtime hardening and dependency security updates (#286)
andreteow
pushed a commit
to andreteow/worldmonitor-a47
that referenced
this pull request
Feb 25, 2026
…oala73#346) * fix: suppress notification sound when popup alerts are disabled Badge playSound() was firing on new findings regardless of the "Pop up new alerts" toggle. Gate sound on popupEnabled so both the modal and audio respect the user preference. * chore: bump version to 2.5.7 with changelog ## What's Changed ### Performance - perf: defer YouTube/map init and stagger data loads (koala73#287) ### Features - feat: universal country detection — CII scoring for all countries (koala73#344) - feat: add Mexico as CII hotspot (koala73#327) - feat: add Mexico and LatAm security feeds (koala73#325) - feat: add category pills and search filter to Panels tab (koala73#322) - feat: consolidate settings into unified tabbed modal (koala73#319) - feat: optional channels with tab-based region browse UI (koala73#295) - feat: custom channel management (koala73#282) ### Bug Fixes - fix: suppress notification sound when popup alerts are disabled - fix: prevent entity conflation in pane summarization (koala73#341) - fix: add Mexico to COUNTRY_BOUNDS and COUNTRY_ALIASES (koala73#338) - fix: OpenSky cache TTLs, serialization, and auth resilience (koala73#329-koala73#333) - fix: replace RSSHub feeds with native/Google News alternatives (koala73#331) - fix: replace HTML5 drag API with mouse events for WKWebView (koala73#313) - fix: sync YouTube mute state with native player controls (koala73#285) - fix: strip Ollama reasoning tokens from summaries (koala73#299) - fix: infra cost optimizations (koala73#275, koala73#283) - fix: circuit breaker persistent cache (koala73#281) - fix: immediately refresh stale services on tab focus (koala73#277) ### Security - Security hardening: SSRF protection, auth gating, token generation (koala73#343) - Harden Railway relay auth, caching, and proxy routing (koala73#320) - Build/runtime hardening and dependency security updates (koala73#286)
facusturla
pushed a commit
to facusturla/worldmonitor
that referenced
this pull request
Feb 27, 2026
…oala73#275) * fix: skip AIS polling when browser tab is backgrounded Add two layers of defence to avoid wasting Railway relay bandwidth on hidden tabs: 1. document.hidden guard in pollSnapshot() — skips fetch when tab is not visible (interval keeps ticking so first tick after focus polls immediately) 2. visibilitychange listener — pauses/resumes the interval timer entirely so no callbacks fire while backgrounded Co-Authored-By: Claude Opus 4.6 <[email protected]> * fix: align cache TTLs with upstream data source refresh rates Climate anomalies: 30min → 3h Source: Open-Meteo Archive API uses ERA5 reanalysis data with a 2–7 day lag (https://open-meteo.com/en/docs/historical-weather-api). 30-min polling gains nothing against week-old data. Fire detections: 30min → 1h Source: NASA FIRMS VIIRS_SNPP_NRT refreshes approximately every 3 hours (https://firms.modaps.eosdis.nasa.gov/usfs/active_fire/). Polling twice per refresh cycle still catches every update. Combined: ~66% fewer Redis reads on these two endpoints. Co-Authored-By: Claude Opus 4.6 <[email protected]> * refactor: deduplicate ACLED API calls via shared cached fetch layer Three RPC handlers (conflict, unrest, intelligence) each made independent ACLED API calls with their own auth/timeout/parsing logic. Extract a shared fetchAcledCached() in server/_shared/acled.ts that: - Centralises auth, timeout, and error handling - Caches by query params so overlapping date ranges share results - Eliminates ~120 lines of duplicated fetch boilerplate - Reduces ACLED API calls when multiple handlers run concurrently Co-Authored-By: Claude Opus 4.6 <[email protected]> * test: add structural tests for round 2 infra optimizations 17 tests covering: TTL alignment (climate 3h, fire 1h), ACLED shared cache layer (fetchAcledCached, cache key derivation, consumer imports, no duplicated ACLED_API_URL), and maritime AIS visibility guard (document.hidden check, pausePolling, resumePolling, visibilitychange listener wiring). Co-Authored-By: Claude Opus 4.6 <[email protected]> * refactor: rename round 2 test file to ttl-acled-ais-guards Co-Authored-By: Claude Opus 4.6 <[email protected]> * fix: address PR koala73#275 review findings --------- Co-authored-by: Claude Opus 4.6 <[email protected]> Co-authored-by: Elie Habib <[email protected]>
facusturla
pushed a commit
to facusturla/worldmonitor
that referenced
this pull request
Feb 27, 2026
…oala73#346) * fix: suppress notification sound when popup alerts are disabled Badge playSound() was firing on new findings regardless of the "Pop up new alerts" toggle. Gate sound on popupEnabled so both the modal and audio respect the user preference. * chore: bump version to 2.5.7 with changelog ## What's Changed ### Performance - perf: defer YouTube/map init and stagger data loads (koala73#287) ### Features - feat: universal country detection — CII scoring for all countries (koala73#344) - feat: add Mexico as CII hotspot (koala73#327) - feat: add Mexico and LatAm security feeds (koala73#325) - feat: add category pills and search filter to Panels tab (koala73#322) - feat: consolidate settings into unified tabbed modal (koala73#319) - feat: optional channels with tab-based region browse UI (koala73#295) - feat: custom channel management (koala73#282) ### Bug Fixes - fix: suppress notification sound when popup alerts are disabled - fix: prevent entity conflation in pane summarization (koala73#341) - fix: add Mexico to COUNTRY_BOUNDS and COUNTRY_ALIASES (koala73#338) - fix: OpenSky cache TTLs, serialization, and auth resilience (koala73#329-koala73#333) - fix: replace RSSHub feeds with native/Google News alternatives (koala73#331) - fix: replace HTML5 drag API with mouse events for WKWebView (koala73#313) - fix: sync YouTube mute state with native player controls (koala73#285) - fix: strip Ollama reasoning tokens from summaries (koala73#299) - fix: infra cost optimizations (koala73#275, koala73#283) - fix: circuit breaker persistent cache (koala73#281) - fix: immediately refresh stale services on tab focus (koala73#277) ### Security - Security hardening: SSRF protection, auth gating, token generation (koala73#343) - Harden Railway relay auth, caching, and proxy routing (koala73#320) - Build/runtime hardening and dependency security updates (koala73#286)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Follow-up to #273. Three targeted optimizations to reduce unnecessary API calls, Redis reads, and upstream bandwidth:
document.hiddenguard +visibilitychangepause/resume so Railway relay gets zero traffic from inactive tabsfetchAcledCached()so conflict, unrest, and intelligence handlers share one Redis-backed fetch instead of three independent upstream callsEstimated savings (at 500K monthly users)
TTL verification sources
Test plan
acled:shared:*entries appear after first ACLED fetch🤖 Generated with Claude Code