511NY: legacy API dead after 511x cutover, and DRB has no DAA grant for the new feed (+ timestamp/disclaimer gaps) #198

New Issue

2026-10-04T05:32:02-04:00

logan commented

2026-10-04 05:32:02 -04:00

Found 2026-10-04 while building design-canvas/camera-sources.md (§B).

1. Feed is dead (behavior). 511ny.org cut over to the Castle Rock CARS "511x" platform (~2026-09-24..30). https://511ny.org/api/getcameras?format=json and /api/getevents now return the SPA's HTML (HTTP 200, text/html), so ny511._fetch raises on r.json() and the layer serves its last cache / shows the feed-error notice. Legacy still URLs (/map/Cctv/{id}) also return HTML. Do not switch to the new site's backend (api-511x-nysdot.carsprogram.org): the new 511NY Terms of Use ban robots/extraction "except as permitted under the 511NY Developer Access Agreement" and ban reverse engineering.

2. Licence (the reason for this issue). DRB pulled 511NY keyless before any DAA acceptance (#183: "works keyless today"). The 2026-09-27 key request went to the old system. New DAA (last updated 2026-09-18, readable at 511ny.org/help -> For Developers) requires a request via the new form (Google Form linked on that page; reviewed weekly), naming product, market, and any third-party disseminators.

3. DAA compliance gaps in today's UI:

"You must display the time at which the data was published or last updated wherever you present it" -- the camera popup in MapView.tsx shows no timestamp (events already show "updated ...").
"best efforts to pass [the as-is disclaimer] on" -- no disclaimer anywhere.
"511NY" may not be used in DRB marketing/branding (UI source credit "511NY / NYSDOT" is fine).

To do: owner re-applies on the new form; port ny511.py to whatever feed/URL shape the grant documents; add camera timestamp + disclaimer line. Before any camera detection/overlay/frame retention: written confirmation from NYSDOT (DAA is silent on imagery analytics and archiving) -- contact named in the DAA.

Found 2026-10-04 while building `design-canvas/camera-sources.md` (§B). **1. Feed is dead (behavior).** 511ny.org cut over to the Castle Rock CARS "511x" platform (~2026-09-24..30). `https://511ny.org/api/getcameras?format=json` and `/api/getevents` now return the SPA's HTML (HTTP 200, `text/html`), so `ny511._fetch` raises on `r.json()` and the layer serves its last cache / shows the feed-error notice. Legacy still URLs (`/map/Cctv/{id}`) also return HTML. Do **not** switch to the new site's backend (`api-511x-nysdot.carsprogram.org`): the new 511NY Terms of Use ban robots/extraction "except as permitted under the 511NY Developer Access Agreement" and ban reverse engineering. **2. Licence (the reason for this issue).** DRB pulled 511NY keyless before any DAA acceptance (#183: "works keyless today"). The 2026-09-27 key request went to the old system. New DAA (last updated 2026-09-18, readable at 511ny.org/help -> For Developers) requires a request via the new form (Google Form linked on that page; reviewed weekly), naming product, market, and any third-party disseminators. **3. DAA compliance gaps in today's UI:** - "You must display the time at which the data was published or last updated wherever you present it" -- the camera popup in `MapView.tsx` shows no timestamp (events already show "updated ..."). - "best efforts to pass [the as-is disclaimer] on" -- no disclaimer anywhere. - "511NY" may not be used in DRB marketing/branding (UI source credit "511NY / NYSDOT" is fine). **To do:** owner re-applies on the new form; port `ny511.py` to whatever feed/URL shape the grant documents; add camera timestamp + disclaimer line. Before any camera detection/overlay/frame retention: written confirmation from NYSDOT (DAA is silent on imagery analytics and archiving) -- contact named in the DAA.

logan commented

2026-10-04 15:41:18 -04:00

Verified 2026-10-04 by reading https://511ny.org/help/24 in a browser (JS-rendered — plain fetches get an empty shell, which is why earlier reads were partial). DAA last updated 2026-09-18.

How to apply: the "XML Data Feed Request Form" — https://docs.google.com/forms/d/e/1FAIpQLScnYcXUYMvsfsVw5pBs2l_oZCqczxaepFVlgEJAP4aP3aASjw/viewform — reviewed weekly; approved users get feed instructions + docs by email. Must describe: intended use + product, market and benefit to the traveling public, similar products, any intermediate/third-party disseminators. Must keep NYSDOT informed of material changes.
Feeds: Traffic events (JSON), Camera inventory (XML), Winter road conditions (JSON), Message sign messages (JSON). Endpoints/schemas are not public — they arrive with approval.
Use: "redistribute, enhance, repackage, and add value" allowed; "You may not alter the substance of a report" (new constraint: don't rewrite event meaning); must display publish/last-updated time wherever shown.
Attribution: "powered by 511NY" + unaltered 511NY logo + link to 511NY.org; no "511NY" in DRB marketing/branding; nothing implying NYSDOT endorsement.
Disclaimer: pass on the as-is disclaimer with best efforts.
Contact: 511NY Program Manager (email on the page) — the right person for the #199 questions on overlays/detection/frame retention.

Verified 2026-10-04 by reading https://511ny.org/help/24 in a browser (JS-rendered — plain fetches get an empty shell, which is why earlier reads were partial). DAA last updated 2026-09-18. - **How to apply:** the "XML Data Feed Request Form" — https://docs.google.com/forms/d/e/1FAIpQLScnYcXUYMvsfsVw5pBs2l_oZCqczxaepFVlgEJAP4aP3aASjw/viewform — reviewed weekly; approved users get feed instructions + docs by email. Must describe: intended use + product, market and benefit to the traveling public, similar products, any intermediate/third-party disseminators. Must keep NYSDOT informed of material changes. - **Feeds:** Traffic events (JSON), Camera inventory (**XML**), Winter road conditions (JSON), Message sign messages (JSON). Endpoints/schemas are not public — they arrive with approval. - **Use:** "redistribute, enhance, repackage, and add value" allowed; **"You may not alter the substance of a report"** (new constraint: don't rewrite event meaning); must display publish/last-updated time wherever shown. - **Attribution:** "powered by 511NY" + unaltered 511NY logo + link to 511NY.org; no "511NY" in DRB marketing/branding; nothing implying NYSDOT endorsement. - **Disclaimer:** pass on the as-is disclaimer with best efforts. - **Contact:** 511NY Program Manager (email on the page) — the right person for the #199 questions on overlays/detection/frame retention.

logan referenced this issue

2026-10-04 17:59:35 -04:00

Live ops wall + pluggable camera providers with licence gating (server-26#198) #208

logan commented

2026-10-04 17:59:42 -04:00

PR #208 (live ops wall + camera provider registry). 511NY ships as an agreement_required provider, OFF by default; enabling it needs an admin licence acknowledgement recorded in audit_log, and /traffic/511 events follow the same switch. Camera popups now show catalog update time + the NYSDOT as-is disclaimer + "powered by 511NY" credit (gap 3 of this issue). Still open here: owner DAA re-application on the new form, then porting ny511.py to the granted feed shape (NY511_API_BASE + tolerant XML parser are in place, unverified until the grant documents it), and the approved 511NY logo. This issue stays open.

PR https://git.vpn.cusano.net/logan/server-26/pulls/208 (live ops wall + camera provider registry). 511NY ships as an `agreement_required` provider, OFF by default; enabling it needs an admin licence acknowledgement recorded in audit_log, and /traffic/511 events follow the same switch. Camera popups now show catalog update time + the NYSDOT as-is disclaimer + "powered by 511NY" credit (gap 3 of this issue). Still open here: owner DAA re-application on the new form, then porting ny511.py to the granted feed shape (NY511_API_BASE + tolerant XML parser are in place, unverified until the grant documents it), and the approved 511NY logo. This issue stays open.

logan referenced this issue

2026-10-04 18:07:43 -04:00

Live wall: minor UI follow-ups from #208 review (nested link in button, unclamped 511 bbox, no-CORS origin latch) #212

logan added the area/legal area/osint

labels 2026-10-05 02:05:00 -04:00

logan referenced this issue

2026-10-05 02:08:38 -04:00

Map: transit layer — MTA GTFS lines/stations plus GTFS-rt service alerts, with incident-to-ROW distance #245

logan commented

2026-10-05 02:08:41 -04:00

Map persona panel 2026-10-05: every NY-market persona noted the home-market camera wall, 'Nearest cameras' panel and Traffic Events layer are empty or erroring. TOC/NEWS ranked getting the DAA filed above any new camera-shaped work. Panel also confirmed: do not substitute PulsePoint (no public API, ToS forbids scraping) or Waze for Cities (public-agency partnership; a commercial vendor likely doesn't qualify).

logan referenced this issue

2026-10-05 02:09:11 -04:00

Map roadmap — persona panel 2026-10-05 #247

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: logan/server-26#198