Alerts: confidence gate before any push alert (Discord/webhook) — avoid the CrimeRadar false shots-fired failure #300

Closed
opened 2026-10-27 20:03:50 -04:00 by logan · 1 comment
Owner

CrimeRadar published a false 'shots fired at an elementary school' alert after STT heard 'fire alarm' as 'firearm' (2026 BBC Verify; police now warn against such apps). alerter.py pushes on rule match with no confidence floor.

Add a minimum confidence and corroboration requirement (e.g. high-severity types need 2+ calls or a confident extraction) before pushing. Low-confidence matches go to a held state visible to admins.

CrimeRadar published a false 'shots fired at an elementary school' alert after STT heard 'fire alarm' as 'firearm' (2026 BBC Verify; police now warn against such apps). alerter.py pushes on rule match with no confidence floor. Add a minimum confidence and corroboration requirement (e.g. high-severity types need 2+ calls or a confident extraction) before pushing. Low-confidence matches go to a held state visible to admins.
logan added the
type
feature
area/ai-pipelinearea/discord
priority
p1
labels 2026-10-27 20:03:50 -04:00
Author
Owner

Fixed in ff0a89e, deployed to prod as 4fab959 on 2026-11-08 (/health confirms).

Fixed in ff0a89e, deployed to prod as 4fab959 on 2026-11-08 (/health confirms).
logan removed the
priority
p1
label 2026-11-08 21:51:15 -05:00
logan closed this issue 2026-11-08 21:51:15 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: logan/server-26#300