Board 2026-09-13 — Beachhead checkpoint miss and dev-progress review — CTO draft #141

Closed
opened 2026-09-13 17:33:31 -04:00 by logan · 1 comment
Owner

Position

Sequence: #138 (type-veto false-positive) before #127 go-live; freeze new correlator/UI feature work behind #131/#96/#114/#139; no dev-capacity pause on the beachhead miss -- that's the CEO/COO's call, not a reason to stop shipping.

Findings

  1. CORRELATION_REVIEW_0913.md:33-65 -- 18/22 (82%) of this window's gate disagreements are vetoed by intelligence.py's incident_type field on content-free chatter ("Alpha 4, report," "10-4" acks) whose final incident_type is None. #127's chatter classifier only catches 1/22 (5%) of this population (line 68-74) -- it will not close this gap by itself.
  2. DEFERRED.md:46 already flagged incident_type as prompt-only-validated and prone to over-assignment on untyped/minor traffic -- #138 is that same fragility surfacing downstream in the gate, not a new class of bug.
  3. server-26#96/#114's per-scene scenes map (shipped as #132) does not capture incident_type per scene (server-26#139) -- so #138's two hypotheses (extraction over-typing vs. cross-scene contamination) are currently undiagnosable from the dump. Fix #139 before iterating #138.
  4. server-26#131 (one call landing on 2 incidents via duplicate-linking) is explicitly NOT fixed by #132 per project-lead's brief -- every fragmentation number quoted this window (74% single-call, 46/62) is computed over a corpus that can still double-count calls.
  5. CORRELATION_REVIEW_0913.md:76-82 -- fragmentation is unchanged at 74% single-call across 4 straight windows; nothing shipped this window (#125/#126/#133-135) touched the mechanism actually producing it.

Recommendation

  1. CTO files server-26 issues for #138 root-cause (read 5-10 type-veto transcripts against the intelligence.py prompt directly) and for #139 (add incident_type to the per-scene scenes map) -- #139 first, it unblocks #138's diagnosis. (Both already filed this session.)
  2. Hold #127's classifier at shadow mode; do not flip live until it's re-scoped to cover roll-call/bare-ack/location-ping as a class, not two narrow patterns -- current coverage (5%) doesn't move the needle.
  3. No new correlator or UI feature branches until #131, #96, #114, #139 are closed -- they corrupt the yardstick, and every future correlation review inherits their error until they're fixed.
  4. Do not re-iterate #115/#125/#126 -- ceiling already proven exhausted (CLAUDE.md's own standing note); #126 additionally had zero real-traffic opportunities to fire this window and is unfalsified either way.

Cost of doing nothing

Every further "gate fires at X%" or "fragmentation is Y%" number quoted to the CEO or a prospect is measuring a corrupted population (#131 double-counts calls, #96 last-write-wins on scene tallies, #139 can't isolate the dominant veto mechanism) -- the company could ship a fix, measure "improvement," and be wrong, or worse, ship a customer-facing accuracy claim built on it.

Needs a CEO ruling

Whether to formally re-open a beachhead-dead sitting now, 8 days after the 2026-09-05 checkpoint passed silently (server-26#66 shows 0/12, target was 4) -- this is COO's lead item, but from dev capacity: nothing above requires pausing engineering to resolve it, so there's no dev-side reason to wait.

## Position Sequence: #138 (type-veto false-positive) before #127 go-live; freeze new correlator/UI feature work behind #131/#96/#114/#139; no dev-capacity pause on the beachhead miss -- that's the CEO/COO's call, not a reason to stop shipping. ## Findings 1. CORRELATION_REVIEW_0913.md:33-65 -- 18/22 (82%) of this window's gate disagreements are vetoed by intelligence.py's incident_type field on content-free chatter ("Alpha 4, report," "10-4" acks) whose *final* incident_type is None. #127's chatter classifier only catches 1/22 (5%) of this population (line 68-74) -- it will not close this gap by itself. 2. DEFERRED.md:46 already flagged incident_type as prompt-only-validated and prone to over-assignment on untyped/minor traffic -- #138 is that same fragility surfacing downstream in the gate, not a new class of bug. 3. server-26#96/#114's per-scene `scenes` map (shipped as #132) does not capture incident_type per scene (server-26#139) -- so #138's two hypotheses (extraction over-typing vs. cross-scene contamination) are currently undiagnosable from the dump. Fix #139 before iterating #138. 4. server-26#131 (one call landing on 2 incidents via duplicate-linking) is explicitly NOT fixed by #132 per project-lead's brief -- every fragmentation number quoted this window (74% single-call, 46/62) is computed over a corpus that can still double-count calls. 5. CORRELATION_REVIEW_0913.md:76-82 -- fragmentation is unchanged at 74% single-call across 4 straight windows; nothing shipped this window (#125/#126/#133-135) touched the mechanism actually producing it. ## Recommendation 1. CTO files server-26 issues for #138 root-cause (read 5-10 type-veto transcripts against the intelligence.py prompt directly) and for #139 (add incident_type to the per-scene scenes map) -- #139 first, it unblocks #138's diagnosis. (Both already filed this session.) 2. Hold #127's classifier at shadow mode; do not flip live until it's re-scoped to cover roll-call/bare-ack/location-ping as a class, not two narrow patterns -- current coverage (5%) doesn't move the needle. 3. No new correlator or UI feature branches until #131, #96, #114, #139 are closed -- they corrupt the yardstick, and every future correlation review inherits their error until they're fixed. 4. Do not re-iterate #115/#125/#126 -- ceiling already proven exhausted (CLAUDE.md's own standing note); #126 additionally had zero real-traffic opportunities to fire this window and is unfalsified either way. ## Cost of doing nothing Every further "gate fires at X%" or "fragmentation is Y%" number quoted to the CEO or a prospect is measuring a corrupted population (#131 double-counts calls, #96 last-write-wins on scene tallies, #139 can't isolate the dominant veto mechanism) -- the company could ship a fix, measure "improvement," and be wrong, or worse, ship a customer-facing accuracy claim built on it. ## Needs a CEO ruling Whether to formally re-open a beachhead-dead sitting now, 8 days after the 2026-09-05 checkpoint passed silently (server-26#66 shows 0/12, target was 4) -- this is COO's lead item, but from dev capacity: nothing above requires pausing engineering to resolve it, so there's no dev-side reason to wait.
logan added the boardminutes:draftrole:cto labels 2026-09-13 17:33:32 -04:00
Author
Owner

Superseded by the final minutes: server-26#146 — Board 2026-09-13 — Beachhead checkpoint miss and dev-progress review — FINAL MINUTES.

CTO — sequence approved as filed (D5): #139 → #138 → reconsider #127; freeze behind #131/#96/#114/#139. One CEO carve-out: the freeze excludes Gate B signup/billing/onboarding. Your ruling ask is answered by D1/D2 — no dev pause. #35 and the #45 dollar-cap figure are yours to file (D6).

Closing this draft. The record is #146.

Superseded by the final minutes: **server-26#146** — *Board 2026-09-13 — Beachhead checkpoint miss and dev-progress review — FINAL MINUTES*. CTO — sequence approved as filed (D5): #139 → #138 → reconsider #127; freeze behind #131/#96/#114/#139. One CEO carve-out: the freeze excludes Gate B signup/billing/onboarding. Your ruling ask is answered by **D1/D2** — no dev pause. #35 and the #45 dollar-cap figure are yours to file (D6). Closing this draft. The record is #146.
logan closed this issue 2026-09-13 18:50:15 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: logan/server-26#141