You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@
10
10
11
11
## The Problem
12
12
13
-
AI generates code 16,000× cheaper than we can verify it. Generation costs dropped 100–150× since 2023. Human review is still capped at ~200 LOC/hour. The **Cv/Ci ratio** — cost-to-verify divided by cost-to-implement — has exploded from ~33:1 to **~3,300:1**, and it's degrading exponentially.
13
+
AI generates code 3,300× cheaper than we can verify it. Per-PR generation cost dropped ~20× since 2023 (raw token prices fell ~200×). Human review is still capped at ~200 LOC/hour. The **Cv/Ci ratio** — cost-to-verify divided by cost-to-implement — has exploded from ~167:1 to **~3,300:1**, and it's degrading exponentially.
Copy file name to clipboardExpand all lines: ai-verification-protocol.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -64,7 +64,7 @@ The protocol is versioned. **v3.0** added Active Repair Mode. **v3.1** hardened
64
64
65
65
## 0. Operating Context
66
66
67
-
Generation costs have collapsed 100-150x. Verification costs have not budged. The industry is shipping code 10,000x faster than humans can review it, and the **verification gap** — the fraction of generated code receiving no meaningful verification before production — compounds daily.
67
+
Per-PR generation cost has collapsed ~20x (raw token prices fell ~200x). Verification costs have not budged. The industry is shipping code 10,000x faster than humans can review it, and the **verification gap** — the fraction of generated code receiving no meaningful verification before production — compounds daily.
68
68
69
69
This protocol operates as a **multi-agent pipeline**, not a single reviewer. The whitepaper's central correlated-failure warning forbids relying on any one model to verify another model's output unaided. Roles must be played by distinct model instances, ideally from distinct provider families.
<divclass="cert-reason"><strong>Why:</strong> axis 2.3 (security surface) 🔴 — new crypto code with 3 SAST-high findings. PR size cap triggered (647 LOC in security path). Certificate identifies exact files and lines for human auditor to inspect.</div>
402
+
<divclass="cert-reason"><strong>Why:</strong> axis 2.3 (security surface) 🔴 — new crypto code with 3 SAST-high findings. η 0.71 sits below the 0.80 auto-threshold, and a 🔴 security axis forces Human Review Required. Certificate identifies exact files and lines for human auditor to inspect.</div>
403
403
</div>
404
404
</div>
405
405
@@ -436,9 +436,9 @@ <h1>The AI <span>Verification</span> Protocol</h1>
436
436
<section>
437
437
<divclass="section-inner">
438
438
<divclass="section-label">The Problem</div>
439
-
<h2class="section-title">AI generates code 16,000× cheaper than we can verify it</h2>
439
+
<h2class="section-title">AI generates code 3,300× cheaper than we can verify it</h2>
440
440
<pclass="section-desc">
441
-
In 2023, generating a 200-line PR cost $0.30 and verifying it cost ~$50. Today, the same PR costs $0.015 to generate — but verification still costs ~$50. The ratio has exploded from 33:1 to over 3,300:1, and it's degrading exponentially.
441
+
In 2023, generating a 200-line PR cost $0.30 and verifying it cost ~$50. Today, the same PR costs $0.015 to generate — but verification still costs ~$50. The ratio has exploded from 167:1 to over 3,300:1, and it's degrading exponentially.
442
442
</p>
443
443
<divclass="formula-block">
444
444
<code>Cv / Ci → ∞</code>
@@ -487,9 +487,9 @@ <h2 class="section-title">Why is AI verification debt the defining problem of th
In March 2023, GPT-4 cost $30/$60 per 1M tokens. By May 2026, DeepSeek V4-Flash costs $0.14/$0.28 — two orders of magnitude cheaper. But human review is still capped at ~200 lines of code per hour, the same sustainable rate documented by SmartBear and Cisco since 2006. The bottleneck shifted from generation to verification overnight.
492
+
In March 2023, GPT-4 cost $30/$60 per 1M tokens. By May 2026, DeepSeek V4-Flash costs $0.14/$0.28 — token prices fell roughly two orders of magnitude, yet per-PR generation cost dropped ~20× as agents grew more token-hungry. But human review is still capped at ~200 lines of code per hour, the same sustainable rate documented by SmartBear and Cisco since 2006. The bottleneck shifted from generation to verification overnight.
493
493
</p>
494
494
<divclass="cite">
495
495
<strong>The AI Verification Debt</strong> — "The industry is celebrating the collapse of generation cost. That is half of the story. [...] Google's engineering practices recommend changes under 200–400 LOC for thorough review. The SmartBear/Cisco study found that reviewing 200–400 LOC/hour is the sustainable human rate for detecting meaningful defects."
@@ -533,7 +533,7 @@ <h3>The components exist — they're just not wired together.</h3>
533
533
<divclass="why-num">05</div>
534
534
<h3>The Cv/Ci ratio is already ~3,300:1 and degrading exponentially.</h3>
535
535
<p>
536
-
Projecting forward: if the price war between US and Chinese labs continues and inference costs drop another 10×, the ratio hits ~16,700:1. The team that invests in verification infrastructure can safely ship 10× more code than the team that invests in better generation alone. The team that does not — will drown in verification debt within this decade.
536
+
Projecting forward: if the price war between US and Chinese labs continues and inference costs drop another 10×, the ratio hits ~33,000:1. The team that invests in verification infrastructure can safely ship 10× more code than the team that invests in better generation alone. The team that does not — will drown in verification debt within this decade.
537
537
</p>
538
538
<divclass="cite">
539
539
<strong>The AI Verification Debt</strong> — "The trap is not that the code is bad. The trap is that <em>nobody knows how bad it is</em> until the verification debt compounds. [...] The team that invests in verification infrastructure can safely ship 10× more code than the team that invests in better generation alone."
0 commit comments