A proof with edges
Google DeepMind researchers used an AI framework called AlphaProof Code to help formally verify several cryptographic guarantees in parts of Signal’s protocol implementation, according to WIRED. Formal verification expresses a specific property mathematically and checks that a defined implementation satisfies it under stated assumptions. The demonstrated change is precise: AI agents helped produce machine-checkable evidence about important production cryptographic code. They did not prove that every part of Signal is secure. [1]
That last distinction is small enough to disappear inside a headline and large enough to matter to anyone with private messages. A proof sounds complete. This proof had an intentional boundary. It did not formally verify the entire Signal mobile application, and DeepMind’s researchers described the work as one milestone in a much larger process. “Formally verified” is therefore not a full-body suit of certainty. It covers what it covers. [1]
A person does not experience a protocol in isolation. They encounter an app, a phone, account controls, updates and an operating system. NIST explains that testing remains necessary even when formal proofs exist, because assumptions can fail when a specification is connected to implemented code, and a small element of a proof may correspond to a large quantity of library code. Mathematical confidence can be deep without being wide. [2]
So the useful response to “proved” is not automatic trust or reflexive dismissal. It is a calmer question: proved what? Precision has a perimeter. Inside that perimeter, a proof can offer unusually strong evidence. Outside it, the normal problems of software continue—bugs, dependencies, poor decisions and the occasional feature that behaves exactly as designed but should never have been designed that way. [1] [2]
The promise behind the proof
The hopeful part deserves room. Formal methods—mathematical techniques for specifying and verifying system properties—have a reputation for enormous expense, according to NIST. DeepMind’s Signal project was completed in four weeks, although it benefited from earlier verification work. When researchers applied the system to older Signal versions containing known, previously fixed vulnerabilities, the relevant claims could not be verified. The project found no new vulnerabilities in the portions examined. [1] [2]
For ordinary people, the potential consequence is not a mountain of mathematics. It is software accompanied by checkable evidence for named promises. If AI-assisted proof construction becomes affordable and repeatable, providers of consequential systems could eventually offer more than “our team tested this.” They could identify a property, disclose its assumptions and provide evidence that independent tools can check. That broader availability remains a possibility, not a result established by this one project. [1] [2]
What interests me is where the human power moves. AI may reduce some of the labour of constructing a proof, but it does not remove the decision about what deserves proving. That decision sits in the specification: the formal description of the required behaviour. DeepMind’s researchers described a human-AI collaboration in which agents contributed and corrected their work while people supplied input and review at important points. [1]
Here is the semantic reversal: if proving becomes easier, omission becomes more powerful. The connection is practical, not playful. A company could prove a narrow property perfectly while leaving the customer’s actual concern outside the specification. The mathematics may be objective once the question is fixed. Choosing the question is still a human act, shaped by budgets, incentives, regulation and whatever the marketing department hopes will fit on one line. [1] [2]
Assurance without absolution
The serious counterargument is that Signal may be an unusually favourable case. Its cryptography is important, heavily studied and suited to guarantees that specialists can state precisely. Everyday business software often contains shifting dependencies, ambiguous rules and disagreements about what correct behaviour means. Google did not disclose the project’s cost, and it did not tell WIRED whether AlphaProof Code would become a commercial product or service. Four weeks is notable. It is not a price tag. [1]
That uncertainty limits the grand prediction. This project does not establish that smaller organisations can now afford formal verification, that every critical system can be handled similarly, or that AI has solved software security. It demonstrates AI-assisted proof construction in one curated and consequential setting. Scaling from cryptographic properties to sprawling software—and maintaining proofs as that software changes—may be the harder proof still to come. [1] [2]
There is also a hidden bill. People must define the guarantees, inspect the assumptions, review the work, maintain the specification and test everything surrounding the proved portion. Someone must pay for that care. If companies receive the authority of the phrase “formally verified” while customers bear the cost of misunderstanding its scope, proof becomes reassurance without responsibility. Assurance should clarify accountability, not absolve it. [1] [2]
When you encounter a formal-verification claim, ask four ordinary questions: what code was covered, which properties were proved, what assumptions were made, and what remained outside? You need not read the mathematics to ask where it begins and ends. AlphaProof Code has shown that AI can help construct a formidable proof. The useful human habit is learning to notice its edges—because every proof has a point, and every proof has a perimeter. [1] [2]
Sources and further reading
AI Transparency
This Founder Reflection and its editorial image were produced with AI under Andrew David Baron's editorial direction. Linked sources support reported facts; the perspective and interpretation are editorial.
