Which AI labs commit to third party vetting by October 31?
Google has a plausible path to matching Anthropic’s evaluator-access commitment, but there is still no public sign that it intends to do so by the deadline. The most likely outcome is that Google does not make the specific employee-level, ongoing access commitment required for a Yes resolution.
Analysis
The key fact is that Google has not yet issued a public commitment that clearly matches Anthropic’s standard of ongoing, employee-level third-party evaluator access to systems, models, and training processes. The market is already reflecting that gap: traders appear to assign meaningful but limited odds, which is consistent with a story where the idea is live in the industry discussion but has not crossed the threshold into an official company pledge. That matters because this market is not about general support for evaluation, pilot access, or pre-release testing; it requires an explicit commitment that is broader, deeper, and more durable than a normal launch review or a customer-facing evaluation program.
The recent context is mildly supportive of a Yes outcome only in the sense that the conversation around external evaluation has become more prominent. Anthropic’s move raises the reputational bar for other frontier labs, and there is evidence that some industry voices are increasingly comfortable with stronger evaluator access. Still, the available signals around Google point mostly to model development, launch timing, infrastructure work, and general evaluation-related services rather than a concrete promise to open up internal systems to outside evaluators on an ongoing basis. A company like Google could decide to remain more selective, especially if it believes its existing safety, red-teaming, and internal review processes are sufficient or if it wants to avoid exposing training workflows and sensitive model development details.
From a market perspective, the current price implies the crowd sees some chance of a late policy shift, but not a high one. That seems reasonable because the remaining window is short and the required announcement must be official and unambiguous. Companies often prefer to use carefully scoped language around evaluation, access, and safety commitments, and the difference between a broad endorsement of third-party evaluation and a qualifying commitment is material here. Unless Google makes a targeted announcement that mirrors Anthropic’s language closely, the default expectation should remain No.
The main bullish case is that Google may feel pressure to avoid looking less transparent than competitors, especially if external evaluators and policymakers continue pushing for more access. But the strongest evidence today is still the absence of a qualifying statement, which is especially important given the market’s strict resolution rules. For Yes to happen, Google needs to do more than discuss evaluation in principle; it needs to publicly commit to ongoing third-party access in a way that clearly covers the development process.
Arguments
For
- Arguments for Yes: Competitive pressure from Anthropic’s commitment could push Google to match it for reputational reasons.
- Arguments for Yes: Growing emphasis on AI transparency may make a formal external-evaluator pledge more attractive to Google.
Against
- Arguments against Yes: Google has not publicly announced the specific ongoing employee-level access commitment required by the market.
- Arguments against Yes: Google may prefer narrower evaluation arrangements that stop short of opening training processes and internal systems.
Key drivers
- Google has not made a public commitment that clearly matches the required ongoing evaluator-access standard.
- The market is pricing uncertainty, not confirmation, which suggests the expected announcement has not materialized.
- Industry discussion around external evaluation is active, but discussion alone does not satisfy the resolution criteria.
- Google appears focused on model launches and infrastructure efforts rather than on a new public access pledge.
Risk factors
- Google could announce a last-minute policy shift that explicitly matches Anthropic’s evaluator-access commitment.
- A broader multi-company or government-linked agreement could include Google and qualify if it meets the exact criteria.
- Public phrasing about external evaluators could be more expansive than expected and accidentally satisfy the market’s language threshold.
- Credible reporting could surface a qualifying commitment before the deadline even without an obvious standalone blog post.
Scenarios
Best case
Google makes an official announcement before October 31 that it will grant third-party evaluators ongoing employee-level access to its systems, models, and training processes during development, matching the market’s definition closely enough to resolve Yes.
Most likely
Google continues discussing safety and evaluation in general terms, but does not issue the exact public commitment needed for a Yes resolution, so the market resolves No.
Worst case
Google makes no qualifying announcement and continues using only limited pre-deployment or service-based evaluation arrangements, leaving the market to resolve No.
More from this day
- EconomicsKalshiEnded
When will DOE next sell or exchange SPR oil?
AI14%MKT83%Edge-69HypedI think the chance of a DOE solicitation to sell or exchange SPR crude before the deadline is meaningfully below the market price. With only about a day left and no visible catalyst, I would put Yes around 14%.
- politicsPolymarketEnded
Next Prime Minister of Sweden
AI57%MKT20%Edge+37Hidden GemUlf Kristersson looks like the leading candidate to become the next prime minister, but the outcome still depends on whether he can assemble enough parliamentary tolerance or support. I think the market is underestimating his chances somewhat, though the deadlock keeps this far from assured.
- PoliticsKalshi3mo
When will a member of Trump's Cabinet leave?
AI97%MKT62%Edge+35Hidden GemThe Yes outcome looks overwhelmingly likely because the provided reporting already describes multiple Cabinet-level departures or replacements before the January 2027 cutoff. The only real uncertainty is resolution language, not whether turnover has occurred.