TL;DR
The US government has established a classified benchmarking process for advanced AI models, designating certain models as ‘covered frontier models.’ Participation in pre-release evaluations is voluntary but could influence federal procurement. This move signals a significant shift in AI security oversight.
On June 2, President Biden signed Executive Order 14409, establishing a classified benchmarking process for advanced AI models, with a deadline of August 1, 2026. This order mandates the creation of thresholds to identify ‘covered frontier models’ based on cyber capabilities, with the NSA responsible for designations. It also introduces a voluntary pre-release review framework allowing the federal government to assess models up to 30 days before public deployment, impacting AI development and procurement.
The executive order, titled Promoting Advanced Artificial Intelligence Innovation and Security, directs agencies including the Treasury, NSA, and CISA to develop classified benchmarks measuring AI cyber capabilities. These benchmarks will determine if a model qualifies as a ‘covered frontier model,’ a designation made solely by the NSA. The process is set to be finalized by August 1, 2026.
Alongside this, the order establishes a voluntary framework whereby developers can opt to share models with the federal government for evaluation up to 30 days prior to release. Participation is not mandatory, but the order hints that being a ‘trusted partner’—a status linked to participation—may influence future federal procurement preferences. The order also creates an AI cybersecurity clearinghouse under Treasury to facilitate information sharing on vulnerabilities and allocates funding for AI security tooling and talent acquisition.
Legal analysts note that although participation is voluntary, the designation as a trusted partner could become a de facto requirement for federal contracts, effectively making the benchmarks and review process a significant gatekeeper in the AI industry. The order also reflects a shift from previous hands-off policies, positioning NSA and Treasury as central overseers of AI security.
Implications of Classified AI Benchmarks for US AI Industry
This development marks a major shift in US AI governance, elevating cybersecurity considerations to a national security level. The classification of benchmarks means that developers will not see the criteria used to evaluate their models, potentially creating opaque standards that could influence market access and government procurement. The move signals a more assertive US stance on AI safety and security, possibly impacting global AI competitiveness and setting a precedent for secretive evaluation frameworks.
For AI companies, especially those seeking federal contracts, participation could become a strategic decision—voluntary now, but potentially mandatory in practice if trusted partner status influences procurement. The order also indicates a prioritization of cybersecurity in AI development, with funding and talent directed toward vulnerability detection and threat mitigation, affecting the broader AI ecosystem and international competitiveness.
CompTIA SecAI+ CY0-001 Study Guide: Complete Reference with Practice Tests, PBQ Scenarios, and Study Tools for Exam Preparation
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
US AI Governance Shift and Historical Precedents
This executive order is a second iteration after an earlier version was reportedly withdrawn over concerns it might hinder US AI competitiveness. Unlike prior policies emphasizing voluntary industry self-regulation, this order significantly increases federal oversight by assigning NSA and Treasury new roles in AI security assessment. Historically, the US has been cautious about transparency in AI standards, favoring classified evaluations similar to military and intelligence practices. In contrast, the EU’s approach with the AI Act emphasizes public, contestable thresholds—such as compute limits—highlighting a fundamental divergence in governance philosophy.
The order also echoes past government actions where capability assessments—like those for weapons or cybersecurity—are classified to prevent adversaries from exploiting weaknesses. The move to classify AI benchmarks aligns AI security with traditional national security measures, signaling a more militarized and secretive stance compared to open European standards.
As an affiliate, we earn on qualifying purchases.
Unanswered Questions About AI Benchmark Classification
It remains unclear how the classified benchmarks will be developed, what specific capabilities they will measure, and how the NSA will make designation decisions without transparency. The potential for benchmarks to evolve over time and the exact criteria for ‘covered frontier models’ are still undisclosed. Additionally, the long-term impact of this framework on global AI competitiveness and whether other nations will adopt similar secretive standards is uncertain.
As an affiliate, we earn on qualifying purchases.
Next Steps in US AI Security Oversight
Agencies are expected to finalize the classified benchmarks and the designation process by August 1, 2026. Developers will decide whether to participate in the voluntary pre-release review, which could influence their standing in federal procurement. The government will also continue to develop the AI cybersecurity clearinghouse and allocate resources toward vulnerability detection tools. Monitoring how industry responds and whether Congress debates potential mandates will be key in the coming months.
As an affiliate, we earn on qualifying purchases.
Key Questions
What is a ‘covered frontier model’?
A ‘covered frontier model’ is an AI system designated by the NSA as having advanced cyber capabilities that meet certain classified thresholds, subject to the new benchmarking process established by the executive order.
Will participation in the pre-release review be mandatory?
Participation is currently voluntary, but industry experts suggest that de facto requirements may emerge if trusted partner status influences federal procurement decisions.
Why are the benchmarks classified?
The benchmarks are classified to prevent adversaries from learning evaluation criteria, which could be exploited for malicious purposes or to teach models to evade detection.
How does this compare to European AI standards?
The EU AI Act uses transparent, public thresholds based on compute and risk levels, whereas the US is adopting a secretive, classified approach that limits public scrutiny and contestability.
What are the implications for AI developers?
Developers may face increased pressure to participate in voluntary evaluations, with trusted partner status potentially becoming a key factor in federal contracts, influencing industry practices and competitive positioning.
Source: ThorstenMeyerAI.com
