MYSTIC DEPOT: Vendor-Agnostic AI Evaluation Infrastructure

Name: MYSTIC DEPOT: Vendor-Agnostic AI Evaluation Infrastructure
Creator: Department of Defense
Keywords: CSO

Department of DefenseDefense Innovation Unit (DIU)

AI Overview

DoD seeks a vendor-agnostic AI evaluation harness and government-specific benchmarks to rigorously assess AI systems—including human-AI teams and autonomous agents—against mission-critical performance criteria. This infrastructure will enable reproducible evaluation across multiple defense programs as AI capabilities rapidly evolve.

This summary is AI-generated from the official solicitation.

Key Details

Agency

Department of Defense

Funding Amount

—

Release Date

March 10, 2026

Due Date

March 24, 2026 (Closed)

Official Description

As artificial intelligence (AI) capabilities evolve at an extraordinary pace, the government requires evaluation infr astructure that can keep pace by continuously assessing new models against mission-specific benchmarks as they are released. Further, the success of AI systems in national security contexts will depend on human-machine teaming. Evaluation must assess not only whether AI systems can perform tasks in isolation, but whether human-AI teams achieve better mission outcomes than either ...

View on official source

Change History

Opportunity AddedMar 10, 2026 at 10:14 PM