benchmark-validity

Here are 3 public repositories matching this topic...

prathamesh-git9 / security-oracle-discrimination

Reproducible benchmark of security-oracle construct validity on 140 real CVE fixes.

benchmarking reproducible-research static-analysis software-security cwe empirical-software-engineering construct-validity llm-code-generation benchmark-validity security-oracle

Updated Aug 26, 2026
Python

maple-quanta / ai-evaluation-assurance

Star

MQ-EVA — Independent AI Evaluation Assurance: a framework for determining whether AI performance claims can be trusted

ai-evaluation ai-assurance ai-governance benchmark-validity ai-procurement tevv

Updated Aug 13, 2026
Python

kadubon / Oversight-Centered-Metrology-PoC

Sponsor

Star

Lightweight proof-of-concept for oversight-centered metrology in coding agents: workflow-aware evaluation, interrupt channels, and claim-margin reporting beyond raw success scores.

ai proof-of-concept human-in-the-loop metrology continuous-monitoring safe-control ai-agent ai-evaluation llm-evaluation coding-agents agentic-ai socio-technical-systems ai-oversight workflow-evaluation claim-margin interrupt-channels deployment-evaluation audit-gaming benchmark-validity

Updated Mar 12, 2026
Python

Add this topic to your repo

To associate your repository with the benchmark-validity topic, visit your repo's landing page and select "manage topics."

Learn more