Skip to content

Leaderboard: add NuRoute Artemis (#224) - #249

Merged
yl231 merged 1 commit into
mainfrom
leaderboard/nuroute-artemis-224
Oct 29, 2026
Merged

Leaderboard: add NuRoute Artemis (#224)#249
yl231 merged 1 commit into
mainfrom
leaderboard/nuroute-artemis-224

Conversation

@yl231

@yl231 yl231 commented Oct 29, 2026

Copy link
Copy Markdown
Contributor

Adds NuRoute Artemis (#224, landed via #247) to the leaderboard at #13.

Arena Accuracy Cost / 1K Optimality Robustness
72.87 75.47% $0.60 — (no optimality rows) 80.00
  • README: a new row. Rows below it move down one place; no values change.
  • leaderboard_manifest.yaml: a NuRoute Artemis entry, closed-source (served from NuRoute's production API), linked to https://nuroute.ai.

The numbers come from /evaluate on #224, re-run on Oct 29 after the LiveCodeBench fixes were merged. #208 (NuRoute v1) is still open while we ask whether this entry replaces it.

🤖 Generated with Claude Code

@yl231 @claude
Leaderboard: add NuRoute Artemis (#224)
f47ef84 
NuRoute's Artemis Task router (#224, landed via #247): Arena 72.87, accuracy
75.47%, $0.60 per 1K queries, robustness 80.00, re-evaluated with the
LiveCodeBench fixes. Adds its README row and a closed-source manifest entry.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@yl231
yl231 merged commit 483e557 into main Oct 29, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@yl231