Skip to content

Response area tests - #100

Merged
peterbjohnson merged 5 commits into
mainfrom
response-area-tests
Nov 8, 2026
Merged

peterbjohnson merged 5 commits into
mainfrom
response-area-tests

Conversation

@peterbjohnson

Copy link
Copy Markdown
Member

No description provided.

Each response area takes accept, responses that must be marked correct,
and reject, responses that must be marked incorrect; both are written as
tests after the answer. MultipleChoice adds a failing test for each wrong
option alone and, with several correct options, for one correct option
and for all options. A response both accepted and rejected is refused.
The converter takes every area's tests from _all_tests and no longer
builds them itself. Whether a test passes is left to the evaluation
function, through the platform's teacher tests.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01JnCY3kcqP1vQ7UixMtuRep
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01JnCY3kcqP1vQ7UixMtuRep
Covers unique image names in the shared media folder, cropping figures
that are not embedded images, what skill means and who sets it, units
and labels in pre_text and post_text, data that appears only in the
solutions, and reporting failed teacher tests to the author.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01JnCY3kcqP1vQ7UixMtuRep
@codecov-commenter

Copy link
Copy Markdown

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.61%. Comparing base (b129440) to head (e3aac73).
⚠️ Report is 6 commits behind head on main.
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #100      +/-   ##
==========================================
+ Coverage   90.55%   91.61%   +1.05%     
==========================================
  Files          15       15              
  Lines         720      811      +91     
==========================================
+ Hits          652      743      +91     
  Misses         68       68              
Flag Coverage Δ
unittests 91.61% <100.00%> (+1.05%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@peterbjohnson
peterbjohnson marked this pull request as ready for review November 8, 2026 06:19
@peterbjohnson
peterbjohnson merged commit 80221cb into main Nov 8, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants