Skip to content

test: verify unlocked requirements evidence on an isolated dependency change - #2554

Closed
groupthinking wants to merge 3 commits into
codex/dependency-evidence-canary-base-nov2from
codex/dependency-evidence-canary-nov2
Closed

groupthinking wants to merge 3 commits into
codex/dependency-evidence-canary-base-nov2from
codex/dependency-evidence-canary-nov2

Conversation

@groupthinking

@groupthinking groupthinking commented Nov 2, 2026 •

Copy link
Copy Markdown
Owner

Controlled hosted verification for dependency recorder commit c62c51f.

Base branch must point exactly to 1b826c1; candidate head is 87990c3. The head adds the two-file recorder repair and the exact apps/web/package.json and package-lock.json bytes already tested and published at #2400 head 8634445. This four-file comparison invokes the actual dependency-review workflow off main; it is not a second product upgrade or a merge candidate.

Required readback: exact base/head and run identity; current-head CI checks; complete dependency-review artifact with schema 3, matching count/hash/raw API rows, original review outcome, and source proof for any unchanged unlocked requirements resolution rows. Existing vulnerability/license checks must remain enforced. Do not infer runtime/model/payment success from this test.

Local recorder validation: 101 affected tests and Ruff pass. The full actual 68-row failed comparison replays without dropping rows or changing its failing review outcome. The canary manifests and lock are byte-identical to tested #2400, but no separate canary install/build or hosted success is claimed. Independent review's attached-hash and malformed-version findings are corrected with failing-before/passing-after regressions and exact probe readback.

Hosted verification is complete and this temporary test PR is closed without merging. Both source branches are preserved. No resolver drift occurred in this comparison; the actual-input replay separately proves that repaired branch. No automatic merge or deployment was requested.

Closes #2552. This reference links the exact tested repair for repository validation; this diagnostic PR will remain unmerged.

Hosted verification — 2026-11-02

Controlled off-main canary #2554 ran this exact recorder at head 87990c3 against base 1b826c1. Dependency run 41530056594, attempt 1, passed full-tree snapshot submission, combined-lock submission, dependency policy review, evidence recording and upload. Head combined snapshot 117439219 reports four manifests and 2,191 packages; exact-base run 41526123217 had already submitted both snapshot types.

Downloaded artifact 13181672366 contains schema-3 review.json with the exact base/head/run/attempt and review_outcome=success. Its 22 raw rows comprise all 20 expected package-lock.json version/scope changes plus two apps/web/package.json changes; the rows contain no reported vulnerability entries. An independent live API read returned HTTP 200, an empty snapshot-warning header and no next page. The entire raw JSON is byte-identical to the uploaded file: SHA-256 0ba4804ac578e6d40500d12e86b8bf766cb5b02df36352ddb26efda5cdad99d7. The downloaded ZIP also matches GitHub's archive digest, SHA-256 2906844dcae21c5523d66454598f522461e3cefaf8b438481fb295034307ff52. The recorded success agrees with the actual policy action; policy settings were not changed.

No fresh unlocked-Python resolver drift occurred in this comparison, so unchanged_requirements_resolutions is empty. The separate captured 68-row production-input replay exercises that repaired branch, retaining every row and its original failing verdict. Both base and head full-tree scanners hit the existing 240-second limit/exit 137 for root requirements.txt and docs/guides/requirements.txt and fell back to declared dependencies without their transitive graph. A warning-free compare is therefore not a claim of complete transitive Python resolution.

Hosted logs confirm all 34 new recorder cases passed in repair Python 3.11 and canary Python 3.12; each inspected unit run passed 3,074 tests with nine deselected, five xpassed and 118 passing subtests. The repair PR's own dependency check correctly used the source-only path and did not produce an artifact. Canary evidence does not establish that each original update PR against main has passed; their exact-head reviews and checks remain separate.

The final CI build also passed TypeScript, ESLint, the web build, real-service Studio preflight and the production-image build. The preview E2E suite passed 16 tests; its cached ready-pack result is not proof of fresh video generation. Repair implementation and review continue in #2553.

@vercel

vercel Bot commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
v0-uvai Ready Ready Preview, v0 Nov 2, 2026 9:37pm UTC

@coderabbitai

coderabbitai Bot commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@github-actions

github-actions Bot commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

🔍 PR Validation

⚠️ Large PR detected (548 lines changed)

@github-actions

github-actions Bot commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

✅ E2E Test Results: ALL TESTS PASSED

Metric Value
Status 🟢 GREEN
Total Tests
Passed 16
Failed
Deployment https://v0-uvai-28nrs0zfu-garv1.vercel.app
Test Output
every request without persisting it�[32m 1�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mTemplate Gallery�[2m > �[22mhomepage returns 200 with HTML�[32m 191�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mTemplate Gallery�[2m > �[22mfeatures page contains template/workflow markup�[33m 491�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mTemplate Gallery�[2m > �[22mfeatures page surfaces at least 5 workflow/template indicators�[33m 307�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mVideo Pack Pipeline�[2m > �[22mPOST /api/video/pack accepts a YouTube URL without hanging�[33m 2023�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mVideo Pack Pipeline�[2m > �[22mGET /api/video/pack resolves to a ready pack with evidence lineage�[33m 829�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mError Handling�[2m > �[22mmissing URL returns 400, not a hang�[32m 178�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mError Handling�[2m > �[22minvalid URL returns 400 quickly, not a hang�[32m 184�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mError Handling�[2m > �[22mPOST /api/video/pack with no body returns 400�[32m 182�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mDashboard�[2m > �[22m/dashboard returns 200�[32m 248�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mDashboard�[2m > �[22m/dashboard contains agent or pipeline visualization markup�[32m 185�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mAPI Health�[2m > �[22mGET /api returns a response (not 404)�[33m 358�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mAPI Health�[2m > �[22mretired /api/pipeline routes are gone (no pipeline served)�[32m 84�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mStatic Assets�[2m > �[22mhomepage has proper meta tags�[32m 195�[2mms�[22m�[39m
 �[32m✓�[39m tests/e2e/pipeline.test.ts�[2m > �[22mEventRelay E2E — Live Deployment�[2m > �[22mStatic Assets�[2m > �[22m/features page returns 200�[32m 215�[2mms�[22m�[39m

�[2m Test Files �[22m �[1m�[32m1 passed�[39m�[22m�[90m (1)�[39m
�[2m      Tests �[22m �[1m�[32m16 passed�[39m�[22m�[90m (16)�[39m
�[2m   Start at �[22m 21:38:54
�[2m   Duration �[22m 7.58s�[2m (transform 54ms, setup 0ms, import 70ms, tests 7.37s, environment 0ms)�[22m


@github-actions

github-actions Bot commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

OpenSSF Scorecard

Scorecard details
PackageVersionScoreDetails
npm/@stripe/stripe-js ^10.0.0 UnknownUnknown
npm/@stripe/stripe-js 10.2.0 🟢 7.1
Details
CheckScoreReason
Code-Review🟢 7Found 17/23 approved changesets -- score normalized to 7
Packaging⚠️ -1packaging workflow not detected
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Maintained🟢 1030 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Binary-Artifacts🟢 10no binaries found in the repo
Pinned-Dependencies🟢 10all dependencies are pinned
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
Fuzzing⚠️ 0project is not fuzzed
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection🟢 6branch protection is not maximal on development and all release branches
Security-Policy🟢 10security policy file detected
SAST🟢 9SAST tool is not run on all commits -- score normalized to 9
npm/@vitest/expect 4.1.12 UnknownUnknown
npm/@vitest/mocker 4.1.12 UnknownUnknown
npm/@vitest/pretty-format 4.1.12 UnknownUnknown
npm/@vitest/runner 4.1.12 UnknownUnknown
npm/@vitest/snapshot 4.1.12 UnknownUnknown
npm/@vitest/spy 4.1.12 UnknownUnknown
npm/@vitest/utils 4.1.12 UnknownUnknown
npm/tinyrainbow 3.2.0 UnknownUnknown
npm/vitest 4.1.12 UnknownUnknown

Scanned Files

  • apps/web/package.json
  • package-lock.json

This branch was successfully deployed

1 active deployment
Preview — 87990c39 Deployed Nov 2, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant