Skip to content

test(e2e): Move OpenAI and Anthropic send-to-sentry cases into gen-ai-libraries - #25841

Draft
mydea wants to merge 1 commit into
developfrom
test/e2e-merge-ai-send-to-sentry-into-gen-ai-libraries
Draft

mydea wants to merge 1 commit into
developfrom
test/e2e-merge-ai-send-to-sentry-into-gen-ai-libraries

Conversation

@mydea

@mydea mydea commented Oct 28, 2026

Copy link
Copy Markdown
Member

Why: Whether gen_ai spans arrive in Sentry isn't something we need to test for each AI integration, and gen-ai-libraries already sends OpenAI and Anthropic chat and tool calls through real OpenRouter and checks them at the event proxy. The only thing the two send-to-sentry apps still covered was a handful of calls against the real provider: streaming with token usage, the Responses API, embeddings, and the Anthropic messages.stream() helper. Those move into gen-ai-libraries as provider-specific extras, so they now also run on Cloudflare. The new (latest) variant replaces the latest-SDK coverage the removed apps had.

How to review: Start with tests/extras.test.ts. The [DONE]-frame workaround came over from the Anthropic app, because Anthropic SDK 0.136+ needs it with OpenRouter.

Unsure about: @anthropic-ai/sdk 1.x isn't instrumented at all: the orchestrion config only covers <1, so no gen_ai.chat span is created. The (latest) variant therefore updates Anthropic to the latest 0.x (0.137.0) instead of @latest. The removed app's (latest) variant would have hit this gap. Supporting 1.x should be a separate issue.

All three variants (node, cloudflare, latest) pass locally, 15/15 each.

🤖 Generated with Claude Code

…-libraries

gen-ai-libraries already runs chat and tool calls for both SDKs against
real OpenRouter through the event proxy. Moves the cases only the
send-to-sentry apps had (streaming usage, Responses API, embeddings, the
Anthropic stream helper) into it, so they also run on Cloudflare, adds a
(latest) variant for both SDKs, and removes node-openai-send-to-sentry and
node-anthropic-send-to-sentry.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

size-limit report 📦

Compared: 9101732 (PR test merge using develop at b382e30)

Against: b382e30 (develop) · base run #63998

✅ Baseline matches: this diff contains only this PR's changes.

Path Size % Change Change
@sentry/browser 30.34 kB - -
@sentry/browser - with treeshaking flags 28.46 kB - -
@sentry/browser - with treeshaking flags tracing without tracing 28.35 kB - -
@sentry/browser (incl. Tracing) 52.61 kB - -
@sentry/browser (incl. Tracing + Span Streaming) 52.62 kB - -
@sentry/browser (incl. Tracing, Profiling) 55.54 kB - -
@sentry/browser (incl. Tracing, Replay) 92.81 kB - -
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags 81.43 kB - -
@sentry/browser (incl. Tracing, Replay with Canvas) 97.54 kB - -
@sentry/browser (incl. Tracing, Replay, Feedback) 110.52 kB - -
@sentry/browser (incl. Feedback) 47.9 kB - -
@sentry/browser (incl. sendFeedback) 35.41 kB - -
@sentry/browser (incl. FeedbackAsync) 40.52 kB - -
@sentry/browser (incl. Metrics) 31.35 kB - -
@sentry/browser (incl. Logs) 31.63 kB - -
@sentry/browser (incl. Metrics & Logs) 32.31 kB - -
@sentry/react 32.16 kB - -
@sentry/react (incl. Tracing) 54.89 kB - -
@sentry/vue 38.61 kB - -
@sentry/vue (incl. Tracing) 55.5 kB - -
@sentry/svelte 30.37 kB - -
@sentry/remix (Remix 3 client bundle) 57.65 kB - -
CDN Bundle 32.07 kB - -
CDN Bundle (incl. Tracing) 53.1 kB - -
CDN Bundle (incl. Logs, Metrics) 34.27 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) 55.05 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) 75.69 kB - -
CDN Bundle (incl. Tracing, Replay) 91.23 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) 93.17 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) 97.36 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) 99.34 kB - -
CDN Bundle - uncompressed 94.31 kB - -
CDN Bundle (incl. Tracing) - uncompressed 157.3 kB - -
CDN Bundle (incl. Logs, Metrics) - uncompressed 100.86 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) - uncompressed 163.27 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) - uncompressed 232.36 kB - -
CDN Bundle (incl. Tracing, Replay) - uncompressed 278.93 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) - uncompressed 284.88 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed 292.63 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) - uncompressed 298.58 kB - -
@sentry/nextjs (client) 57.75 kB - -
@sentry/sveltekit (client) 53.06 kB - -
@sentry/core/server 44.29 kB - -
@sentry/core/browser 13.95 kB - -
@sentry/node 155.05 kB +0.01% +10 B 🔺
@sentry/node/import (ESM hook with diagnostics-channel injection) 81.67 kB - -
@sentry/node - without tracing 95.77 kB +0.01% +7 B 🔺
@sentry/node - without channel injection 135.68 kB +0.01% +9 B 🔺
@sentry/aws-serverless 103.94 kB +0.01% +7 B 🔺
@sentry/cloudflare (withSentry) - minified 197.89 kB - -
@sentry/cloudflare (withSentry) 491.81 kB - -
@sentry/nextjs/cloudflare (withSentry) - minified 218.47 kB - -

View base workflow run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit a22efbc. Configure here.

expect(attr(span, 'gen_ai.provider.name')).toBe('openai');
expect(attr(span, 'gen_ai.embeddings.input')).toContain('Paris');
expect(attr(span, 'gen_ai.usage.input_tokens')).toBeGreaterThan(0);
});

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hardcoded span attribute names in tests

Low Severity

New extra-route assertions compare span ops and attributes with string literals such as gen_ai.chat and sentry.origin. This was flagged because the review rules require those values to come from @sentry/conventions. The rest of this app's tests use the same local style.

Additional Locations (2)
Fix in Cursor Fix in Web

Triggered by project rule: PR Review Guidelines for Cursor Bot

Reviewed by Cursor Bugbot for commit a22efbc. Configure here.

@github-actions

Copy link
Copy Markdown
Contributor

Optional E2E tests

Some optional checks were not successful. They do not block the merge. 7 not successful, 57 successful. See the run.

Check Status
❌ CI: Optional E2E Tests / E2E nextjs-16 (cloudflare, latest) Test (optional) Failing after 23s Details
❌ CI: Optional E2E Tests / E2E nextjs-16 (deno) Test (optional) Failing after 29s Details
❌ CI: Optional E2E Tests / E2E nextjs-16 (canary, turbopack) Test (optional) Failing after 18s Details
❌ CI: Optional E2E Tests / E2E nextjs-16-tunnel (cloudflare) Test (optional) Failing after 49s Details
❌ CI: Optional E2E Tests / E2E nextjs-16 (vinext, bun) Test (optional) Failing after 19s Details
❌ CI: Optional E2E Tests / E2E nextjs-16 (canary, webpack) Test (optional) Failing after 29s Details
❌ CI: Optional E2E Tests / E2E nextjs-16 (vinext) Test (optional) Failing after 40s Details
Successful checks
Check Status
✅ CI: Optional E2E Tests / E2E angular (canary) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E angular (canary) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E nextjs-orpc Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-eve Test (optional) Successful in 42s Details
✅ CI: Optional E2E Tests / E2E node-openai-decisions-send-to-sentry (latest) Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E node-express-send-to-sentry Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E cloudflare-workers-send-to-sentry Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E nextjs-14 (latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-eve (latest) Test (optional) Successful in 55s Details
✅ CI: Optional E2E Tests / E2E cloudflare-mastra Test (optional) Successful in 46s Details
✅ CI: Optional E2E Tests / E2E cloudflare-think (ai v6) Test (optional) Successful in 37s Details
✅ CI: Optional E2E Tests / E2E nextjs-15 (latest) Test (optional) Successful in 4m Details
✅ CI: Optional E2E Tests / E2E astro-7 Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-flue-send-to-sentry Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E nextjs-15 (turbo) Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E node-express-mcp-v1 Test (optional) Successful in 21s Details
✅ CI: Optional E2E Tests / E2E nextjs-14 (canary) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E cloudflare-pi-durable (latest) Test (optional) Successful in 39s Details
✅ CI: Optional E2E Tests / E2E node-mastra (latest) Test (optional) Successful in 50s Details
✅ CI: Optional E2E Tests / E2E cloudflare-agent Test (optional) Successful in 34s Details
✅ CI: Optional E2E Tests / E2E astro-7-static Test (optional) Successful in 59s Details
✅ CI: Optional E2E Tests / E2E node-mastra Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-flue (latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E gen-ai-libraries Test (optional) Successful in 39s Details
✅ CI: Optional E2E Tests / E2E debug-id-sourcemaps Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-express-send-to-sentry-static Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E gen-ai-libraries (latest) Test (optional) Successful in 48s Details
✅ CI: Optional E2E Tests / E2E node-express-mcp-v2 Test (optional) Successful in 28s Details
✅ CI: Optional E2E Tests / E2E node-flue Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E deno (latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-eve (orchestrion) Test (optional) Successful in 58s Details
✅ CI: Optional E2E Tests / E2E tanstackstart-react-sourcemaps Test (optional) Successful in 29s Details
✅ CI: Optional E2E Tests / E2E react-send-to-sentry Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E cloudflare-flue-send-to-sentry Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E nextjs-16-standalone (canary, turbopack) Test (optional) Successful in 47s Details
✅ CI: Optional E2E Tests / E2E nuxt-5-sourcemaps (static / nuxt generate) Test (optional) Successful in 34s Details
✅ CI: Optional E2E Tests / E2E node-openai-decisions-send-to-sentry Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-fastify-6 Test (optional) Successful in 51s Details
✅ CI: Optional E2E Tests / E2E gen-ai-libraries (cloudflare) Test (optional) Successful in 42s Details
✅ CI: Optional E2E Tests / E2E nuxt-3 (canary) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-fastify-6 (tracer provider) Test (optional) Successful in 39s Details
✅ CI: Optional E2E Tests / E2E cloudflare-think Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E nuxt-5-sourcemaps (client source maps kept) Test (optional) Successful in 38s Details
✅ CI: Optional E2E Tests / E2E vue-3 (canary) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E cloudflare-pi-durable Test (optional) Successful in 37s Details
✅ CI: Optional E2E Tests / E2E node-pi-durable (latest) Test (optional) Successful in 28s Details
✅ CI: Optional E2E Tests / E2E supabase-nextjs Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E nuxt-5 Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E nuxt-4 (canary) Test (optional) Successful in 3m Details
✅ CI: Optional E2E Tests / E2E vue-3 (no Options API) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E node-pi-durable Test (optional) Successful in 33s Details
✅ CI: Optional E2E Tests / E2E nuxt-4-static (canary) Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E react-router-7-framework-instrumentation Test (optional) Successful in 2m Details
✅ CI: Optional E2E Tests / E2E solidstart-2 Test (optional) Successful in 41s Details
✅ CI: Optional E2E Tests / E2E nuxt-5-sourcemaps Test (optional) Successful in 41s Details
✅ CI: Optional E2E Tests / E2E node-flue-send-to-sentry (latest) Test (optional) Successful in 1m Details
✅ CI: Optional E2E Tests / E2E tanstackstart-react-cloudflare Test (optional) Successful in 33s Details

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant