Skip to content

docs(models): the output floor covers max_output_tokens too - #199

Merged
sre-helmcode merged 2 commits into
mainfrom
docs/output-budget-limits
Oct 19, 2026
Merged

sre-helmcode merged 2 commits into
mainfrom
docs/output-budget-limits

Conversation

@sre-helmcode

Copy link
Copy Markdown
Contributor

What

The deepseek-v4-flash card documented the output-budget floor as "a max_tokens below 16384 is raised to 16384", which named only the Chat Completions fields.

The floor now covers the Responses API's max_output_tokens as well (see helmcode/nan-devops#893), so the sentence covers both routes and states the other half of the rule explicitly: a budget above 16384 is never lowered.

Why

The same model answered with a different output budget depending on the route, and the public doc described neither the parity nor the "never lowered" half. A client reading only this page could not tell what their max_output_tokens would become.

Verification

npm run build passes in the worktree.

The deepseek-v4-flash card said "a max_tokens below 16384 is raised to
16384", which described only the Chat Completions fields. The floor now
covers the Responses API's max_output_tokens as well, so one sentence
covers both routes and states the other half of the rule: a budget above
16384 is never lowered.
Completes the previous commit, which only touched the English card:

  * the Spanish card (es/models.mdx) said the same thing about
    max_tokens only, so a reader of either locale now sees the same
    rule, including "a budget above 16384 is never lowered";
  * openapiSpec.test.ts and docsReasoning.test.ts assert the card text
    verbatim -- by design -- so they had to move with it. They now also
    pin the Responses-API half and the never-lowered half in both
    locales, which is what would have caught a half-updated card.

Full suite: 2496 tests / 87 files green. npm run build green.
@sre-helmcode
sre-helmcode merged commit 9e8ff61 into main Oct 19, 2026
1 check passed
@barckcode
barckcode deleted the docs/output-budget-limits branch October 20, 2026 12:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants