Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
93 commits
Select commit Hold shift + click to select a range
a890511
chore: pin the core dependency to a tag instead of tracking main (#25)
fylorn Sep 23, 2026
a90e9f3
feat!: forward what can be forwarded, convert only what must be (#26)
fylorn Sep 23, 2026
ca7647c
refactor: take the circuit-breaker registry and metric labels back fr…
fylorn Sep 23, 2026
a6678cf
refactor: redact PII with core's guard engine, and restore tool argum…
fylorn Sep 23, 2026
437a671
feat: inspect the tool calls an upstream returns (#29)
fylorn Sep 23, 2026
038796b
build: keep only line tables in dev and test builds (#30)
fylorn Sep 24, 2026
05f52e8
feat: one circuit-breaker state machine, and hidden characters in req…
fylorn Sep 24, 2026
8a76395
fix: make the integration suite pass again (#32)
fylorn Sep 24, 2026
6482690
test: fix the two flaky integration tests (#33)
fylorn Sep 24, 2026
9f46116
fix: bill a Chat stream whose caller did not ask for usage (#34)
fylorn Sep 24, 2026
3c35ab8
fix: a request the upstream refuses no longer fails over or trips bre…
fylorn Sep 24, 2026
234fcce
Merge main (v1.1.0) into dev
fylorn Sep 24, 2026
82f8061
docs: cut releases from a release branch, and keep the tag's headings…
fylorn Sep 24, 2026
bd57b5d
ci: run checks on pull requests into dev, including the integration s…
fylorn Sep 24, 2026
c1b2085
fix: bill cached input at cache prices, estimate missing usage, strip…
fylorn Sep 24, 2026
ad5b75b
refactor: take back what only this side used from core (#41)
fylorn Sep 24, 2026
3a617f3
feat(gateway): take official hosts, output fallback and error shapes …
fylorn Sep 24, 2026
ed1c8b5
feat(gateway): accept Gemini clients, and the Responses API over a We…
fylorn Sep 24, 2026
28d4387
test: count the probes that miss before the streaming cache hit (#44)
fylorn Sep 24, 2026
d3f36fc
refactor(server): move the catalog's SQL into repositories (#45)
fylorn Sep 24, 2026
83e9bcc
refactor(server): move the dashboard, limits and log-forwarding handl…
fylorn Sep 24, 2026
9b5b326
refactor(server): move the MCP handlers' SQL into repositories (#50)
fylorn Sep 24, 2026
86beb82
refactor(gateway): run the request guards on core's tw-guard engines …
fylorn Sep 24, 2026
1c80b83
refactor(server): move the identity handlers' SQL into repositories (…
fylorn Sep 24, 2026
c25b44f
fix(mcp): revoking a default connection no longer fails with a 500 (#51)
fylorn Sep 24, 2026
dbce845
test: leave the cancelled stream after it has started, not on a timer…
fylorn Sep 24, 2026
c3d2d57
refactor(server): move the access handlers' SQL into repositories (#48)
fylorn Sep 24, 2026
d92c2d1
fix(settings): read security.totp_required as a boolean, and seed aut…
fylorn Sep 24, 2026
7e95183
feat(gateway): record a client that leaves before its response exists…
fylorn Sep 24, 2026
367df3c
feat(auth): enforce the TOTP requirement (#55)
fylorn Sep 24, 2026
443de8d
feat(gateway): keep the last response on a Responses WebSocket (#56)
fylorn Sep 24, 2026
6890c72
Merge main (v2.0.0) into dev
fylorn Sep 24, 2026
d4f6d5a
docs(release): CI runs the integration suite on the release PR (#58)
fylorn Sep 24, 2026
ef3de87
docs(contributing): point vulnerability reports at the organization's…
fylorn Sep 25, 2026
c4f8b1c
docs(readme): current description of ThinkWatch Lite and ThinkWatch C…
fylorn Sep 25, 2026
f259962
feat(providers): authenticate Bedrock with an API key (#61)
fylorn Sep 28, 2026
78f9ab5
test: hold the early-cancel client once its key is known, not on a ti…
fylorn Sep 28, 2026
1b752f2
feat(providers): list Bedrock's models, and let the route editor take…
fylorn Sep 28, 2026
1f08421
fix(bedrock): refuse keys that will not decrypt, and keep instance-ro…
fylorn Sep 28, 2026
e480bfd
refactor(bedrock): use core's shared tw-bedrock, and core v0.55.0 (#65)
fylorn Sep 29, 2026
e1e7999
docs(readme): rewrite both READMEs to be short and accurate (#66)
fylorn Sep 30, 2026
af9eb81
Merge main (v2.1.0) into dev
fylorn Sep 30, 2026
ed6dd39
docs(readme): 37 MCP templates, what the setup wizard does, body reda…
fylorn Sep 30, 2026
9afcc08
fix(rbac): make the seeded team_manager work at team scope (#69)
fylorn Sep 30, 2026
fa3a5b9
fix(rbac): require gateway use, and count only grants that give it (#70)
fylorn Sep 30, 2026
a1eed6f
Merge main (v2.2.0) into dev
fylorn Sep 30, 2026
da88b09
Merge main (sponsor line) into dev
fylorn Oct 2, 2026
1a399e7
Allow clippy::double_must_use on the async_trait BlobStore (#73)
fylorn Oct 2, 2026
8d8d96f
Unify the request guards with thinkwatch-core's rule model (#72)
fylorn Oct 3, 2026
2baa123
Fix what the pre-release review of the guard unification found (#75)
fylorn Oct 3, 2026
33c22dc
Merge main (v3.0.0) into dev
fylorn Oct 3, 2026
dcc8616
Merge main (README: ThinkWatch Lite for individual developers) into dev
fylorn Oct 4, 2026
6b73344
Merge main (v3.1.0) into dev
fylorn Oct 5, 2026
03c393c
Usage limits: token limits refuse, key limits count on the key, Retry…
fylorn Oct 5, 2026
4075855
fix(redis): connect over TLS for rediss:// URLs (#82)
fylorn Oct 5, 2026
33234ee
Concurrent startup, body retention on restart, and Helm network polic…
fylorn Oct 5, 2026
b7a34e1
Merge main (v3.2.0) into dev
fylorn Oct 5, 2026
2ce6471
chore(deps): update rust crate rand to v0.10.1 [security] (#77)
renovate[bot] Oct 6, 2026
0682864
chore(deps): update rust crate xxhash-rust to v0.8.16 [security] (#78)
renovate[bot] Oct 6, 2026
1fbe7bd
chore(deps): take the Renovate dashboard upgrades (#85)
fylorn Oct 6, 2026
2e23fd9
chore(deps): pnpm 12, and ClickHouse row validation on (#86)
fylorn Oct 6, 2026
977cab0
ci: save Rust caches only on pushes, and let releases read CI's image…
fylorn Oct 8, 2026
a19ed65
Merge main (v3.2.1) into dev
fylorn Oct 8, 2026
ea2a81f
Merge main (v3.3.0) into dev
fylorn Oct 9, 2026
e8ae1f1
Stream endings and in-stream errors logged like answers; core v0.68.0…
fylorn Oct 10, 2026
0e070a9
Merge main (v3.3.1) into dev
fylorn Oct 10, 2026
633ad90
Merge main (v3.4.0) into dev
fylorn Oct 10, 2026
235e38b
fix(limits): enforce route caps and close the places limits leaked (#94)
fylorn Oct 10, 2026
31cbfc8
feat: GET /v1/usage answers for the key or its owner; API key limits …
fylorn Oct 10, 2026
8151cee
Merge main (v3.5.0) into dev
fylorn Oct 10, 2026
721b5ee
Merge main (README zh) into dev
fylorn Oct 10, 2026
4f87839
feat(console): Add to ThinkWatch Lite; gateway address for every user…
fylorn Oct 11, 2026
042e605
Merge main (v3.6.0) into dev
fylorn Oct 11, 2026
ebdb9dc
chore: add a contributor license agreement signed by PR comment (#102)
fylorn Oct 11, 2026
133d610
ci: name the CLA job cla (#103)
fylorn Oct 12, 2026
eef9ff4
Merge main (3.7.0) back into dev
fylorn Oct 12, 2026
30c5f5b
Merge main (3.7.1) back into dev
fylorn Oct 12, 2026
12f4f82
Merge main (3.8.0) back into dev
fylorn Oct 13, 2026
7ef4ff0
Merge main (3.8.1) back into dev
fylorn Oct 13, 2026
72888a4
Bump rustls to 0.23.46 (RUSTSEC-2026-0346 to -0349) (#108)
fylorn Oct 15, 2026
98b6790
Merge main (3.8.2) back into dev
fylorn Oct 16, 2026
d86570c
Tool inspection: decide on settled input, record whole calls (core v0…
fylorn Oct 19, 2026
a9c5150
chore(deps): update node.js to v24.22.0 (#111)
renovate[bot] Oct 19, 2026
57369f6
chore(deps): update pnpm to v12.14.0 (#99)
renovate[bot] Oct 19, 2026
9549fd6
chore(deps): update ghcr.io/zitadel/zitadel docker tag to v4.19.5 (#110)
renovate[bot] Oct 19, 2026
57c05d9
Merge main (3.8.3) back into dev
fylorn Oct 20, 2026
ff8ccf4
feat(web): carry a key's request limits in the Add to ThinkWatch Lite…
fylorn Oct 20, 2026
17b7e9c
Fix the rotation comment: key limits follow the lineage (#116)
fylorn Oct 20, 2026
caa6751
fix(auth): answer database failures in auth middleware with a 503, no…
fylorn Oct 20, 2026
fd13601
Run Argon2 on the blocking pool in request handlers (#118)
fylorn Oct 20, 2026
65aedcd
Merge main (3.9.0) back into dev
fylorn Oct 20, 2026
f9fe732
Route a conversation's encrypted history back to the provider that ho…
fylorn Oct 22, 2026
ec9be28
chore(release): tag 3.9.1
fylorn Oct 23, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 44 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,50 @@ target.

## [Unreleased]

## [3.9.1] — 2026-10-23

A conversation whose history a provider encrypted, such as a Codex
conversation over OpenAI's Responses API, now stays with that provider
instead of failing on every turn once it moves, and a provider that
cannot read such history says why. The thinkwatch-core crates move from
v0.77.0 to v0.81.0.

No setting, schema or API route changes.

### Fixed

- **A conversation whose history a provider encrypted goes back to that
provider.** OpenAI's Responses API with `store: false` (Codex always
sends it) hands the client encrypted state that comes back every turn:
reasoning, remote compactions, Codex's messages between agents,
encrypted tool output. Only the account that encrypted it can read it,
so a conversation that moved to another provider — after five idle
minutes, a tripped breaker or a failover — was refused on every turn
from then on with `invalid_encrypted_content`. The gateway now
remembers, for 30 days and whatever the affinity settings say, the
provider that last answered each conversation (the authenticated user
and the request's `x-session-id`, or else the session header the client
sends by itself, such as Codex's `session_id`; over HTTP and over the
WebSocket). The log row's `session_id` still comes from `x-session-id`
only. A
Responses request carrying encrypted content that cannot be left out
goes only to that provider: no strategy pick, no failover, and its open
breaker does not stop it. When that provider has no route for the model
any more, the request is refused up front with 409, naming the provider
and saying to start a new conversation. A request carrying only
encrypted reasoning goes to that provider first and still fails over.
Requests that name no conversation are routed as before. The request's log
row records `"pinned_by": "encrypted_history"` when the provider was
picked this way.
- **A provider that cannot read a conversation's encrypted history says
so.** Its refusal, as a 4xx answer or as the error event of a stream
that opened with 200, now reaches the caller and the log as
`SealedHistoryRefused`: the provider cannot read this conversation's
encrypted history because another provider encrypted it; route the
conversation back to that provider or start a new conversation. The
upstream's own words follow. It no longer counts against the route's
breaker.

## [3.9.0] — 2026-10-20

The Add to ThinkWatch Lite link from a rotated key now carries the key's
Expand Down
30 changes: 15 additions & 15 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 5 additions & 5 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ members = [
]

[workspace.package]
version = "3.9.0"
version = "3.9.1"
edition = "2024"
# The MSRV: the newest `rust-version` among the locked dependencies
# (sqlx 0.9 and the aws-smithy crates under aws-sigv4). Without it,
Expand Down Expand Up @@ -70,10 +70,10 @@ opt-level = 3
# never re-exported through a local shim. And the reverse: something only
# this side uses (the at-rest crypto, IMDSv2 credentials, the gateway error)
# lives here, not in core.
tw-bedrock = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.77.0" }
tw-breaker = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.77.0" }
tw-dialect = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.77.0" }
tw-guard = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.77.0" }
tw-bedrock = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.81.0" }
tw-breaker = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.81.0" }
tw-dialect = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.81.0" }
tw-guard = { git = "https://github.com/ThinkWatchProject/ThinkWatch-Core.git", tag = "v0.81.0" }

# Web framework
axum = { version = "0.8", features = ["macros", "ws"] }
Expand Down
30 changes: 30 additions & 0 deletions crates/gateway/src/error.rs
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,32 @@ pub enum GatewayError {
/// pass it on. Maps to 403.
#[error("Blocked by policy: {0}")]
PolicyBlocked(String),
/// The upstream refused the conversation's encrypted history (OpenAI
/// Responses `encrypted_content`, see `tw_dialect::sealed`): another
/// provider's account encrypted it, and only that one can read it.
/// `status` is the upstream's (as an answer, or what its error in a
/// stream would have been), `said` its own words, truncated. Not the
/// upstream failing: no failover, nothing against its breaker.
#[error(
"Provider `{provider}` cannot read this conversation's encrypted history: another \
provider encrypted it, and only that one can read it. Route the conversation back to \
that provider, or start a new conversation. The provider said: {said}"
)]
SealedHistoryRefused {
status: u16,
provider: String,
said: String,
},
/// The conversation's history is encrypted by `provider`, which has no
/// route for the model any more, and no other provider can read it.
/// Refused before anything is sent. Maps to 409: the request is well
/// formed, but the conversation cannot go on here.
#[error(
"This conversation's history is encrypted by provider `{provider}`, which can no \
longer serve model `{model}`, and no other provider can read it. Start a new \
conversation."
)]
SealedHistoryUnavailable { provider: String, model: String },
}

impl GatewayError {
Expand All @@ -90,6 +116,8 @@ impl GatewayError {
GatewayError::UpstreamRateLimited { .. } | GatewayError::LocalRateLimited { .. } => 429,
GatewayError::UpstreamAuthError { .. } => 401,
GatewayError::PolicyBlocked(_) => 403,
GatewayError::SealedHistoryRefused { status, .. } => i64::from(*status),
GatewayError::SealedHistoryUnavailable { .. } => 409,
}
}

Expand All @@ -108,6 +136,8 @@ impl GatewayError {
GatewayError::LocalRateLimited { .. } => "LocalRateLimited",
GatewayError::UpstreamAuthError { .. } => "UpstreamAuthError",
GatewayError::PolicyBlocked(_) => "PolicyBlocked",
GatewayError::SealedHistoryRefused { .. } => "SealedHistoryRefused",
GatewayError::SealedHistoryUnavailable { .. } => "SealedHistoryUnavailable",
}
}

Expand Down
Loading
Loading