Skip to content

cache: Wait for the proxy before the first request - #1600

Merged
phlax merged 1 commit into
envoyproxy:mainfrom
phlax:cache-wait
Nov 1, 2026
Merged

phlax merged 1 commit into
envoyproxy:mainfrom
phlax:cache-wait

Conversation

@phlax

@phlax phlax commented Nov 1, 2026

Copy link
Copy Markdown
Member

The first request fires as soon as compose returns, which is when the backends are healthy, not when the proxy is listening. In https://github.com/envoyproxy/envoy/actions/runs/41313931262/job/124878023013 front-envoy was one second old and still loading clusters when curl connected, so it got a connection reset (exit 56).

Probe the never-cached private response with wait_for until the proxy answers, so the first cacheable request is still served by the origin and the later private checks are unaffected. Same pattern as the opentelemetry example.

@phlax
phlax force-pushed the cache-wait branch 2 times, most recently from bec83a5 to ef8288c Compare November 1, 2026 15:43
The first request fired as soon as compose returned; front-envoy was one
second old and still loading clusters, so curl got a connection reset
(exit 56). Probe the never-cached private response until the proxy
answers, so the first cacheable request is still served by the origin.

Signed-off-by: Ryan Northey <ryan@synca.io>
@phlax
phlax merged commit 3945315 into envoyproxy:main Nov 1, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant