Change vLLM app config for Qwwen 3.8 27B - #3
Conversation
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: bfc25cae7e
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| enabled: true | ||
| path: /health | ||
| initialDelaySeconds: 60 | ||
| initialDelaySeconds: 300 |
There was a problem hiding this comment.
When the 27B model is not already cached or initialization takes more than roughly 320 seconds, the liveness probe configured in helm/vllm/templates/deployment.yaml begins after this delay and restarts the container after three 10-second failures. The increased readiness failure threshold cannot prevent that restart, so a cold deployment can repeatedly interrupt the model download/load; use a startup probe or give liveness a cold-start window long enough for this model.
Useful? React with 👍 / 👎.
1 participant
Problem
Qwen 3.8 27B recently released and it's a beast
Solution
I want it in my home setup