feat: add circuit breaker package for fault tolerance - #3982
Open
Zakariasisu5 wants to merge 1 commit into
Open
Conversation
- Implement three-state circuit breaker (Closed/Open/Half-Open) for resilience - Add configurable thresholds for failure detection and recovery testing - Include timeout-based recovery with exponential backoff integration - Thread-safe concurrent access with RWMutex - Comprehensive test coverage (14 test cases) - Practical examples for LLM APIs, MCP servers, and HTTP tools - Full documentation with configuration guidance and best practices The circuit breaker prevents cascading failures by fast-failing when external services (LLM providers, MCP servers, HTTP tools) are known to be down. This is essential for docker-agent's reliability, reducing unnecessary load during service degradation and improving user experience. Key features: - Automatic recovery testing in half-open state - Capacity limits for concurrent test requests - Statistics tracking for monitoring - Context cancellation support
aheritier
added
area/docs
Collaborator
|
👋 Some commits in this PR are not signed and verified by GitHub. Please sign your commits with a GPG or SSH key registered in your GitHub account, then force-push. Commits that are not verified: See GitHub's guide on signing commits for setup instructions. I've added |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The circuit breaker prevents cascading failures by fast-failing when external services (LLM providers, MCP servers, HTTP tools) are known to be down. This is essential for docker-agent's reliability, reducing unnecessary load during service degradation and improving user experience.
Key features: