Skip to content

Avoid primary manager when assigning Fate and Compaction work - #6631

Draft
keith-turner wants to merge 17 commits into
apache:mainfrom
keith-turner:avoid-primary
Draft

keith-turner wants to merge 17 commits into
apache:mainfrom
keith-turner:avoid-primary

Conversation

@keith-turner

Copy link
Copy Markdown
Contributor

When there is more than one manager process this change will avoid
assigning Fate and compaction coordinatoin to the primary manager.
The primary manager does a lot of work with balancing and the tablet
group watcher, with this change it can focus on that while other
manager processes do Fate and compaction coordination.

Opening this as a draft because it builds on unmerged changes from #6324. This is a small change if #6324 is merged.

keith-turner and others added 17 commits April 17, 2026 20:16
For an overview of how this works see the javadoc in
CompactionCoordinator.
…n/CoordinatorLocationsFactory.java

Co-authored-by: Dave Marion <dlmarion@apache.org>
revert changes in 9af4fdd as it broke clearing uneeded compaction jobs.

CompactionPriorityQueueMetricsIT.testCompactionQueueClearedWhenNotNeeded() was failing
When there is more than one manager process this change will avoid
assigning Fate and compaction coordinatoin to the primary manager.
The primary manager does a lot of work with balancing and the tablet
group watcher, with this change it can focus on that while other
manager processes do Fate and compaction coordination.
@keith-turner keith-turner added this to the 4.0.0 milestone Nov 4, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant