Repository navigation

migration: complete target promotion catalog state - #1090

Merged

bootjp merged 338 commits into

mainfrom

design/hotspot-split-m2-promotion-complete

Oct 24, 2026

Merged

migration: complete target promotion catalog state#1090
bootjp merged 338 commits into
mainfrom
design/hotspot-split-m2-promotion-complete

This pull request is big! We're only showing the most recent 250 commits

Commits on Jul 14, 2026
- store: ignore stale promotion cursors
  bootjp
  committed
  40c2f52
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-cross-group' into design/hotspot-split-m2-promote
  bootjp
  committed
  327cb1c
- Guard split fence retry paths
  bootjp
  committed
  f1aeeeb
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-fence-drain' into design/hotspot-split-m2-cross-group
  bootjp
  committed
  1db42a8
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-cross-group' into design/hotspot-split-m2-promote
  bootjp
  committed
  4b1d950
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-promote' into design/hotspot-split-m2-promotion-complete
  bootjp
  committed
  961a177
- Fix promotion completion merge compatibility
  bootjp
  committed
  9d9e051
- Merge promotion completion into target readiness
  bootjp
  committed
  8e74d6e
- Fail closed read-only shard readiness checks
  bootjp
  committed
  2d57ae9
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-target-readiness' into design/hotspot-split-m2-job-rpc
  bootjp
  committed
  9994ec7
- Guard snapshot spooling disk headroom
  bootjp
  committed
  8d11161
- Raise snapshot spool headroom reserve
  bootjp
  committed
  0215c38
- Fix raft startup and snapshot spool guards
  bootjp
  committed
  774779b
- Handle route fences in adapter retries
  bootjp
  committed
  46722f6
- Stabilize raft snapshot dispatch and maintenance gates
  bootjp
  committed
  70cf6f8
- Honor partition resolver in fence prechecks
  bootjp
  committed
  a241809
- Make raft startup and fence checks deterministic
  bootjp
  committed
  ee363c4
- Gate public startup after raft replay
  bootjp
  committed
  54ad999
- Stabilize raft dispatch and S3 cleanup fences
  bootjp
  committed
  e20475f
- Stabilize raft startup and write fences
  bootjp
  committed
  c3a8ecf
- Stabilize route-fence cleanup retries
  bootjp
  committed
  61feed4
- Keep heartbeat responses coalescing under read-index load
  bootjp
  committed
  f373cd3
- Stabilize raft snapshot recovery checkpoints
  bootjp
  committed
  8f821fe
- Enforce current route fences at apply time
  bootjp
  committed
  3e988ef
- Prioritize received raft snapshots
  bootjp
  committed
  04e8053
- Stabilize snapshot catch-up and fence checks
  bootjp
  committed
  d818602
Commits on Jul 15, 2026
- Stabilize startup reads and snapshot recovery
  bootjp
  committed
  db9843a
- Reset stale raft peer connections
  bootjp
  committed
  a6d7d76
- Stabilize snapshot catch-up and fence routing
  bootjp
  committed
  c8f865e
- Keep SQS receive route fences visible
  bootjp
  committed
  b553090
- Stabilize redis proxy and raft recovery
  bootjp
  committed
  d2b22ac
- Add migration fence drain guards (#1087)
  bootjp
  authored
  549a786
Commits on Jul 16, 2026
- Fix sparse Lua list pop fallback
  bootjp
  committed
  fefd809
- Align ElasticKV proxy socket timeouts
  bootjp
  committed
  e1b32b5
- Replay blocking zset pops deterministically
  bootjp
  committed
  cf47858
- Cap ElasticKV secondary script concurrency
  bootjp
  committed
  f697640
- Refresh ElasticKV leader after not-leader replies
  bootjp
  committed
  7e40979
- Avoid full stream rewrites for Lua XADD
  bootjp
  committed
  3df9239
- Handle Redis proxy replay edge cases
  bootjp
  committed
  d19b2a4
- distribution: add split job management RPCs (#1092)
  bootjp
  authored
  a850ee1
- Honor Lua XADD cached state
  bootjp
  committed
  b8bb6ad
- Cover Lua XADD maxlen zero append
  bootjp
  committed
  adf5cdb
- Merge remote-tracking branch 'origin/main' into work/pr1088-conflict
  bootjp
  committed
  01b02ad
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-store-export' into work/pr1088-conflict
  bootjp
  committed
  f02d1c0
- Enforce migration write floors during apply
  bootjp
  committed
  7407423
- Fence migration exports with applied reads
  bootjp
  committed
  2c920bc
- Delete staged rows for migrated prefixes
  bootjp
  committed
  bdf05a6
- Preserve staged scan visibility
  bootjp
  committed
  c9d7ddc
- migration: harden target readiness guards
  bootjp
  committed
  bbc1876
- migration: add target readiness guard (#1091)
  bootjp
  authored
  a02b6c1
- migration: fix staged s3 bucket routing
  bootjp
  committed
  acc9305
- migration: persist promotion timestamp floor
  bootjp
  committed
  f902f34
- migration: keep invalid promote cursors non-halting
  bootjp
  committed
  e3e37ce
- migration: promote staged versions (#1089)
  bootjp
  authored
  f6457de
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-cross-group' into design/hotspot-split-m2-promotion-complete
  bootjp
  committed
  a3b7276
- Merge remote-tracking branch 'origin/design/hotspot-split-m2-promotion-complete' into design/hotspot-split-m2-promotion-complete
  bootjp
  committed
  f51ca32
- migration: fix promotion complete review findings
  bootjp
  committed
  5dec8cb
- migration: make promotion completion retry idempotent
  bootjp
  committed
  00da46c
- migration: disambiguate legacy list exports
  bootjp
  committed
  19961d3
- store: preserve empty-key migration exports
  bootjp
  committed
  bd55701
- migration: tighten routed cleanup safety
  bootjp
  committed
  8a687ca
- migration: preserve ambiguous list tombstones
  bootjp
  committed
  fd179f9
- adapter: preserve scan route groups for list cleanup
  bootjp
  committed
  c275022
- adapter: backtrack list compactor accepted tails
  bootjp
  committed
  5cf01fd
- kv: cover pinned primary transaction commits
  bootjp
  committed
  7fe4112
- ci: generate redis proxy image metadata locally
  bootjp
  committed
  83cd5bf
- proxy: allow redis-only without secondary seeds
  bootjp
  committed
  0e76181
- ci: avoid failing lint on reviewdog API errors
  bootjp
  committed
  ab82447
- ci: keep lint required when reviewdog is unavailable
  bootjp
  committed
  5189172
- migration: persist applied index on imports
  bootjp
  committed
  319b442
- kv: preserve broad scans with staged routes
  bootjp
  committed
  2c29191
Commits on Jul 17, 2026
- migration: gate import proposals during rollouts
  bootjp
  committed
  aaa96da
- kv: reject raw prefix writes below floors
  bootjp
  committed
  d34d103
- migration: route partitioned exports by group
  bootjp
  committed
  78a0400
- kv: scan staged routes for physical limits
  bootjp
  committed
  4851c6f
- Merge cross-group migration fixes
  bootjp
  committed
  052c64c
- migration: keep split capability gated
  bootjp
  committed
  2b7c3af
- adapter: pin sparse list fallback route bounds
  bootjp
  committed
  eea5dec
- redis: fix Lua XADD and blocking move replay
  bootjp
  committed
  1b70e39
- proxy: replay blocking multipop writes
  bootjp
  committed
  8df8acf
- proxy: avoid retrying user not-leader errors
  bootjp
  committed
  9a0286d
- proxy: classify not-leader redis replies safely
  bootjp
  committed
  7b12482
- migration: reject armed readiness without write floor
  bootjp
  committed
  5d78d7a
- docs: mark hotspot m2 migration partial
  bootjp
  committed
  178fda6
- migration: run split target promotion
  bootjp
  committed
  c065ad9
- migration: harden split runner promotion
  bootjp
  committed
  252bd64
- distribution: keep split migration gates closed
  bootjp
  committed
  938a284
- Fix sparse Lua list pop fallback (#1094)
  bootjp
  authored
  3e1c85f
- distribution: finish split promotion cleanup
  bootjp
  committed
  1c7ea5b
Commits on Jul 18, 2026
Commits on Jul 19, 2026
- Complete hotspot split M2 migration lifecycle (#1096)
  bootjp
  authored
  28449f9
- docs: mark hotspot split M2 implemented
  bootjp
  committed
  db933c0
- docs: link implemented hotspot split design
  bootjp
  committed
  f270d8d
- migration: complete target promotion catalog state
  bootjp
  committed
  f2aad59
- migration: harden split cutover compatibility
  bootjp
  committed
  54cc7b9
- migration: satisfy current lint gates
  bootjp
  committed
  48a4da8
Commits on Jul 20, 2026
- Resolving merge conflicts with base branch
  Copilot
  authored
  19c2657
- docs: resolve merge conflicts with base branch
  Copilot
  authored
  6b54f22
Commits on Jul 22, 2026
- Keep hotspot M2 status PR docs-only
  bootjp
  committed
  20cebac
Commits on Jul 23, 2026
- Mark hotspot split M2 design implemented (#1124)
  bootjp
  authored
  4ed488c
- proto: reserve raft admin status fields
  bootjp
  committed
  ebf6878
- migration: harden promotion readiness fences
  bootjp
  committed
  f79bc00
- adapter: fail closed on split capability regression
  bootjp
  committed
  4163665
- migration: harden split cleanup guards
  bootjp
  committed
  d57699d
Commits on Jul 24, 2026
- migration: preserve cleanup metadata barriers
  bootjp
  committed
  dcb7744
Commits on Aug 21, 2026
- migration: scope source read drain to pre-cutover reads
  bootjp
  committed
  75d86c0
Commits on Aug 28, 2026
- migration: prove readiness before key-only scans
  bootjp
  committed
  37b1d8f
Commits on Aug 29, 2026
- migration: recover when the importer is ahead of copy progress
  bootjp
  committed
  b5eea8c
- migration: record the source group on the split job
  bootjp
  committed
  b216767
- migration: leave resolver-owned SQS rows out of route cleanup
  bootjp
  committed
  f81057b
Commits on Sep 4, 2026
- Merge base branch design/hotspot-split-m2-cross-group
  bootjp
  committed
  67ee758
- kv: clean up after the base merge
  bootjp
  committed
  0ae4697
- adapter: settle the S3 bucket-auxiliary export owner rule after the merge
  bootjp
  committed
  5876404
- migration: unify S3 auxiliary ownership and halt apply on unprovable state
  bootjp
  committed
  557c542
Commits on Sep 5, 2026
- kv: halt only on unprovable local readiness, and on readiness persist failures
  bootjp
  committed
  b667077
- kv: classify apply halts by process-locality, not by call site
  bootjp
  committed
  6fb87e4
Commits on Sep 12, 2026
- kv: halt batched applies on an unproven readiness verdict
  bootjp
  committed
  04f51f5
- adapter: give the promotion fixture the source group a planner would set
  bootjp
  committed
  eb48ed2
Commits on Oct 11, 2026
- Merge main into design/hotspot-split-m2-promotion-complete
  bootjp
  committed
  35fc04d
- Merge commit '16b56f2d7a8c184e5ffba8faeb9a7df477707ff9' into HEAD
  bootjp
  committed
  35b6fa1
Commits on Oct 22, 2026
- migration: close split safety gaps
  bootjp
  committed
  618d4ab
- Merge main into hotspot split promotion
  bootjp
  committed
  66cca4d
- Fix migration apply lock ordering
  bootjp
  committed
  6b4af2b
- Strengthen migration lock order test
  bootjp
  committed
  ecdcb9b
- Check Pebble test store assertion
  bootjp
  committed
  c380480
- Authenticate migration control and bound voter probes
  bootjp
  committed
  3dfa8f7
- Protect internal migration mutations and configure test authentication
  bootjp
  committed
  86928cd
- Authenticate migration exports and encrypt control credentials
  bootjp
  committed
  06d5109
- Isolate migration authority and harden split runner recovery
  bootjp
  committed
  5d9b61b
- Recover compacted legacy jobs and separate RPC attempt budgets
  bootjp
  committed
  84e0b50
- Bound remaining migration control RPC attempts
  bootjp
  committed
  06cd398
- Authenticate migration probes and persist target clock floors
  bootjp
  committed
  2405abb
- Authenticate peer forwards and validate cleanup authority
  bootjp
  committed
  92d9ed9
- Stage peer authentication before enabling migration enforcement
  bootjp
  committed
  8228a97
- Validate migration transport and retire routed snapshot seals
  bootjp
  committed
  6161878
- Persist split phase failures and restore gated TLS queries
  bootjp
  committed
  a49b9c4
- Merge main and preserve migration guards in shared paths
  bootjp
  committed
  07d1343
- Preserve migration retries during leader churn and Raft replay
  bootjp
  committed
  629340a
- Merge main integration regression fixes
  bootjp
  committed
  d15bf0f
- Protect staged migration jobs and complete operator recovery
  bootjp
  committed
  6568983
- Merge main and secure full-range migration control deletes
  bootjp
  committed
  6b4aca9
- Restore source writes before abandoned target cleanup
  bootjp
  committed
  ed52cb5
- Reject catalog migrations across resolver-owned SQS routes
  bootjp
  committed
  90a87ec
- Merge prepare evidence main with migration safeguards
  bootjp
  committed
  2c58c1e
- Merge shutdown main and verify migration evidence integration
  bootjp
  committed
  57f4e95
- store: permanently reject retired migration mutations
  bootjp
  committed
  9fc6a9d
- WIP: checkpoint native migration ownership evidence
  bootjp
  committed
  1f3d622
- raft: validate external snapshot restore origins before startup
  bootjp
  committed
  6bd837f
- Validate snapshot restore origin before publishing FSM headers
  bootjp
  committed
  86111b7
- kv: validate TSO snapshot restore origins and legacy payloads
  bootjp
  committed
  cd8a83c
- store: guard external snapshot restores against migration state
  bootjp
  committed
  b6c5fc1
- Verify external KV and TSO restore lineage across store formats
  bootjp
  committed
  db85271
- Make migration apply admission deterministic
  bootjp
  committed
  9ac2c4b
- kv: test encrypted external restore lineage
  bootjp
  committed
  172bede
- Add migration transfer preflight and compensation
  bootjp
  committed
  6fe33ba
- WIP: checkpoint migration ownership runtime attestations
  bootjp
  committed
  d5387e7
- test: exercise complete migration ownership snapshot evidence
  bootjp
  committed
  2004149
- raft: retain external restore origin across restarts
  bootjp
  committed
  ada79fe
- raft: resync completed external restore bindings on retry
  bootjp
  committed
  2a56b04
- Refresh durable migration ownership through authenticated root attestations
  bootjp
  committed
  8d548a8
- Test ownership refresh refusal after sequential range splits
  bootjp
  committed
  dd6b9cc
- WIP: bind source ownership and public admission
  bootjp
  committed
  f5634d1
Commits on Oct 23, 2026
- Wire migration admission while keeping protocol activation closed
  bootjp
  committed
  4a931d8
- Build KV migration fixtures with complete ownership evidence
  bootjp
  committed
  37ef634
- adapter: validate cleanup before privileged migration dispatch
  bootjp
  committed
  28d256d
- Bound source ownership probe attempts
  bootjp
  committed
  f0a911e
- Rebind destination configuration after external restore
  bootjp
  committed
  ec1e1b7
- Validate prefix deletes against complete route proof coverage
  bootjp
  committed
  75894e2
- Admit every prefix broadcast participant before committing
  bootjp
  committed
  2d1a36a
- store: distinguish logical user keys during external restore
  bootjp
  committed
  a6492c6
- Reject direct mutations of migration store metadata
  bootjp
  committed
  4ec7fab
- Merge current main into migration review integration
  bootjp
  committed
  06400ad
- Define ownership partition protocol interfaces
  bootjp
  committed
  af71541
- raftadmin: check learner protocol before promotion
  bootjp
  committed
  f4fb72e
- test: isolate pending promotion and legacy hook behavior
  bootjp
  committed
  9241bbf
- Separate installed partition support from active migration readiness
  bootjp
  committed
  06e37c4
- kv: add explicit moving-range transfer size guard
  bootjp
  committed
  9be6a3c
- Persist immutable root ownership partition manifests
  bootjp
  committed
  cacd6f3
- Merge current main into migration implementation
  bootjp
  committed
  9b12a21
- Add migration protocol membership admission checks
  bootjp
  committed
  bb6748a
- Restrict forwarded admin payloads and protect partition ledger writes
  bootjp
  committed
  4ece9ca
- Persist split partition lineage and working source route atomically
  bootjp
  committed
  36d1719
- store: preserve atomic ownership partitions and cached admission
  bootjp
  committed
  7045c53
- main: snapshot all migration apply members at an applied epoch
  bootjp
  committed
  13efbc5
- adapter: require all-member transfer guard admission witnesses
  bootjp
  committed
  58ce1f4
- Test migrated ownership across later range splits
  bootjp
  committed
  12fdb21
- Test partition ledger conflicts before route publication
  bootjp
  committed
  f1c01b5
- kv: gate namespace admission on durable member agreement
  bootjp
  committed
  964abaf
- store: isolate attestation inputs and protect replay watermark
  bootjp
  committed
  7095904
- store: retain unknown legacy barriers after partition adoption
  bootjp
  committed
  f9b80a6
- kv: admit active ownership frontiers without all-shard read scans
  bootjp
  committed
  8d27147
- kv: verify installed partition admission protocol paths
  bootjp
  committed
  4b2b6d0
- store: share versioned migration configuration codec
  bootjp
  committed
  62dad94
- store: accept activated namespace epochs in partition controls
  bootjp
  committed
  b697b26
- Connect working source reconciliation to installed partition runtime
  bootjp
  committed
  5714ca8
- adapter: gate transfer phases on durable guard admission
  bootjp
  committed
  4336227
- migration: negotiate namespace activation and prejoin permissions
  bootjp
  committed
  eef934d
- Add replicated ownership partition control and root refresh
  bootjp
  committed
  c141fac
- Negotiate namespace admission before partition reconciliation
  bootjp
  committed
  32a68bb
- jepsen: cover bounded same-owner and cross-group resplits
  bootjp
  committed
  3e738dd
- Exclude adopted job history from active ownership admission
  bootjp
  committed
  05d5b64
- Avoid duplicate adopted jobs in partition reconciliation
  bootjp
  committed
  0f389bc
- adapter: require namespace admission for migration mutation RPCs
  bootjp
  committed
  dec9bb0
- Verify partition control durability across Pebble reopen
  bootjp
  committed
  2113214
- Refactor migration control validation and dispatch
  bootjp
  committed
  986d79b
- adapter: avoid redundant namespace activation proposals
  bootjp
  committed
  df4018d
- Validate partition geometry and member protocols before side effects
  bootjp
  committed
  8af7588
- kv: simplify admission predicates and remove obsolete proof selectors
  bootjp
  committed
  8dd44ee
- Refactor namespace admission validation for strict lint
  bootjp
  committed
  6786804
- Test migration admission with real Raft quorum and learner restart
  bootjp
  committed
  5de0d2c
- Test fence drain and copy timeouts with real transfer admission
  bootjp
  committed
  7a029ef
- Merge current main and contributor sign-off policy
  bootjp
  committed
  4e1eaeb
- adapter: extract coherent namespace activation phase
  bootjp
  committed
  031fa47
- Reconcile historical nonowner partition geometry safely
  bootjp
  committed
  ad71616
- Validate ownership control budget before publishing split geometry
  bootjp
  committed
  b05bd77
- test: add migration codec properties
  bootjp
  committed
  61a6bb7
- Fence quorum restart snapshots by acknowledged write index
  bootjp
  committed
  b2180e9
- kv: index durable frontier evidence and select disjoint ranges linearly
  bootjp
  committed
  fb45960
- Refuse split geometry when native owner evidence is unavailable
  bootjp
  committed
  812d918
- Extract negative partition geometry eligibility
  bootjp
  committed
  989f4bf
- Test quorum prepared drains and historical transfer preflight
  bootjp
  committed
  16e1e2f
- Gate migration readiness on installed runtime and applied configuration
  bootjp
  committed
  341238b
- Fence native split evidence and bound both endpoint control sizes
  bootjp
  committed
  51bc35f
- test: guard move-back target partition control budget
  bootjp
  committed
  3d9629c
- Require dedicated operator authentication for catalog splits
  bootjp
  committed
  a2996ef
- Test quorum commits across forced leadership handoff
  bootjp
  committed
  e094e7f
- Refresh serving ownership closures after partition catalog changes
  bootjp
  committed
  e775a75
- Acknowledge disjoint owners before completing catalog splits
  bootjp
  committed
  572a209
- Retry serving-owner barriers after working split recovery
  bootjp
  committed
  7328918
- Bound snapshot churn in native migration acceptance
  bootjp
  committed
  9975654
- adapter: bound namespace activation RPC attempts
  bootjp
  committed
  79820b1
- Keep pending transfer acknowledgements retryable
  bootjp
  committed
  5449c01
- Retry supported namespace activation acknowledgements
  bootjp
  committed
  ec37113
- Run full gRPC sequences in a separate CI phase
  bootjp
  committed
  7081873

Commits

Commits on Jul 14, 2026

Commits on Jul 15, 2026

Commits on Jul 16, 2026

Commits on Jul 17, 2026

Commits on Jul 18, 2026

Commits on Jul 19, 2026

Commits on Jul 20, 2026

Commits on Jul 22, 2026

Commits on Jul 23, 2026

Commits on Jul 24, 2026

Commits on Aug 21, 2026

Commits on Aug 28, 2026

Commits on Aug 29, 2026

Commits on Sep 4, 2026

Commits on Sep 5, 2026