Skip to content

feat(observability): expose microbatch lifecycle bounds - #770

Merged
kvlonge merged 1 commit into
mainfrom
feat/microbatch-lifecycle-bounds
Sep 21, 2026
Merged

kvlonge merged 1 commit into
mainfrom
feat/microbatch-lifecycle-bounds

Conversation

@kvlonge

@kvlonge kvlonge commented Sep 21, 2026 •

Copy link
Copy Markdown
Contributor

Why

Resource-level lifecycle facts do not identify which microbatch interval is currently active. Operators need bounded, append-only evidence to distinguish delayed, completed, and failed work, including concurrent and recovery execution.

Changes

  • emit start, completion, and failure facts for each active microbatch interval
  • include active and planned cursor bounds, batch progress, configured and effective sizes, strategy, run type, and recovery classification
  • preserve version 1 lifecycle catalogs while extending version 2 and lifecycle-event sink filtering
  • document the lifecycle contract and cover serial, concurrent, failure, cleanup, and capped out-of-order execution

Verification

  • uv run pytest tests/unit/src/sqlbuild/runtime/observability tests/unit/src/sqlbuild/runtime/event_exporting/test_policy.py tests/unit/src/sqlbuild/runtime/event_exporting/test_sinks.py tests/unit/src/sqlbuild/executor/build/classes/test_build_scheduler_microbatch.py tests/integration/src/sqlbuild/executor/run/microbatch/test_microbatch_execution.py tests/integration/src/sqlbuild/executor/run/microbatch/test_microbatch_observability.py -n auto --dist loadfile
  • make check-ci
  • public repository hygiene scan

@kvlonge
kvlonge merged commit 1470abb into main Sep 21, 2026
24 of 25 checks passed
@kvlonge
kvlonge deleted the feat/microbatch-lifecycle-bounds branch September 21, 2026 12:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant