Skip to content

feat(jobs): 持久化作业队列第一批(#67) - #84

Merged
Antruly merged 1 commit into
masterfrom
feat/job-queue
Nov 22, 2026
Merged

Antruly merged 1 commit into
masterfrom
feat/job-queue

Conversation

@Antruly

@Antruly Antruly commented Nov 22, 2026

Copy link
Copy Markdown
Owner

Part of #67(第一批:内存记录 + 同步 handler;SQLite/MySQL store、异步 handler 留后续)。

内容

新增 uvcpp_job_queue / uvcpp_job_store / uvcpp_memory_job_store:

  • 状态:PENDING / RUNNING / SUCCESS / FAILED / CANCELLED;每次变更写 store 并回调 on_state();
  • 执行:handler 在 uvcpp_work 线程池上同步跑;超时 / 取消是协作式的(置 ctx.cancelled(),队列不杀线程);
  • concurrency_key:同一非空 key 同时只允许一个 RUNNING;max_concurrent 默认 4;
  • 重试:失败后 attempt <= max_retry 回 PENDING,退避 backoff_ms * 2^(attempt-1)(封顶 1 小时);
  • 队列满:max_queue > 0 且 PENDING 达上限时 submit() 拒绝并计 rejected;
  • 重启恢复:start() 从 store 读回;上次 RUNNING → PENDING,error 标 recovered after restart;
  • stats():pending / running / success / failed / cancelled / retried / rejected;
  • store 接口可插拔(本 PR 带线程安全内存实现);析构契约:先 stop() 且 running == 0。

用例

job_queue_func:

  1. 3 个作业执行、stats.success=3、clear_finished 清理;
  2. 5 个同 key 作业:实测同时执行数最大为 1;
  3. 前两次抛异常、第三次成功:attempt=3、retried=2;max_retry=1 的常败任务最终 FAILED 且恰好尝试 2 次;
  4. 取消 PENDING → CANCELLED 且 handler 从未执行;取消 RUNNING → handler 轮询 cancelled() 后退出、状态 CANCELLED;超时 → FAILED 且 error=timeout;
  5. max_queue=1:第三个提交被拒绝、rejected=1;
  6. store 里预置一条 RUNNING 记录:新队列 start() 后变 PENDING + recovered 标记,放行后成功执行。

验证

build-all 170/170、build-h3 / build-default 编过;check_docs / check_doc_lines / check_doc_versions / check_ci_layout 全绿。文档 doc/lowlevel-guide.md §13。

新增 `uvcpp_job_queue`(`src/uvcpp/uvcpp_job_queue.*`):

- 状态 PENDING/RUNNING/SUCCESS/FAILED/CANCELLED,每次变更写 store + on_state;
- handler 在 `uvcpp_work` 线程池上同步执行;超时/取消是协作式(置
  `ctx.cancelled()`,队列不杀线程),长循环须自行轮询;
- `concurrency_key` 非空时同一 key 严格串行;`max_concurrent` 默认 4;
- 失败按 `max_retry` 重试,退避 `backoff_ms * 2^(attempt-1)`,封顶 1 小时;
- `max_queue` 上限时 submit 拒绝并计 `rejected`;
- `start()` 从 store 恢复:上次 RUNNING → PENDING,error 标
  `recovered after restart`;
- store 接口 + 内存实现(可替换;SQLite/MySQL 与异步 handler 留后续);
- stats:pending/running/success/failed/cancelled/retried/rejected。

用例 `job_queue_func`:执行/统计/清理、同 key 最大并发 1、两次失败后成功
(attempt=3、retried=2)、重试耗尽 FAILED、取消 PENDING 与 RUNNING(协作)、
超时标记 timeout、队列满拒绝、RUNNING 记录重启恢复后成功。文档 §13。

本地 build-all 170/170、build-h3/default 编过;五条文档门禁全绿。
@Antruly
Antruly merged commit 1a853ee into master Nov 22, 2026
47 of 49 checks passed
@Antruly
Antruly deleted the feat/job-queue branch November 22, 2026 06:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant