diff --git a/Architecture.md b/Architecture.md index 194d184..e862afd 100644 --- a/Architecture.md +++ b/Architecture.md @@ -5,8 +5,8 @@ * **Specification Status**: Phase 0 Approved Architecture & Subsystem Suite (see [Section 12](#12-implementation-status-matrix-paper-vs-repository) for current prototype vs. Phase 1–6 implementation status) * **Design Methodology**: [Google Elephant-Goldfish Model (EGM)](https://github.com/google/elephant-goldfish-model) for Spec-Driven Development (SDD) * **Primary Theoretical Reference**: This architecture is directly inspired by and adapted from Baidu's trillion-scale production metadata database paper: - > **Biao Cao, Kang Chen, Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou.** - > *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, arXiv:2610.32247v1 (Baidu & Peking University, 2026). [https://arxiv.org/html/2610.32247v1](https://arxiv.org/html/2610.32247v1) + > **Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou.** + > *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, arXiv:2610.32247v1 (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026). [https://arxiv.org/html/2610.32247v1](https://arxiv.org/html/2610.32247v1) --- diff --git a/README.md b/README.md index 9db3ce1..c1df349 100644 --- a/README.md +++ b/README.md @@ -8,7 +8,7 @@ > **Academic & Architectural Attribution**: > The architecture of `rustfs/MetaDB` is inspired by and adapted from Baidu's trillion-scale production metadata center paper: -> **Biao Cao, Kang Chen, Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou**, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Baidu & Peking University, 2026). +> **Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou**, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026). > *(Note: Trillion-record production figures cited from `arXiv:2610.32247v1` reflect Baidu's production deployment; see [Current Implementation Status](#current-implementation-status) below for `rustfs/MetaDB` repository milestones.)* > > **Spec-Driven Development Methodology**: diff --git a/_agents/skills/metadb_elephant/SKILL.md b/_agents/skills/metadb_elephant/SKILL.md index c0e5a79..696a433 100644 --- a/_agents/skills/metadb_elephant/SKILL.md +++ b/_agents/skills/metadb_elephant/SKILL.md @@ -20,7 +20,7 @@ This skill loads the architectural history, foundational literature, subsystem c * [`docs/designs/sharding_and_control_plane.md`](../../../docs/designs/sharding_and_control_plane.md) 6. **EGM Goldfish Review Report**: [`docs/designs/review_report.md`](../../../docs/designs/review_report.md) 7. **Multilingual Usage Documentation (`en`, `ja`, `fr`, `zh`, `de`)**: [`docs/README.md`](../../../docs/README.md) -8. **Foundational Paper**: Biao Cao et al. (Baidu & Peking University), *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, arXiv:2610.32247v1 (2026). +8. **Foundational Paper**: Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026). ## Target 8-Crate Pure-Rust Workspace diff --git a/docs/designs/concepts_brief.md b/docs/designs/concepts_brief.md index 4839789..f5a576b 100644 --- a/docs/designs/concepts_brief.md +++ b/docs/designs/concepts_brief.md @@ -2,7 +2,7 @@ * **Project**: `rustfs/MetaDB` * **Methodology**: [Google Elephant-Goldfish Model (EGM)](https://github.com/google/elephant-goldfish-model) -* **Theoretical Foundation**: Biao Cao et al. (Baidu & Peking University), *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) +* **Theoretical Foundation**: Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026) --- diff --git a/docs/designs/consensus_and_transactions.md b/docs/designs/consensus_and_transactions.md index c3db4a9..2cbf875 100644 --- a/docs/designs/consensus_and_transactions.md +++ b/docs/designs/consensus_and_transactions.md @@ -2,7 +2,7 @@ * **Status**: Phase 0 Approved Specification * **Target Crates**: `crates/metadb-raft` and `crates/metadb-tx` -* **Primary Reference**: Biao Cao et al., *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1), §3.2, §4.2, §5.1, §5.2 +* **Primary Reference**: Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026), §3.2, §4.2, §5.1, §5.2 * **Semantic Boundaries**: * `FeatureRange`: Sections 1 – 4 * `DetailedRange` (Zero-Decision Implementation Contract): Sections 5 – 10 diff --git a/docs/designs/metadb_architecture.md b/docs/designs/metadb_architecture.md index 80b6323..b22d5c3 100644 --- a/docs/designs/metadb_architecture.md +++ b/docs/designs/metadb_architecture.md @@ -2,7 +2,7 @@ * **Status**: Phase 0 Approved Umbrella Specification * **Methodology**: [Google Elephant-Goldfish Model (EGM)](https://github.com/google/elephant-goldfish-model) -* **Primary Reference**: Biao Cao et al., *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Baidu & Peking University, 2026) +* **Primary Reference**: Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026) * **Modular Subsystem Contracts**: * [`storage_lsm_mvcc.md`](./storage_lsm_mvcc.md) — Pure-Rust WAL-less LSM, `SnapshotGuard` MVCC & `LocalityCompactor` (`metadb-storage`) * [`consensus_and_transactions.md`](./consensus_and_transactions.md) — `openraft` Multi-Raft, 3-Watermark Log, `ReadIndex`, `PushdownExecutor`, `AsyncAttrAggregator`, `AuxOutbox` & 2PC (`metadb-raft`, `metadb-tx`) diff --git a/docs/designs/sharding_and_control_plane.md b/docs/designs/sharding_and_control_plane.md index f0f7157..c2cc66f 100644 --- a/docs/designs/sharding_and_control_plane.md +++ b/docs/designs/sharding_and_control_plane.md @@ -2,7 +2,7 @@ * **Status**: Phase 0 Approved Specification * **Target Crates**: `crates/metadb-proto`, `crates/metadb-cluster`, and `crates/metadb-proxy` -* **Primary Reference**: Biao Cao et al., *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1), §3.1, §3.2, §4.1, §8 +* **Primary Reference**: Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026), §3.1, §3.2, §4.1, §8 * **Semantic Boundaries**: * `FeatureRange`: Sections 1 – 4 * `DetailedRange` (Zero-Decision Implementation Contract): Sections 5 – 10 diff --git a/docs/designs/storage_lsm_mvcc.md b/docs/designs/storage_lsm_mvcc.md index defa304..be17622 100644 --- a/docs/designs/storage_lsm_mvcc.md +++ b/docs/designs/storage_lsm_mvcc.md @@ -2,7 +2,7 @@ * **Status**: Phase 0 Approved Specification * **Target Crate**: `crates/metadb-storage` (depends solely on `metadb-core` + pure-Rust utilities; zero C/C++ FFI) -* **Primary Reference**: Biao Cao et al., *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1), §3.2 & §6 +* **Primary Reference**: Zebin Ren ([@ZebinRen](https://github.com/ZebinRen)), Biao Cao, Kang Chen ([@kangchenPKU](https://github.com/kangchenPKU)), Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, and Zhenyu Hou, *"MetaDB: Putting File-System Structure Back into Distributed Databases"*, [arXiv:2610.32247v1](https://arxiv.org/html/2610.32247v1) (Vrije Universiteit Amsterdam, Baidu & Peking University, 2026), §3.2 & §6 * **Semantic Boundaries**: * `FeatureRange`: Sections 1 – 5 * `DetailedRange` (Zero-Decision Implementation Contract): Sections 6 – 10