Skip to content

Commit 3dc05b8

Browse files
authored
docs: list what the benchmark project contains (#1195)
1 parent 27b3316 commit 3dc05b8

2 files changed

Lines changed: 30 additions & 8 deletions

File tree

‎src/sqlbuild/.agents/skills/sqlbuild/references/docs/benchmarks.md‎

Lines changed: 15 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -101,10 +101,21 @@ compiles in full.
101101

102102
## The project and how to reproduce it
103103

104-
The project comes from the dense generator SQLBuild's compile CI uses: 10,000 models (31 columns on
105-
average), 2,400 sources, 500 seeds, 250 SQL functions, 120 macros and 10,000 SQL tests. The dbt
106-
project has the same names, folders, SQL and DAG. Each edit changes one constant in a model's SQL;
107-
the 1% edit changes 100 models spread across the project. Rounds alternate the variant order.
104+
The project comes from the dense generator SQLBuild's compile CI uses. The dbt project has the same
105+
names, folders, SQL and DAG.
106+
107+
| What | Count | In dbt |
108+
|---|---:|---|
109+
| Models with typed columns (8–472 columns, about 31 on average) | 10,000 | models with enforced contracts |
110+
| Sources | 2,400 | sources |
111+
| Seeds | 500 | seeds |
112+
| SQL functions | 250 | functions |
113+
| Macros | 120 | Jinja macros producing the same SQL |
114+
| `not_null` audits | 17,000 | `not_null` data tests |
115+
| SQL tests with fixture rows | 10,000 | unit tests |
116+
117+
Each edit changes one constant in a model's SQL; the 1% edit changes 100 models spread across the
118+
project. Rounds alternate the variant order.
108119

109120
The harness and the exact command for every variant are in
110121
[`benchmarks/dbt-compare/`](https://github.com/chio-labs/sqlbuild/tree/main/benchmarks/dbt-compare).

‎website/src/content/docs/docs/benchmarks.mdx‎

Lines changed: 15 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -89,10 +89,21 @@ compiles in full.
8989

9090
## The project and how to reproduce it
9191

92-
The project comes from the dense generator SQLBuild's compile CI uses: 10,000 models (31 columns on
93-
average), 2,400 sources, 500 seeds, 250 SQL functions, 120 macros and 10,000 SQL tests. The dbt
94-
project has the same names, folders, SQL and DAG. Each edit changes one constant in a model's SQL;
95-
the 1% edit changes 100 models spread across the project. Rounds alternate the variant order.
92+
The project comes from the dense generator SQLBuild's compile CI uses. The dbt project has the same
93+
names, folders, SQL and DAG.
94+
95+
| What | Count | In dbt |
96+
|---|---:|---|
97+
| Models with typed columns (8–472 columns, about 31 on average) | 10,000 | models with enforced contracts |
98+
| Sources | 2,400 | sources |
99+
| Seeds | 500 | seeds |
100+
| SQL functions | 250 | functions |
101+
| Macros | 120 | Jinja macros producing the same SQL |
102+
| `not_null` audits | 17,000 | `not_null` data tests |
103+
| SQL tests with fixture rows | 10,000 | unit tests |
104+
105+
Each edit changes one constant in a model's SQL; the 1% edit changes 100 models spread across the
106+
project. Rounds alternate the variant order.
96107

97108
The harness and the exact command for every variant are in
98109
[`benchmarks/dbt-compare/`](https://github.com/chio-labs/sqlbuild/tree/main/benchmarks/dbt-compare).

0 commit comments

Comments
 (0)