Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
7d59883
feat(security): add fail-closed host file protection engine and Comma…
Coding-Dev-Tools Oct 14, 2026
3552ce4
feat: sync local desktop-memory, stdio bridge, and history-integrity …
Coding-Dev-Tools Oct 30, 2026
1f52f34
chore(release): prepare 1.7.12 candidate
Coding-Dev-Tools Oct 30, 2026
5ef0bbf
tools: add Windows RAM integrity stress probe
Coding-Dev-Tools Oct 30, 2026
80e70d5
fix(http): treat watchdog interruption as deadline timeout
Coding-Dev-Tools Nov 3, 2026
d93e890
fix(http): catch HTTPException on watchdog interrupted socket reads
Coding-Dev-Tools Nov 3, 2026
e10173a
Merge origin/main into feat/file-guard-protection
Coding-Dev-Tools Nov 3, 2026
627cfff
fix(benchmark): rebind offline evidence to the http deadline change
Coding-Dev-Tools Nov 3, 2026
a657890
chore(release): merge origin/main into feat/file-guard-protection
Coding-Dev-Tools Nov 3, 2026
560c562
fix(docker): update Python base image to 3.11.18 (#314)
Coding-Dev-Tools Nov 4, 2026
773f321
chore: reconcile with the rewritten main lineage
Coding-Dev-Tools Nov 4, 2026
3adb658
docs(readme): add Pro and Team upgrade benefits (#321)
Coding-Dev-Tools Nov 4, 2026
b385d79
chore: merge main into the branch for review
Coding-Dev-Tools Nov 5, 2026
bf81be0
Merge origin/main into feat/file-guard-protection
Coding-Dev-Tools Nov 5, 2026
4a98564
fix(benchmark): rebind offline evidence artifact to refreshed source …
Coding-Dev-Tools Nov 9, 2026
f27ad31
Merge remote-tracking branch 'origin/main' into fix/audit-engraphis-2…
Coding-Dev-Tools Nov 9, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 6 additions & 6 deletions BENCHMARKS.md
Original file line number Diff line number Diff line change
Expand Up @@ -94,14 +94,14 @@ interpretation and do not count as additional benchmark-quality gains.
### Public numeric evidence registry

Every exact public aggregate retained below comes from the checked-in, public-safe
[`offline-fixtures-receipt-diagnostics-20261103.json`](docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261103.json) artifact. Its
[`offline-fixtures-receipt-diagnostics-20261109.json`](docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261109.json) artifact. Its
SHA-256 is
`62fc90a14e36622943e70f509cf2cd172239be9c862f8d51e64060ebe6f1496f`, also recorded in the
`d13497f0a36fe53ca7871597d8acfbc878348a1f6985ebae4714b4e0bee4985e`, also recorded in the
adjacent `.sha256` file. The artifact contains no raw questions, answers, prompts, customer data,
or per-record content fingerprints.

The fixture-suite digest is
`cee29f122abcdbf6a8874073d58840720b1724ab0a3ed125822841707b066b77`. The artifact defines
`c1b3f2ca3dc80047737eaa47730a7859a902a1111b6c7bf2291f5f9ad5fd9bf9`. The artifact defines
the digest algorithm and records the SHA-256 of every suite and dataset file. Each evidence ID
also binds its exact command through `sha256(UTF-8 exact command)`:

Expand Down Expand Up @@ -134,7 +134,7 @@ retrieval-quality improvement. It does not qualify browser behavior, hosted serv
external models, or provider billing. The registered artifact was produced with:

```bash
python -m scripts.export_offline_evidence --output docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261103.json
python -m scripts.export_offline_evidence --output docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261109.json
```

The earlier release-review predecessors,
Expand Down Expand Up @@ -203,13 +203,13 @@ grounded checks in separate panels; provider billing and MCP transport are not m
the SVG and matching PNG with:

```bash
python scripts/render_benchmark_report.py --report docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261103.json --output docs/images/context-efficiency.svg --png-output docs/images/context-efficiency.png
python scripts/render_benchmark_report.py --report docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261109.json --output docs/images/context-efficiency.svg --png-output docs/images/context-efficiency.png
```

The companion examples are also generated from that artifact with:

```bash
python -m scripts.render_benchmark_examples --report docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261103.json --output docs/images/evidence-backed-agent-examples.svg --png-output docs/images/evidence-backed-agent-examples.png
python -m scripts.render_benchmark_examples --report docs/benchmark-evidence/offline-fixtures-receipt-diagnostics-20261109.json --output docs/images/evidence-backed-agent-examples.svg --png-output docs/images/evidence-backed-agent-examples.png
```
The historical-to-executable mapping is in
[`docs/BENCHMARK_CHANGE_COVERAGE.md`](docs/BENCHMARK_CHANGE_COVERAGE.md).
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ Pro is $10/month or $100/year for one owner. Team is $20/seat/month or $200/seat
The current registered artifact contains three deterministic offline fixture runs. It separates context size, retrieval quality, and grounded decision checks; these small fixtures do not establish general task performance.

<p align="center">
<img src="https://raw.githubusercontent.com/Coding-Dev-Tools/engraphis/99af3855bd6b685cbac4a4489b44b3c374129053/docs/images/context-efficiency.svg" alt="Three registered offline fixtures: structure-aware chunking reduced mean retrieved context from 740.3 to 214.3 tokens per question (71.1%, 18 questions); the serialized JSON-shape proxy fell from 24,590 to 11,138 tokens across 26 payload samples and 260 recalls. Candidate and packed retrieval quality (Recall@5, Hit@5, and answer-token recall) are shown separately (each 1.000). Grounded checks show 5/5 answerable queries grounded and 6/6 abstention queries rejected, including a 1/1 quarantined-evidence probe; 11/11 decisions were correct. MCP transport and provider billing were not measured. Artifact SHA-256 prefix 62fc90a14e36; see the benchmark guide for the full checksum." width="100%">
<img src="https://raw.githubusercontent.com/Coding-Dev-Tools/engraphis/99af3855bd6b685cbac4a4489b44b3c374129053/docs/images/context-efficiency.svg" alt="Three registered offline fixtures: structure-aware chunking reduced mean retrieved context from 740.3 to 214.3 tokens per question (71.1%, 18 questions); the serialized JSON-shape proxy fell from 24,590 to 11,138 tokens across 26 payload samples and 260 recalls. Candidate and packed retrieval quality (Recall@5, Hit@5, and answer-token recall) are shown separately (each 1.000). Grounded checks show 5/5 answerable queries grounded and 6/6 abstention queries rejected, including a 1/1 quarantined-evidence probe; 11/11 decisions were correct. MCP transport and provider billing were not measured. Artifact SHA-256 prefix d13497f0a36f; see the benchmark guide for the full checksum." width="100%">
<br>
<sup>Three offline fixtures separate context reduction, candidate and packed retrieval quality, and grounded behavior. The chart shows the artifact checksum prefix; see the benchmark guide for the full checksum and reproduction steps.</sup>
</p>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -103,7 +103,7 @@
],
"schema": "engraphis-public-offline-fixtures/v1",
"suite": {
"digest": "0179ada4cfffd827e2d1cf2cce1b5110862ac9a5cafbbf0db6dcd6e975e864ce",
"digest": "ca7492a5d783b641afa0c638995d65e50742ad3536160ed4e3ced6c89a3e14f6",
"digest_method": "sha256(canonical compact JSON mapping each sorted path to its file SHA-256)",
"files": {
"engraphis/__init__.py": "54c83cf75637c6d12314b474aaeab66ffd2bf817f066d6148ec8aa3bf2c4952a",
Expand Down Expand Up @@ -192,7 +192,7 @@
"engraphis/file_guard.py": "44eccaeca3afef7149bfdfea2321c325472253ee39a9e0bc24c720b3da3d685b",
"engraphis/graphdata.py": "f5dc93395f52203c66deaeec8bc58d5c1f990a35a535151e0b9a84cecf7d8430",
"engraphis/hosted_client.py": "5b56b0d2384cf24ecb409090af15f09e437ec8ab5a98bed931384daff46b4f48",
"engraphis/http_deadline.py": "bb29ac2d1e2fb49829e8484bb17f8abe98c23895ef17c68abe135d13f5df0099",
"engraphis/http_deadline.py": "943435334c43780b3ddfe45d79e025d1a86da26c3450e8f148d46bd694ac7a86",
"engraphis/http_security.py": "5cd96551778d7a964ce1d87c6bce032a5e70c7a1779fb2f6731432b96f5f069b",
"engraphis/inspector/__init__.py": "720cac28b8a6019d0a0c53809d5905b7d6eb9d4ecbac767505904c6ec3c39071",
"engraphis/inspector/app.py": "8aefe8a935397dde3c6466e691a7e6a7203ebe42e07aa00c332b733465e59e04",
Expand Down
Original file line number Diff line number Diff line change
@@ -1 +1 @@
8df20fd0a97f20070ac26628e19b5ae1be653cd7aa9c7399d424cedf0e839a01 offline-fixtures-automatic-browser-access-20261101.json
9792658fa430895191a896c5ba97da8b497b8f451cd3484cbf35e6d06c51251a offline-fixtures-automatic-browser-access-20261101.json
Loading
Loading