Skip to content

Commit 75bca79

Browse files
committed
Update README to clarify prompt caching benefits and improve example formatting
1 parent 9b14551 commit 75bca79

1 file changed

Lines changed: 5 additions & 4 deletions

File tree

‎README.md‎

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ Autofill for chatbots. Works with VS Code, Cursor, Antigravity, and others.
2121

2222
**LLMs are brilliant, yet mindless pattern matchers.** Because they lack properties similar to mental models, they can't _imagine_ how the correct output should look like before their context is filled with relevant files.
2323

24-
To address this limitation, **Code Web Chat lets you guide the model with context**. By having it static, you automatically use [prompt caching](https://platform.openai.com/docs/guides/prompt-caching) for substantial 50-90% discount on input tokens.
24+
To address this limitation, **Code Web Chat lets you guide the model with context**. Files are intelligently sorted in a way prioritizing [prompt caching](https://platform.openai.com/docs/guides/prompt-caching) across tasks—put less strain on the planet and save up to 90% on input tokens.
2525

2626
**Messages are simple**, constructed from selected files, chosen edit format, and prompt:
2727

@@ -30,9 +30,10 @@ To address this limitation, **Code Web Chat lets you guide the model with contex
3030
Whenever showing a new, updated, renamed or deleted file, provide a brief explanation...
3131
</system>
3232
<files>
33-
<file path="src/calculator.ts">
34-
export const addNumbers = (a: number, b: number) => a + b;
35-
</file>
33+
<file path="src/calculator.ts">
34+
export const addNumbers = (a: number, b: number) => a + b;
35+
</file>
36+
...
3637
</files>
3738
<system>
3839
Whenever showing a new, updated, renamed or deleted file, provide a brief explanation...

0 commit comments

Comments
 (0)