Skip to content

Commit d28ac28

Browse files
committed
Update README to clarify agent limitations and improve prompt caching explanation
1 parent c9cd048 commit d28ac28

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

‎README.md‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -24,11 +24,11 @@ Works with VS Code family of editors (Cursor, Antigravity, VSCodium, etc.).
2424

2525
**LLMs are brilliant, yet mindless pattern matchers.** Because they lack properties similar to mental models, they can't _imagine_ how the correct output should look like _before_ their context is filled with files.
2626

27-
While agents address this limitation via tool calling just fine—they're slow and, because files are placed in output tokens, expensive.
27+
Coding agents address this limitation via tool calling—although keyword search may work, it requires instructions complex enough to fully understand your intent. The context is compiled in output tokens by slowly printing out all relevant files. With a lot of rambling along the way, it's an expensive and time consuming process.
2828

29-
Code Web Chat proposes an alternative approach where the model is guided with hand-picked context, allowing simpler instructions and enabling accuracy that can't get any better!
29+
Code Web Chat proposes an alternative approach where the model is guided with files included directly in the prompt, allowing simpler instructions and unlocking accuracy that can't get any better!
3030

31-
For efficiency, files are sorted in a way enabling **[prompt caching](https://platform.openai.com/docs/guides/prompt-caching) across tasks**—be kinder to the planet, and save up to 90% on input tokens!
31+
With clever sorting of files by its update recency, CWC help utilize **[prompt caching](https://platform.openai.com/docs/guides/prompt-caching) across tasks**—consistently save up to 90% on input tokens and reserve the more expensive output tokens for the changes you're looking for.
3232

3333
**Example message:**
3434

0 commit comments

Comments
 (0)