Skip to content

Commit 321f3c8

Browse files
committed
Add sustainability section to README highlighting prompt caching optimization
1 parent a1be0cd commit 321f3c8

1 file changed

Lines changed: 6 additions & 0 deletions

File tree

‎README.md‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,12 @@ Code Web Chat is an open-source and privacy-first **AI coding toolkit for VS Cod
3030
> [!TIP]
3131
> Don't want to make edits in chatbots? CWC supports remote and local (e.g. Ollama) model providers.
3232
33+
## 🌱 Sustainability
34+
35+
Code Web Chat is **designed from the ground-up for [prompt caching](https://developers.openai.com/api/docs/guides/prompt-caching)** by placing all recently modified and selected files at the end of constructed prompts.
36+
37+
Offload chatbots. Save up to 90% on input tokens, across tasks! Make local inference fast.
38+
3339
## Enabling autofill
3440

3541
Got tired with copy and paste? Enable prompt autofill with a browser extension ([source code](https://github.com/robertpiosik/CodeWebChat/tree/dev/apps/browser)).

0 commit comments

Comments
 (0)