🦝 Fully In-Browser Chat Over Documents with AI-Mask 🦝

Model provider

🏡Yes, it's another LLM-powered chat over documents implementation... but this one is entirely local in your browser!
🌐The vector store (Voy) and embeddings (Transformers.js) are served via Vercel Edge function and run fully in the browser with no setup required.
⚙️The default LLM is Phi-2 run using AI-Mask. You must have the extension installed for this to work.
🕑The first time you start a chat, the model provider will automatically download the weights and cache them. These weights are several GB in size, so it may take some time. Make sure you have a good internet connection!
🗺️
The default embeddings are
```
"Xenova/all-MiniLM-L6-v2"
```
. For higher-quality embeddings on machines that can handle it, switch to
```
nomic-ai/nomic-embed-text-v1
```
in
```
app/worker.ts
```
.
🦜LangChain.js handles orchestration and ties everything together!
🐙This template is open source - you can see the source code and deploy your own version from the GitHub repo!
👇Try embedding a PDF below, then asking questions! You can even turn off your WiFi after the initial model download.