Grape
Help center
AI setup and models3 min readUpdated October 2, 2026

Run local AI models with Ollama or LM Studio

Keep AI on your machine with a local model on desktop, and what to expect from it.

A local model runs on your own computer, so your text never leaves the machine. This is the option for material that cannot go to a hosted provider.

Ollama

Install and start Ollama on your computer, then enable the Ollama provider in Settings under Models on the desktop app. No key is needed. Click Add Model under a list and Grape lists the models you have pulled: chat models under Chat Models, embedding models under Indexing Models. If it says it could not reach Ollama, Ollama is not running.

Step by stepOn desktop
1With Ollama running, switch on Ollama in Settings under Models. It takes no key.
2Click Add Model under Chat Models and pick a model you have pulled.
3The model is ready to pick in the chat.

LM Studio

Start LM Studio's local server, enable the LM Studio provider, and add your loaded models the same way, from Add Model. Grape talks to LM Studio at its standard local address.

Step by stepOn desktop
1Start the local server in LM Studio, then switch on LM Studio in Settings under Models.
2Add your loaded model from Add Model. It joins the list, switched on.

Desktop only

Local providers are a desktop feature, since the model has to run somewhere with the memory to hold it. Phones use Grape AI or a hosted provider instead.

What to expect

A local model is as good as the hardware and the model you picked. Expect slower answers than a hosted provider and quality that varies by model. For summarizing and chatting over notes, mid sized local models are genuinely usable, and the privacy trade is the whole point.

Mixing local and hosted

Providers are switches, not a commitment. Some people run chat locally and keep a hosted model enabled for transcription, which local setups rarely handle well.

Did this not help? Contact us with the version you are on and what you were trying to do.

Try It While the Guide Is Open

Grape is free to install and needs no account, so you can follow along in the real app.