GrapeGrape
Help center
AI setup and models3 min readUpdated August 10, 2026

Run local AI models with Ollama or LM Studio

Keep AI on your machine with a local model on desktop, and what to expect from it.

A local model runs on your own computer, so your text never leaves the machine. This is the option for material that cannot go to a hosted provider.

Ollama

Install and start Ollama on your computer, then enable the Ollama provider in Settings under Models on the desktop app. No key is needed. Add the models you have pulled locally with Add Custom Model, using the same model name Ollama uses.

LM Studio

Start LM Studio's local server, enable the LM Studio provider, and add your loaded models the same way. Grape talks to LM Studio at its standard local address.

Desktop only

Local providers are a desktop feature, since the model has to run somewhere with the memory to hold it. Phones use Grape AI or a hosted provider instead.

What to expect

A local model is as good as the hardware and the model you picked. Expect slower answers than a hosted provider and quality that varies by model. For summarizing and chatting over notes, mid sized local models are genuinely usable, and the privacy trade is the whole point.

Mixing local and hosted

Providers are switches, not a commitment. Some people run chat locally and keep a hosted model enabled for transcription, which local setups rarely handle well.

Try It While the Guide Is Open

Grape is free to install and needs no account, so you can follow along in the real app.