Ollama vs LM Studio — running models locally, CLI or GUI
Both let you run open-weight models on your own hardware, for free, with no data leaving the machine. The split is temperamental rather than technical: Ollama is a command-line tool that other software talks to, LM Studio is an application you use.
AI Tools Hub Editorial · published · updated
The short version
- You want to wire local models into your own code → Ollama
- You want to chat with a local model and try things → LM Studio
- You want both → they coexist fine on the same machine
Ollama
Pull a model, run it, and you have a local API endpoint. That endpoint is why it has become the default for developers: editors, scripts and applications can point at it with a few lines. Model management is a command, which is a feature if you live in a terminal and a barrier if you do not.
LM Studio
A desktop application with model discovery, a chat interface and clear memory and quantisation settings. For someone evaluating whether a local model is good enough for a task, it removes every obstacle that is not the model itself. It can also expose a local server, so the gap is narrower than it used to be.
What local models are actually good for
- Work on documents that cannot leave the machine
- High-volume classification or extraction where API cost would dominate
- Offline use
- Experimenting without a per-token meter running
What they are not good for, still, is replacing a frontier model on hard reasoning. The gap narrowed and did not close.
What hardware do I need?
A current Apple Silicon Mac with plenty of unified memory, or a machine with a modern GPU. Memory is the usual constraint rather than raw speed.
Is a local model private by definition?
The inference is. Check what the surrounding application does — some tools phone home for model metadata even when inference is local.
Related
More articles
Opinion
Why AI rollouts fail in Japanese companies — four structural reasons
For business
Enterprise AI rollout checklist — SOC 2, ISO 27001, DPAs and personal data
For business
Japanese-developed LLMs for business — ELYZA, Sakana AI, NTT tsuzumi and PLaMo
Comparison
AI coding tools compared — Cursor, Copilot, Claude Code, Windsurf and Codeium