Jan AI and AnythingLLM both position themselves as complete local AI applications — download, install, and start using AI without touching a terminal. But they make fundamentally different choices about what to prioritise. Jan is a clean, fast general-purpose AI chat app. AnythingLLM is a document knowledge base platform with a chat interface attached. Choosing … Read more
Once you move beyond basic Ollama usage, a set of advanced server configuration options unlocks meaningfully better performance and more flexible deployment. This guide covers the four most impactful advanced topics: profiling your GPU during inference to identify bottlenecks, running two models simultaneously for different tasks, understanding how Ollama caches models between requests, and configuring … Read more
The local AI ecosystem has matured dramatically. Where there were once only a handful of rough tools, there are now polished interfaces for every use case and user type. This roundup covers the best GUI options for interacting with local LLMs in 2026 — what each is best at, who it is for, and how … Read more
LM Studio, GPT4All, and text-generation-webui (Oobabooga) are three of the most popular desktop applications for running local AI models. Each approaches the user experience differently — LM Studio targets a polished developer experience, GPT4All targets maximum accessibility for non-technical users, and Oobabooga targets power users who want every possible configuration knob. If you are choosing … Read more
Three tools dominate the conversation when people talk about running local LLMs: Ollama, Jan AI, and Llamafile. They approach the same problem — making local model inference accessible — in meaningfully different ways, and the right choice depends on what you want to do. This guide cuts through the surface-level descriptions to explain what each … Read more
Running AI on your own computer used to require significant technical knowledge. In 2026 it is genuinely accessible to anyone comfortable installing software. Ollama — free, open-source, and available for Windows, macOS, and Linux — handles almost everything automatically. This guide is for people who have heard about local AI and want to try it … Read more
Google Sheets has a built-in scripting environment — Apps Script — that can call external APIs using JavaScript. With Ollama running locally and a tunnel to make it accessible, or Ollama deployed on a server, you can call it directly from Apps Script and add AI capabilities to any Google Sheet. Generate product descriptions, classify … Read more
Notion AI is convenient but it sends every piece of text you ask it to process to Anthropic’s or OpenAI’s servers. For personal notes, confidential work documents, client data, or anything sensitive, that’s a meaningful privacy trade-off. With Ollama and a few tools, you can replicate most of what Notion AI does — writing assistance, … Read more
Logseq is an open-source knowledge management tool built around bidirectional linking, daily journals, and a graph view of connected notes. Its AI features — query answering, content generation, summarisation — can be backed by any OpenAI-compatible API, which means you can connect them to Ollama for fully local, private knowledge management. Your notes never leave … Read more
Benchmarking intro text. This guide covers how to measure Ollama performance precisely, what to look for in the numbers, how to compare models and settings systematically, and how Flash Attention improves both speed and memory usage. The goal is to give you concrete numbers rather than vague impressions about what is fast or slow. Built-in … Read more
