How to Use the Ollama REST API with Python (Complete Guide)

Ollama exposes a clean REST API that lets you interact with any locally running model from your Python code — no paid API keys, no rate limits, nothing leaving your machine. Whether you’re building a chatbot, automating document processing, or integrating LLM capabilities into an existing application, the Ollama API is your bridge between Python … Read more

How to Run Command R+ Locally with Ollama

Command R+ is Cohere’s flagship open-weight model and one of the most capable models you can run locally for RAG (retrieval-augmented generation) and tool use. It was specifically trained with these workflows in mind — it handles long documents better than most models its size, supports structured tool calling natively, and performs well in multi-turn … Read more

Ollama Context Length Guide: How to Set num_ctx and Which Models Support Long Context

One of the most common surprises when using Ollama is discovering that your model has a context length of 2048 tokens by default — even if the model itself supports 128K. Ollama’s default is conservative to protect users on limited hardware, but for most people the right context length is much higher. This guide explains … Read more

How to Run Mixtral 8x7B Locally with Ollama

Mixtral 8x7B was a landmark release when it came out — a Mixture of Experts model that delivers performance competitive with much larger models by selectively routing each token through just two of its eight expert networks at inference time. This means you get the quality of a large model at the computational cost of … Read more

How to Configure Ollama Environment Variables (Complete Guide)

Ollama’s behaviour is almost entirely configurable through environment variables — where it stores models, what address and port it listens on, how long it keeps models in memory, how many parallel requests it handles. The defaults are sensible for a single-user local setup, but as soon as you want to customise anything — move models … Read more