How to Run Qwen 2.5 72B Locally with Ollama

Qwen 2.5 72B is Alibaba’s largest open-weight model and one of the most capable you can run locally. At 72 billion parameters it’s in the same tier as Llama 3.1 70B and Mixtral 8x22B, but it benchmarks ahead of both on several tasks — particularly coding, mathematics, and multilingual work. If your hardware can handle … Read more

How to Use Ollama with LlamaIndex for Local RAG

LlamaIndex is one of the most capable frameworks for building RAG systems — retrieval-augmented generation pipelines that let your LLM answer questions grounded in your own documents. Connecting it to Ollama means you get the full LlamaIndex feature set (document loading, chunking, vector indexing, query engines, agents) backed by a local model with no API … Read more

How to Run Command R+ Locally with Ollama

Command R+ is Cohere’s flagship open-weight model and one of the most capable models you can run locally for RAG (retrieval-augmented generation) and tool use. It was specifically trained with these workflows in mind — it handles long documents better than most models its size, supports structured tool calling natively, and performs well in multi-turn … Read more

How to Run Mixtral 8x7B Locally with Ollama

Mixtral 8x7B was a landmark release when it came out — a Mixture of Experts model that delivers performance competitive with much larger models by selectively routing each token through just two of its eight expert networks at inference time. This means you get the quality of a large model at the computational cost of … Read more