Ollama Advanced Server Config: GPU Profiling, Dual Models, Caching and NUMA
Once you move beyond basic Ollama usage, a set of advanced server configuration options unlocks meaningfully better performance and more flexible deployment. This guide covers the four most impactful advanced topics: profiling your GPU during inference to identify bottlenecks, running two models simultaneously for different tasks, understanding how Ollama caches models between requests, and configuring … Read more