Beyond the Basics: Why Advanced Cost Optimisation Matters Most teams deploying LLMs learn the obvious cost levers quickly: use cheaper models for simple tasks, enable prompt caching, keep prompts concise. These basics can reduce costs by 30–50%. But the teams achieving 70–90% cost reductions without quality loss are applying a more systematic, layered approach that … Read more
What Are Knowledge Graphs and Why Pair Them with LLMs? A knowledge graph is a structured representation of entities and the relationships between them, stored as a network of nodes (entities) and edges (relationships). Where a relational database stores facts in tables with rows and columns, a knowledge graph stores facts as triples: subject, predicate, … Read more
Three Approaches, One Question When an LLM does not behave the way you need it to, three distinct strategies are available to improve its performance: prompting (changing what you say to the model at inference time), retrieval-augmented generation (providing relevant external information at inference time), and fine-tuning (changing the model’s weights through training). These are … Read more
The Data Analysis Transformation Data analysis has historically required either technical skill (SQL, Python, R) or expensive analyst time to translate business questions into code and results. LLMs are disrupting both requirements. They can write SQL and Python from natural language descriptions, explain complex data in plain language, generate visualisation code from data summaries, identify … Read more
Why Few-Shot Prompting Still Matters in 2026 With powerful frontier models that follow complex instructions reliably, it is tempting to think that few-shot prompting — providing examples in the prompt — is a technique from an earlier, less capable era. It is not. Few-shot examples remain one of the most powerful tools for eliciting specific … Read more
What AI Pair Programming Actually Is AI pair programming is not autocomplete. Modern LLM coding assistants — GitHub Copilot, Cursor, Claude, ChatGPT — understand code context at the function, file, and increasingly codebase level. They can explain unfamiliar code, suggest approaches to new problems, generate complete implementations from docstrings, write tests for existing functions, refactor … Read more
What Is a Token? Every LLM input is converted into tokens before the model processes it. A token is not a word, not a character, and not a syllable — it is a unit that falls somewhere between characters and words, determined by the tokeniser’s vocabulary. In practice, common English words are typically one token … Read more
The Structured Output Problem LLMs generate free-form text by default. When your application needs the output in a specific format — JSON for an API response, a list with defined fields, a table with precise columns — getting reliable structured output requires deliberate engineering. The naïve approach of asking the model to “respond in JSON” … Read more
Why Context Compression Matters Even with million-token context windows, there are compelling reasons to compress what you send to the model. Cost scales linearly with input tokens — a 100,000-token prompt costs 10x more than a 10,000-token one. Latency scales with input length, directly affecting user experience in interactive applications. And longer contexts do not … Read more
Why LLM Product Strategy Is Different Building products on top of large language models requires a different strategic framework than traditional software products. The underlying capability is non-deterministic, rapidly improving, and shared by competitors — three properties that make standard product moats (proprietary technology, switching costs, network effects) harder to build and maintain. A product … Read more
