The DataLoader is often the bottleneck that prevents your GPU from training at full utilisation. If your GPU sits at 30–60% utilisation between batches, the problem is almost certainly data loading — the CPU cannot prepare and transfer batches fast enough to keep the GPU busy. This guide covers every meaningful optimisation: worker count, pinned … Read more
PyTorch Lightning is a high-level wrapper around PyTorch that removes boilerplate from training loops while keeping you in control of the actual model logic. Vanilla PyTorch gives you maximum flexibility and transparency — every part of training is code you wrote. The decision between them is not about which is better in absolute terms: it … Read more
Distributed training lets you use multiple GPUs — on one machine or across many — to train models faster or to fit models that do not fit on a single GPU. PyTorch’s DistributedDataParallel (DDP) is the standard approach: each GPU runs a full copy of the model on a shard of the data, and gradients … Read more
A PyTorch training loop that is not learning is one of the most common and frustrating situations in deep learning. The loss is flat, or NaN, or oscillating — and the model is right, the data is right, so what is wrong? This guide covers the systematic debugging process: how to isolate whether the problem … Read more
Apple Silicon (M1, M2, M3, M4) brings a capable GPU integrated into the same die as the CPU, with shared memory that eliminates the PCIe data transfer bottleneck of discrete GPUs. PyTorch supports it via the Metal Performance Shaders (MPS) backend, available since PyTorch 1.12. For ML workloads that fit in the Mac’s unified memory, … Read more
JAX is NumPy with automatic differentiation, JIT compilation, and hardware acceleration baked in. It is not a deep learning framework in the way PyTorch is — there are no built-in layers or optimisers. Instead, JAX gives you the primitives for building them: pure functional transformations (jit, grad, vmap, pmap) that compose cleanly and run efficiently … Read more
PyTorch 2.0 introduced torch.compile(), a one-line speedup for PyTorch models. It compiles your model’s computation graph using TorchDynamo and TorchInductor, fusing operations and generating optimised kernels for your hardware. On NVIDIA GPUs, compile mode typically delivers 10–50% speedup with no changes to model architecture or training loop. This guide covers how to use it, what … Read more
PyTorch and JAX both dominate modern deep learning research, but they make fundamentally different design choices. PyTorch is object-oriented, eager by default, and built around mutable tensors and a familiar Python programming model. JAX is functional, pure, and built around function transformations — you write plain Python functions and apply jit, grad, vmap, and pmap … Read more
TabNet is a deep learning architecture designed specifically for tabular data. It uses sequential attention to select which features to focus on at each decision step — essentially learning feature selection and transformation jointly rather than relying on hand-crafted engineering. XGBoost is gradient boosted trees, the dominant tabular baseline for the past decade. The comparison … Read more
Saving and loading XGBoost models sounds trivial — and mostly it is — but there are enough format options, version compatibility nuances, and post-load gotchas (particularly around early stopping) to make it worth covering carefully. This guide covers every serialisation format XGBoost supports, when to use each, and what to watch out for. Format Overview … Read more
