Machine Learning

In Part 1, we explored why LLM serving is expensive, how naive KV cache allocation wastes 60–80% of GPU memory, and how PagedAttention eliminates that waste through OS-style paging. Now it is time to put theory into practice. [Read More]

Large language models are transforming every corner of software, but serving them in production is brutally expensive. A single LLaMA-13B model can consume over 26 GB of GPU memory just for its weights, and that is before accounting for the memory needed to actually process requests. When dozens or hundreds... [Read More]

Large language models have grown at a staggering pace. Models like LLaMA-2 70B carry 70 billion parameters, which in full 32-bit floating point precision would require roughly 280 GB of GPU memory just to load the weights. Even a 7B parameter model needs around 28 GB in FP32. For most... [Read More]

In Part 1 we covered experiment design fundamentals, and in Part 2 we explored the statistical framework and metric selection. In this final part, we tackle the practical realities of running experiments — the pitfalls that can invalidate your results, the infrastructure needed to run experiments reliably, and the decision-making... [Read More]

In Part 1 we covered the foundations of A/B testing: what it is, why it matters, and how to design experiments with proper user segmentation and traffic allocation. Now we turn to the statistical machinery that makes A/B testing rigorous — how to determine sample sizes, choose the right metrics,... [Read More]

In the high-stakes world of machine learning deployment, launching a new model is like piloting a spacecraft - every decision matters, and there’s no room for blind leaps of faith. Enter A/B testing, the mission control center of model deployment that transforms uncertainty into calculated progress. Think of A/B testing... [Read More]

In this post, we we breifly discuss about several tools that can be useful while developing and structuring machine learning based projects. Specifically, we will focus on the fundamental tools related to MLOps. [Read More]

Developing intelligent machine leaning models for solving a particular problem with considerable accuracy in itself is a great challenge. We can manage to build the most optimum model, but unless we know how to put it into production, it’s hard to get it to create the maximum amount of possible... [Read More]