Ashutosh Varma — Lab
Ashutosh Varma
Systems Engineering
Scroll
What I Do
Words
&
work
.
Words
&
work
.
All of it.
Latest
From the blog
AI Infrastructure Jul 24, 2026
Why You Need a Local LLM Gateway - and How to Set One Up with Bifrost
If you're calling LLM APIs directly from your apps, you're flying blind. A local LLM gateway gives you logs, fallbacks, cost tracking, and a single configuration point for every provider. This post covers why that matters and how to deploy Bifrost in Docker in under five minutes.
Read → AI Infrastructure Jul 23, 2026
Cache, Stack, and Time: Three Ways to Slash Your LLM API Bill
Cache hit rate is the single number that determines your LLM bill. A small cache improvement cuts cost in half because cached tokens are 10-20x cheaper than fresh ones. Here's how to get there with Bifrost, OpenRouter session_id, and timing your API calls.
Read → AI Infrastructure Jun 23, 2026
I Gave My AI Agent Unblockable Internet — Firecrawl, Camofox & a Raspberry Pi
How I gave my AI agents unblockable web access using Firecrawl, Camofox, a residential proxy chain, and SearXNG — all self-hosted on a homelab.
Read →