Tag

Bifrost

2 posts

AI Infrastructure · July 24, 2026

Why You Need a Local LLM Gateway - and How to Set One Up with Bifrost

If you're calling LLM APIs directly from your apps, you're flying blind. A local LLM gateway gives you logs, fallbacks, cost tracking, and a single configuration point for every provider. This post covers why that matters and how to deploy Bifrost in Docker in under five minutes.

Read →

AI Infrastructure · July 23, 2026

Cache, Stack, and Time: Three Ways to Slash Your LLM API Bill

Cache hit rate is the single number that determines your LLM bill. A small cache improvement cuts cost in half because cached tokens are 10-20x cheaper than fresh ones. Here's how to get there with Bifrost, OpenRouter session_id, and timing your API calls.

Read →