← The journal
Indie Hacking / Startups

Scaling Indie Hacking with Free LLM APIs (OpenRouter, Gemini, Groq)

Bootstrapping an AI startup? Don't pay for tokens until you have to. Learn how to combine multiple free API tiers into a reliable production stack using FreeLM.

When you are indie hacking, your most precious resource is runway. Every dollar spent on API calls before you achieve Product-Market Fit is a dollar wasted.

But AI applications are token-hungry. If you are building an agentic workflow that makes 10 LLM calls per user action, you can burn through a $20 credit balance in a weekend of testing.

To scale from 0 to 1, you need to leverage the massive free capacity offered by companies trying to win developer mindshare.

The Free Tier Landscape in 2026

  • Google AI Studio (Gemini): Google offers incredibly high limits on Gemini 1.5 Flash and Pro for free. This is the workhorse of the indie hacker stack.
  • OpenRouter: The aggregator of aggregators. Their :free models include top-tier open-source weights.
  • Groq / Cerebras: When you need blistering fast inference (e.g., for real-time UI updates), these providers offer generous free tiers for Llama models.
  • NVIDIA NIM / Mistral: Excellent free endpoints for specialized models.

The Problem: Reliability

You cannot build a production SaaS on a single free tier. The moment your app gets traction, you will hit a rate limit, and your users will get errors.

To solve this, I built freelm, an open-source gateway available on PyPI and npm.

The "Zero-Cost" Architecture

Using freelm, you can build a highly available architecture without spending a dime.

  1. Register Everywhere: Sign up for free API keys at Google AI Studio, OpenRouter, Groq, and NVIDIA.
  2. Pool the Keys: Feed all these keys into your environment variables.
  3. Route via FreeLM: Use freelm as your central LLM client.
npm install freelm

The Quota-Aware Strategy

freelm includes a strategy="quota_aware" setting. This is the secret weapon for indie hackers.

Instead of just hammering your first provider until it breaks, freelm calculates the available quota across all your keys. If your Groq key is nearing its daily limit, it will smoothly start routing more traffic to your Gemini key.

It behaves like a financial portfolio manager, diversifying your API risk across multiple free providers.

Conclusion

You don't need venture capital to build an AI startup. You just need clever engineering. By pooling free resources with freelm, you can handle thousands of users per day before you ever have to enter a credit card.

Check out the code on GitHub and start bootstrapping your AI app today.

Keep reading
Shihab portraying Goku in an anime-inspired costume, keeping his own facial identity
The other lives of Shihab

01/ 08

The pursuit of better.

Goku — Dragon Ball

A training arc never really ends.

Personal cosplay artwork. Same face. A different world.Enter the six-form training arc ↗
A little energy from the whole world.
1 of 8