freelm.

freelm is an open-source Python and Node.js gateway that pools free-tier LLM providers behind one fault-tolerant, OpenAI-compatible call.

freelm is an open-source gateway that pools six free-tier LLM providers—OpenRouter, Google AI Studio (Gemini), NVIDIA NIM, Groq, Cerebras, and Mistral—behind one fault-tolerant, OpenAI-compatible call. It handles automatic failover, circuit breaking, rate-limit awareness, and live free-model discovery. Available on PyPI and npm.

• 01

  Combine OpenRouter, Gemini, NIM, Groq, Cerebras, and Mistral

• 02

  Automatic Failover across keys and providers

• 03

  Drop-in OpenAI API shim (`freelm.compat.OpenAI`)

• 04

  Available for Python (PyPI) and Node.js/TypeScript (npm)