← All projects
ContactResume
Project

never429

One endpoint for five free LLM tiers

An OpenAI-compatible gateway you deploy to your own Cloudflare account. It fronts the free tiers of Groq, Gemini, Cerebras, Mistral and OpenRouter with your keys, and when one provider rate-limits you, the request moves to the next configured provider. Free-tier models and quotas vary by provider and can change.

PythonCloudflare WorkersOpenAI-compatibleEdge cacheLLM
scroll
Overview

What it is

never429 is a single Python Cloudflare Worker that sits in front of the free tiers of several LLM providers. You point any OpenAI-compatible client at it, and it routes each request to a healthy provider and key: on a 429, auth error, timeout or 5xx it moves the request to the next configured provider or key, surfacing an error only when every option is cooling down or capped. Responses are cached at the edge, and optional daily budget caps stop you from burning a provider's daily quota. It runs entirely on Cloudflare's free tier - no server, no Docker, no bill.

Automatic failover

On 429s, auth errors, timeouts and 5xx, the request moves to the next configured provider or key. Response headers show which one answered.

Multi-key rotation

Several keys per provider, with per-key cooldowns that honor the provider's Retry-After header.

Edge response cache

Repeat prompts are served straight from Cloudflare's edge, skipping the provider entirely.

Daily budget caps

Optional per-provider daily caps stop a busy day from exhausting a free tier's quota.

Observable

/v1/models and /v1/usage report usage and which keys are cooling down, in one call.

Also an agent skill

The failover core is packaged separately as a portable SKILL.md agent skill with a dependency-free CLI.

Flow

How it works

Route

An OpenAI-compatible request hits the Worker, which picks the first healthy provider and key.

Fail over

On a rate limit or error, that key cools down and the request moves to the next key or provider.

Observe

Headers and /v1/usage show which provider answered, cache hits and cooling-down keys.

Pure-Python Cloudflare Worker. 45 tests and green CI in the repo; the live demo runs on Cloudflare's free tier and can trail the latest commits.

Run it

git clone https://github.com/Prajit-22/never429.git cd never429 npx wrangler secret put GROQ_API_KEY uv run pywrangler deploy
Next projectragkit →