📌 tashfeenahmed/freellmapi — OpenAI-compatible proxy aggregating free(771 stars)

6 至 9 分鐘

1,471 個字元

📌 專案簡介 這是 GitHub 上一個備受關注的開源專案,致力於openai 相容代理 整合免費 API。該…

📌 專案簡介

這是 GitHub 上一個備受關注的開源專案,致力於openai 相容代理 整合免費 API。該專案目前已獲得 771 stars,受到開發者社群的廣泛關注。

🔑 主要特色

FreeLLMAPI

**One OpenAI-compatible endpoint. Fourteen free LLM providers. ~1.3B+ tokens per month.**

Aggregate the free tiers from Google, Groq, Cerebras, SambaNova, NVIDIA, Mistral, OpenRouter, GitHub Models, Hugging Face, Cohere, Cloudflare, Zhipu, Moonshot, and MiniMax behind a single `/v1/chat/completions` endpoint. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap.

![CI](https://github.com/tashfeenahmed/freellmapi/actions/workflows/ci.yml)

![License: MIT](./LICENSE)

![PRs Welcome](#contributing)

!Fallback chain with per-provider token budget

Contents

Why this exists

Every serious AI lab now offers a free tier — a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly **1.3 billion tokens per month** of working inference capacity, across dozens of models from small-and-fast to reasonably capable.

The problem is that stacking them by hand is painful: fourteen different SDKs, fourteen different rate limits, fourteen places a request can fail. FreeLLMAPI collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your loca

📦 安裝與使用

請參考官方 README 文件中的安裝說明。通常的安裝方式包括:

  • 克隆專案到本地
  • 按照 README 中的指示進行配置
  • 運行相關命令啟動專案

🔗 相關連結

💡 想了解更多開源 AI 專案?歡迎持續關注我們的更新!

「mosiwang」的個人頭像

發佈留言

發佈留言必須填寫的電子郵件地址不會公開。 必填欄位標示為 *