io.github.shin-bot-litellm/litellm-mcp

Official

Give AI agents access to 100+ LLMs. Call any model, compare outputs.

Give agents access to 100+ language models with ability to call and compare outputs.

Install

Configuration

Environment variables

OPENAI_API_KEYsecret

OpenAI API key for GPT models

ANTHROPIC_API_KEYsecret

Anthropic API key for Claude models

claude_desktop_config.json

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<YOUR_OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>"
      }
    }
  }
}