BenchGecko

Official9 tools

by BenchGecko · Shell

AI model prices per provider, benchmarks, own AI behavior tests and AI economy data, with sources.

ai.benchgecko/benchgecko — Model Context Protocol (MCP) Server

The ai.benchgecko/benchgecko MCP server provides AI model prices per provider, benchmark data, own AI behavior tests, and AI economy data. The published data includes sources, and the server is associated with the slug ai-benchgecko-benchgecko.

🛠️ Key Features

AI model prices per provider
Benchmarks
Own AI behavior tests
AI economy data
Includes sources

🚀 Use Cases

Compare model pricing across providers
Review benchmark results
Reference AI behavior test outcomes
Analyze AI economy data with cited sources

⚡ Developer Benefits

Structured access to prices, benchmarks, and test results
Source-backed data for evaluation and reporting

⚠️ Limitations

No additional capabilities (e.g., specific tools, authentication, or endpoints) are described in the provided data.

Topics

aibenchmarksdatasetsgpullmopen-datapricing

Captured live from the server via tools/list.

search_models

Find AI models in the BenchGecko catalog by name, slug or lab. Returns slugs to use with get_model, cheapest_provider and compare_models, with BenchGecko score and list price.

Parameters2

query	string	required	Model name, slug or lab, e.g. "claude opus", "gpt-5", "deepseek"
limit	integer	optional

Raw schema

{
  "type": "object",
  "properties": {
    "query": {
      "type": "string",
      "description": "Model name, slug or lab, e.g. \"claude opus\", \"gpt-5\", \"deepseek\""
    },
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 25,
      "default": 10
    }
  },
  "required": [
    "query"
  ]
}

get_model

Core facts for one AI model: BenchGecko score and rank, list price, price at every provider, benchmark scores with their original sources, Gecko Tests grades and as-of dates.

Parameters1

model

string

required

Model slug (from search_models) or name, e.g. "claude-opus-5-5"

Raw schema

{
  "type": "object",
  "properties": {
    "model": {
      "type": "string",
      "description": "Model slug (from search_models) or name, e.g. \"claude-opus-5-5\""
    }
  },
  "required": [
    "model"
  ]
}

cheapest_provider

Every provider serving a model, sorted by input price per 1M tokens (refreshed daily from provider endpoints), with output price, quantization and 1 day uptime.

Parameters1

model

string

required

Model slug or name

Raw schema

{
  "type": "object",
  "properties": {
    "model": {
      "type": "string",
      "description": "Model slug or name"
    }
  },
  "required": [
    "model"
  ]
}

compare_models

Side by side: BenchGecko score, list price, cheapest provider, context window, shared benchmark scores and Gecko Tests grades for two models.

Parameters2

a	string	required	First model slug or name
b	string	required	Second model slug or name

Raw schema

{
  "type": "object",
  "properties": {
    "a": {
      "type": "string",
      "description": "First model slug or name"
    },
    "b": {
      "type": "string",
      "description": "Second model slug or name"
    }
  },
  "required": [
    "a",
    "b"
  ]
}

get_gecko_test

Results of one of BenchGecko's own tests (own measurements, CC BY 4.0): who-are-you (Does the model know which lab made it?) world-map (How well does the model draw the world map from memory?) censorship-index (How often does the model refuse legitimate questions?) knowledge-horizon (Where does the model's knowledge of world events actually stop?) tokenizer-tax (How many more tokens does the same text cost outside English?) same-model-different-host (Do providers serving the same open model give the same quality?) model-drift-index (Do models quietly change behind the same name?)

Parameters2

test	string	required
limit	integer	optional	Rows in the text summary (structured result has all rows)

Raw schema

{
  "type": "object",
  "properties": {
    "test": {
      "type": "string",
      "enum": [
        "who-are-you",
        "world-map",
        "censorship-index",
        "knowledge-horizon",
        "tokenizer-tax",
        "same-model-different-host",
        "model-drift-index"
      ]
    },
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 100,
      "default": 20,
      "description": "Rows in the text summary (structured result has all rows)"
    }
  },
  "required": [
    "test"
  ]
}

get_scorecard

BenchGecko Gecko Scorecard: every model across BenchGecko's own profile tests with a letter grade per test and an overall Gecko Score (behavior, not intelligence).

Parameters1

limit

integer

optional

Raw schema

{
  "type": "object",
  "properties": {
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 100,
      "default": 15
    }
  }
}

latest_findings

Latest notable results detected in the Gecko Tests and price data (fixed rules, numbers and quotes from stored results).

Parameters1

limit

integer

optional

Raw schema

{
  "type": "object",
  "properties": {
    "limit": {
      "type": "integer",
      "minimum": 1,
      "maximum": 20,
      "default": 5
    }
  }
}

search

Search BenchGecko models and Gecko Tests. Returns ids for fetch.

Parameters1

query

string

required

Raw schema

{
  "type": "object",
  "properties": {
    "query": {
      "type": "string"
    }
  },
  "required": [
    "query"
  ]
}

fetch

Fetch the full record for an id returned by search (model:<slug>, gecko-test:<slug> or scorecard).

Parameters1

string

required

Raw schema

{
  "type": "object",
  "properties": {
    "id": {
      "type": "string"
    }
  },
  "required": [
    "id"
  ]
}

README.md2 KBView on GitHub

BenchGecko open datasets

Daily snapshots of the data BenchGecko collects and computes about the AI economy: model prices across providers, price changes, company figures with sources, developer attention (Mindshare), GPU rental prices and the results of BenchGecko's own model tests (Gecko Tests).

Files are refreshed every day by an automated job. Every day's version is in the git history, so the history of each file is a time series.

License

CC BY 4.0. Free to use, share and adapt, including commercially. Attribution required: "Source: BenchGecko" with a link to https://benchgecko.ai.

Cite as:

BenchGecko (2026). BenchGecko open datasets. https://github.com/BenchGecko/datasets · https://benchgecko.ai

Files

File	What it is	Source
`prices/price-history.csv`	Daily list price per model (USD per 1M tokens: input, output, cache read) since 2026-03-30	OpenRouter catalog, recorded daily
`prices/provider-offers.csv`	Every provider offer per model today: price, quantization, context, 1-day uptime	OpenRouter endpoints, daily
`prices/price-changes.csv`	Dated events: new models, price changes that held (5%+), company updates	Computed by BenchGecko
`companies/company-facts.csv`	Valuation, revenue, funding, headcount per AI company, each with as-of date and source URL when known	SEC filings, market close, press verified against the source page
`mindshare/mindshare-daily.csv`	Daily attention per model, lab, agent, person and topic: Hacker News mentions, Wikipedia views, GitHub stars, 7-day share	Hacker News Algolia API, Wikimedia, GitHub
`gpu/gpu-rental-daily.csv`	Median, 10th percentile and minimum on-demand rental price per GPU-hour for tracked AI chips	Vast.ai public marketplace
`gecko-tests/world-map.csv`	World Map test: land or water answers on a 6° grid per model, scored against Natural Earth	BenchGecko test runs
`gecko-tests/<test>.json`	Gecko Lab tests (who-are-you, tokenizer-tax, knowledge-horizon, same-model-different-host): questions, answer keys, every model answer and score	BenchGecko test runs

Methodology for each test: https://benchgecko.ai/gecko-tests

Benchmark scores aggregated from third-party leaderboards are not redistributed here; see each leaderboard's own license.

Questions or corrections

hello@benchgecko.ai

Install

Tools (9)

search_modelsget_modelcheapest_providercompare_modelsget_gecko_testget_scorecardlatest_findingssearch

Remote endpoint

Streamable HTTP

Hosted server - connect over the network, no local install.

url

https://benchgecko.ai/api/mcp

Add to VS Code Add to Cursor

claude_desktop_config.json

json

{
  "mcpServers": {
    "benchgecko": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://benchgecko.ai/api/mcp"
      ]
    }
  }
}

Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.

ai.benchgecko/benchgecko — Model Context Protocol (MCP) Server

🛠️ Key Features

🚀 Use Cases

⚡ Developer Benefits

⚠️ Limitations

Topics

search_models

get_model

cheapest_provider

compare_models

get_gecko_test

get_scorecard

latest_findings

search

fetch

BenchGecko open datasets

License

Files

Questions or corrections

Install

Remote endpoint

Related servers