ai-eval-api
Cloudflare Workers MCP server: ai-eval. REST + MCP (JSON-RPC 2.0). Live: api.lazy-mac.com/ai-eval
Catalog
io.github.lazymac2x/ai-eval
Official3 toolsby lazymac2x
Cloudflare Workers MCP server: ai-eval
Evaluates and benchmarks AI model outputs and performance metrics.
Captured live from the server via tools/list.
score_response
Score an AI response against a prompt using heuristic metrics (length, relevance, structure, completeness)
Parameters (3)
- promptstringrequired
The original prompt/question
- responsestringrequired
The AI response to evaluate
- criteriaarray
Optional keywords that should appear in response
compare_responses
Compare and rank multiple AI responses to the same prompt
Parameters (2)
- promptstringrequired
- responsesarrayrequired
text_metrics
Get text quality metrics: word count, sentence count, estimated tokens, readability grade
Parameters (1)
- textstringrequired
Install
claude_desktop_config.json
{
"mcpServers": {
"ai-eval": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://api.lazy-mac.com/ai-eval/mcp"
]
}
}
}Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.