Agentโ™ฅ๏ธŽAge
Catalog

Iris

Official

by iris-eval ยท TypeScript

Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.

Iris Eval MCP Server

The io.github.iris-eval/mcp-server is an MCP server that evaluates AI agent outputs by scoring them for quality, safety, and cost. Its scope is agent evaluation using Model Context Protocol integration, with topics covering evaluation, security, and observability/tracing.

๐Ÿ› ๏ธ Key Features

  • Scores agent output for quality
  • Scores agent output for safety
  • Scores agent output for cost
  • Aligns with Model Context Protocol (MCP) for tooling integration

๐Ÿš€ Use Cases

  • Evaluate agent responses against quality criteria
  • Check agent behavior for safety concerns
  • Measure/compare agent runs by cost
  • Integrate evaluation into MCP-based workflows

โšก Developer Benefits

  • Adds evaluation-focused observability via evaluation, observability, and tracing topics
  • Uses an MCP server to standardize agent scoring across tools

โš ๏ธ Limitations

  • Description does not specify supported model providers, scoring methods, or available evaluation result formats beyond the three score dimensions (quality, safety, cost)

Topics

agent-evaluationai-agentclaudeevalllmmcpmcp-servermodel-context-protocolobservabilitytracingevaluationsecurity