llm-output-quality-monitor-api
Cloudflare Workers MCP server: llm-output-quality-monitor. REST + MCP (JSON-RPC 2.0). Live: api.lazy-mac.com/llm-output-quality-monitor
Catalog
io.github.lazymac2x/llm-output-quality-monitor
Official5 toolsby lazymac2x
Cloudflare Workers MCP server: llm-output-quality-monitor
Monitors and measures the quality of language model outputs.
Captured live from the server via tools/list.
quality_validator
Validate LLM response quality based on length, format, and structure
Parameters (4)
- responsestringrequired
LLM response to validate
- minLengthnumber
Minimum response length (default: 10)
- maxLengthnumber
Maximum response length (default: 10000)
- strictFormatboolean
Enforce punctuation and capitalization
drift_detector
Detect quality drift between current and previous LLM responses
Parameters (3)
- currentResponsestringrequired
Current LLM response
- previousResponsestringrequired
Previous LLM response
- thresholdnumber
Drift threshold (0-1, default: 0.15)
hallucination_scorer
Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination detector.
Parameters (2)
- responsestringrequired
LLM response to analyze
- contextstring
Reference context for grounding
schema_enforcer
Validate JSON response against schema
Parameters (2)
- responsestringrequired
JSON response to validate
- schemaobjectrequired
JSON schema definition
consistency_check
Check consistency across multiple LLM responses
Parameters (1)
- responsesarrayrequired
Array of responses to compare
Install
claude_desktop_config.json
{
"mcpServers": {
"llm-output-quality-monitor": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
]
}
}
}Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.