io.github.lazymac2x/llm-output-quality-monitor

Official5 toolsLive

by lazymac2x

Cloudflare Workers MCP server: llm-output-quality-monitor

io.github.lazymac2x/llm-output-quality-monitor (Cloudflare Workers MCP)

Cloudflare Workers MCP server named llm-output-quality-monitor. It provides both REST and MCP via JSON-RPC 2.0, and is associated with the live endpoint api.lazy-mac.com/llm-output-quality-monitor. The server description is Cloudflare Workers MCP server: llm-output-quality-monitor.

🛠️ Key Features

Supports REST and MCP (JSON-RPC 2.0)
Deployed as a Cloudflare Workers service

🚀 Use Cases

Monitor or evaluate “LLM output quality” through the provided MCP/REST interfaces

⚡ Developer Benefits

Uses JSON-RPC 2.0 for MCP integration
Offers a REST interface alongside MCP access
Live base URL: api.lazy-mac.com/llm-output-quality-monitor

⚠️ Limitations

Only the existence of 5 tools is indicated (toolCount: 5); specific tools and capabilities are not provided here

Captured live from the server via tools/list.

quality_validator

Validate LLM response quality based on length, format, and structure

Parameters4

response	string	required	LLM response to validate
minLength	number	optional	Minimum response length (default: 10)
maxLength	number	optional	Maximum response length (default: 10000)
strictFormat	boolean	optional	Enforce punctuation and capitalization

Raw schema

{
  "type": "object",
  "properties": {
    "response": {
      "type": "string",
      "description": "LLM response to validate"
    },
    "minLength": {
      "type": "number",
      "description": "Minimum response length (default: 10)"
    },
    "maxLength": {
      "type": "number",
      "description": "Maximum response length (default: 10000)"
    },
    "strictFormat": {
      "type": "boolean",
      "description": "Enforce punctuation and capitalization"
    }
  },
  "required": [
    "response"
  ]
}

drift_detector

Detect quality drift between current and previous LLM responses

Parameters3

currentResponse	string	required	Current LLM response
previousResponse	string	required	Previous LLM response
threshold	number	optional	Drift threshold (0-1, default: 0.15)

Raw schema

{
  "type": "object",
  "properties": {
    "currentResponse": {
      "type": "string",
      "description": "Current LLM response"
    },
    "previousResponse": {
      "type": "string",
      "description": "Previous LLM response"
    },
    "threshold": {
      "type": "number",
      "description": "Drift threshold (0-1, default: 0.15)"
    }
  },
  "required": [
    "currentResponse",
    "previousResponse"
  ]
}

hallucination_scorer

Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination detector.

Parameters2

response	string	required	LLM response to analyze
context	string	optional	Reference context for grounding

Raw schema

{
  "type": "object",
  "properties": {
    "response": {
      "type": "string",
      "description": "LLM response to analyze"
    },
    "context": {
      "type": "string",
      "description": "Reference context for grounding"
    }
  },
  "required": [
    "response"
  ]
}

schema_enforcer

Validate JSON response against schema

Parameters2

response	string	required	JSON response to validate
schema	object	required	JSON schema definition

Raw schema

{
  "type": "object",
  "properties": {
    "response": {
      "type": "string",
      "description": "JSON response to validate"
    },
    "schema": {
      "type": "object",
      "description": "JSON schema definition"
    }
  },
  "required": [
    "response",
    "schema"
  ]
}

consistency_check

Check consistency across multiple LLM responses

Parameters1

responses

array

required

Array of responses to compare

Raw schema

{
  "type": "object",
  "properties": {
    "responses": {
      "type": "array",
      "items": {
        "type": "string"
      },
      "description": "Array of responses to compare"
    }
  },
  "required": [
    "responses"
  ]
}

Install

Tools (5)

quality_validatordrift_detectorhallucination_scorerschema_enforcerconsistency_check

Remote endpoint

Streamable HTTP

Hosted server - connect over the network, no local install.

url

https://api.lazy-mac.com/llm-output-quality-monitor/mcp

Add to VS Code Add to Cursor

claude_desktop_config.json

json

{
  "mcpServers": {
    "llm-output-quality-monitor": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
      ]
    }
  }
}

Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.

io.github.lazymac2x/llm-output-quality-monitor

io.github.lazymac2x/llm-output-quality-monitor (Cloudflare Workers MCP)

🛠️ Key Features

🚀 Use Cases

⚡ Developer Benefits

⚠️ Limitations

quality_validator

drift_detector

hallucination_scorer

schema_enforcer

consistency_check

llm-output-quality-monitor-api

Install

Remote endpoint

Related servers