Scrapiq MCP Server
MCP server for Scrapiq — turn any URL into clean text, markdown, or JSON for LLM/RAG pipelines, directly from your MCP client.
Scrapiq is a lightweight open-source HTTP API that fetches a web page and returns clean content — boilerplate stripped. This server exposes it as a Model Context Protocol (MCP) tool so Claude Desktop, Cursor, and any MCP client can extract clean web content with one call.
Dependency-free: pure Python stdlib, no pip packages, no node_modules. Two transports: stdio for local clients, streamable HTTP for remote clients.
Use the hosted server (no install)
The server is listed in the official MCP Registry as io.scrapiq/scrapiq and runs at:
No key, no install — add that URL as a remote MCP server in any client that supports streamable HTTP:
{
"mcpServers": {
"scrapiq": { "url": "https://scrapiq.io/mcp" }
}
}
Install locally
Not on PyPI yet, so install straight from this repo:
uvx --from git+https://github.com/NG-PR0JECT/scrapiq-mcp-server scrapiq-mcp
pipx install git+https://github.com/NG-PR0JECT/scrapiq-mcp-server
Requires a running Scrapiq instance (see Scrapiq README — git clone, pip install -e ".[dev]", then scrapiq). Point the server at it:
SCRAPIQ_ENDPOINT=http://localhost:8001/v1/extract scrapiq-mcp
Run your own HTTP endpoint
scrapiq-mcp --http --host 127.0.0.1 --port 8002
Stateless: one POST /mcp per JSON-RPC message (or batch), replies with application/json. It issues no Mcp-Session-Id and offers no server→client SSE stream, so GET /mcp answers 405 by design. CORS is open, so browser-based clients (e.g. MCP Inspector) can call it directly.
Usage with Claude Desktop
Add to claude_desktop_config.json:
{
"mcpServers": {
"scrapiq": {
"command": "scrapiq-mcp",
"env": { "SCRAPIQ_ENDPOINT": "http://localhost:8001/v1/extract" }
}
}
}
Extract a web page into clean structured content.
Arguments:
url (string, required) — the URL to extract
format (string, optional) — "markdown" (default) | "text" | "json"
max_chars (integer, optional) — truncate content to N chars
Example:
scrapiq_extract(url="https://en.wikipedia.org/wiki/Retrieval-augmented_generation", format="markdown")
Returns title, content, links, and metadata — no ads, no nav, no scripts.
Test the server
printf '%s\n' \
'{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2024-11-05"}}' \
'{"jsonrpc":"2.0","id":2,"method":"tools/list"}' \
'{"jsonrpc":"2.0","id":3,"method":"tools/call","params":{"name":"scrapiq_extract","arguments":{"url":"https://example.com","format":"text"}}}' \
| scrapiq-mcp
License
MIT