Web Scraping MCP Server
Official3 toolsby thenextgennexus
Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.
Crawl URLs and extract HTML content from any website.
Captured live from the server via tools/list.
crawl_website
Crawl a website and extract its content as structured data. Args: url: Website URL to crawl (e.g. 'https://example.com') max_pages: Max pages to crawl (default 5)
Parameters (2)
- urlstringrequired
- max_pagesinteger
google_search
Search Google and return organic results with titles, URLs, snippets. Args: query: Search query (e.g. 'best python libraries 2026') max_results: Max results (default 10)
Parameters (2)
- querystringrequired
- max_resultsinteger
wikipedia_lookup
Look up a Wikipedia article and return its content. Args: topic: Topic to look up (e.g. 'Artificial intelligence')
Parameters (1)
- topicstringrequired
README not available yet.
Install
Remote endpoint
Streamable HTTPHosted server - connect over the network, no local install.
https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcpclaude_desktop_config.json
{
"mcpServers": {
"web-scraping-mcp-server": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
]
}
}
}Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.