Web Hygiene MCP
· Official MCP Registry: io.github.Luca-003/web-hygiene-mcp
Remote MCP server (Streamable HTTP) that gives AI agents seven tools answering from the live web — never from a cache or the model's memory:
| Tool | What it does |
|---|
site_overview(site) | robots.txt (sitemaps declared, AI crawlers addressed, blanket disallow), llms.txt, sitemaps with URL count sample, feeds |
list_site_urls(site_or_sitemap, max_urls, include_regex, exclude_regex) | URLs a site publishes in its sitemaps, with lastmod (≤ 2,000) |
check_url(url) | HTTP status, full redirect chain, final URL, response time, content type |
check_links(urls | site_or_sitemap, max_urls, problems_only) | Bulk check: 404s, 5xx, timeouts, SSL errors, redirect chains, slow pages (≤ 300) |
discover_feeds(site) | RSS / Atom / JSON feeds of a website |
read_feed(feed_or_site, max_items, include_content) | Normalised feed items: title, link, date in UTC, author, summary, enclosures (≤ 100) |
verify_citations(text | urls | citations, check_archive, max_citations) | Per cited URL: verified / mismatch / not-found / redirected-home / paywalled / blocked …, real title/date/author, quote match evidence, Internet Archive copy for dead links (≤ 50) |
Connect
URL: https://bruco3--web-hygiene-mcp.apify.actor/mcp
Header: Authorization: Bearer <YOUR_APIFY_API_TOKEN>
Claude Desktop / Cursor / any Streamable HTTP client:
{
"mcpServers": {
"web-hygiene": {
"url": "https://bruco3--web-hygiene-mcp.apify.actor/mcp",
"headers": { "Authorization": "Bearer YOUR_APIFY_API_TOKEN" }
}
}
}
A free Apify account gives you an API token and $5 of monthly credits. Tool calls are billed pay-per-event to your Apify account: a check_url costs a fraction of a cent; verifying the 10 sources of an answer about two cents. No subscription, nothing to run.
Try it — three prompts
- "Check the sources in the answer you just gave me: does each link exist, and is the quote really on the page?" →
verify_citations
- "Before we cite anything from example.com, what does the site publish and allow?" →
site_overview
- "Check every link in this README and tell me which are broken or redirected." →
check_links
Claude Code: ready-made plugin with two skills — /plugin marketplace add Luca-003/web-hygiene-claude-plugin then /plugin install web-hygiene@luca-003 (repo).
Why
Language models are confident about links and sources they have never fetched. These tools let an agent look before it claims: verify a URL exists and where it leads, check robots.txt and llms.txt before quoting a site, read what a site really publishes, confirm a cited page carries the quoted passage.
Details, pricing, issues
Full documentation, pricing table and issue tracker: https://apify.com/bruco3/web-hygiene-mcp
Related Actors for whole-site / whole-document jobs: Sitemap URL Extractor · Broken Link Checker · Feed Monitor · Citation & Link Verifier
Legal
The tools request only public files sites publish for automated readers (sitemaps, feeds, robots.txt, llms.txt) and public pages you name, with a clear User-Agent. No personal data is collected or stored.
This repository holds the registry metadata (server.json) and documentation; the server runs on Apify.