Agent♥︎Age
Catalog

Octocrawl

Official2 toolsLive

by 77777R7 · TypeScript

Pages, crawls and URL batches as clean Markdown and JSON for AI agents, with an Evidence Record.

io.github.77777R7/octocrawl — Model Context Protocol (MCP) Server

The MCP server io.github.77777R7/octocrawl provides a web scraping capability for agents. It is designed to report blocked, empty, and wrong pages as such, rather than treating them as valid results. Scraping outcomes are captured with an Evidence Record.

🛠️ Key Features

  • Web scraping for agents
  • Explicit reporting for blocked pages
  • Explicit reporting for empty pages
  • Explicit reporting for wrong pages
  • Uses an Evidence Record to store scraping evidence

🚀 Use Cases

  • Agent workflows that need verified page retrieval
  • Automated content fetching with failure categorization (blocked/empty/wrong)

⚡ Developer Benefits

  • Clear classification of scrape failures
  • Evidence Record support for auditing and traceability of scraping results

⚠️ Limitations

  • Scope is limited to reporting blocked, empty, and wrong pages; additional behaviors are not described in the provided data

Topics

ai-agentscrawlerdata-extractionfirecrawl-alternativehtml-to-markdownllmmarkdownmcpmcp-servermodel-context-protocolpythonragscrapertypescriptweb-crawlerweb-scrapingclaude-codeurl-to-markdownweb-scraping-mcp