Agent♥︎Age
Catalog

com.agishub/web-scraper

Official

by agishub · TypeScript

Web scraper for agents: fetch any URL as clean markdown (headings, links). x402 for JS rendering.

Model Context Protocol (MCP) Server: com.agishub/web-scraper

The com.agishub/web-scraper MCP server provides web scraping capabilities for agents by fetching a specified URL and converting the content into clean Markdown. Output includes structured elements such as headings and links. It also supports JavaScript rendering via the x402 option.

🛠️ Key Features

  • Fetches any provided URL
  • Converts page content into clean Markdown
  • Preserves headings and links in the extracted output
  • Supports JS rendering using x402

🚀 Use Cases

  • Extracting web page content for agent context
  • Converting HTML pages into Markdown for downstream processing
  • Capturing readable document structure (headings) and navigation references (links)

⚡ Developer Benefits

  • Agent-friendly text format (Markdown) for context injection
  • Consistent structure with headings and links preserved
  • Optional JS rendering support for dynamic pages

Topics

aiai-agentsbasellmmcpmcp-serverusdcx402
com.agishub/web-scraper - agentage MCP Catalog