GoAI Moat Web Scrape

Official2 tools

by jayniebingyu-cyber · Python

Scrape any URL into clean LLM-ready Markdown, or crawl a whole site.

com.goaimoat/web-scrape — Model Context Protocol (MCP) Server

The MCP server com.goaimoat/web-scrape provides functions to transform web content into clean, LLM-ready Markdown. It supports scraping a single URL and crawling an entire site, producing Markdown output from the source material.

🛠️ Key Features

Scrape any URL into clean LLM-ready Markdown
Crawl a whole site

🚀 Use Cases

Convert a specific webpage into Markdown for LLM consumption
Extract content across multiple pages in a site via crawling

⚡ Developer Benefits

Markdown output structured for downstream LLM use
Single-page and whole-site ingestion workflows

⚠️ Limitations

No additional capabilities, tooling count, or constraints were provided in the available server data.

Topics

ai-agentsb2b-datacompany-dataemail-finderlead-generationllm-toolsmcpmcp-servermodel-context-protocolweb-scraping

Captured live from the server via tools/list.

scrape_url

Scrape a URL into clean, LLM-ready Markdown.

Parameters3

url	string	required	The full URL to scrape (e.g. https://example.com/article).
email	string	optional
license_key	string	optional

Raw schema

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "The full URL to scrape (e.g. https://example.com/article)."
    },
    "email": {
      "default": "",
      "type": "string"
    },
    "license_key": {
      "default": "",
      "type": "string"
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

crawl_website

Crawl a website and return clean Markdown for each page.

Parameters4

url	string	required	The starting URL.
limit	integer	optional	Max pages to crawl (default 10).
email	string	optional
license_key	string	optional

Raw schema

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "The starting URL."
    },
    "limit": {
      "default": 10,
      "type": "integer",
      "description": "Max pages to crawl (default 10)."
    },
    "email": {
      "default": "",
      "type": "string"
    },
    "license_key": {
      "default": "",
      "type": "string"
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

README.md3 KBView on GitHub

GoAI Moat — MCP Servers

13 Model Context Protocol (MCP) servers that give AI agents the ability to audit "AI visibility", detect competitor AI adoption, and serve cross-border e-commerce teams. All listed under com.goaimoat/* on the official MCP Registry.

Being good is no longer enough — you have to be sayable by AI. These tools make that measurable.

Why

Buyers stopped searching — they ask AI. Being "cited by AI" is replacing "ranking #1":

65–68% of Google searches end without a click;
brands cited by AI earn ~35% more organic clicks and ~91% more paid clicks;
AI-referred visitors convert at 14.2% vs 2.8% for organic (≈5×).

The 13 servers

Server	Registry ID	What it does
AI Visibility Audit	`com.goaimoat/ai-visibility`	Score a brand's AI visibility 0-30 + 30-point checklist + fix priority
Competitor AI Signals	`com.goaimoat/competitor-signals`	7 public signals + TSI score to detect a company's quiet AI adoption
Market Intel Brief	`com.goaimoat/market-intel-brief`	Search a weekly verified cross-border × AI intelligence library
Decision-Maker Lookup	`com.goaimoat/decision-maker-lookup`	Find B2B decision makers and verify work emails
AI Content Studio	`com.goaimoat/content-studio`	Bilingual (EN/ZH) cross-border content generation
Brand Intel Memory	`com.goaimoat/brand-intel-memory`	Persistent business-intelligence memory for agents
Cross-border Profit	`com.goaimoat/cross-border-profit`	Calculate cross-border e-commerce cost & profit
Export Compliance	`com.goaimoat/export-compliance`	Export compliance checks (HS codes, restrictions)
IP Brand Protection	`com.goaimoat/ip-brand-protection`	Brand/IP protection guidance
Pricing Strategy	`com.goaimoat/pricing-strategy`	Pricing strategy for cross-border sellers
Product Selection	`com.goaimoat/product-selection`	Cross-border product selection research
Review Intelligence	`com.goaimoat/review-intelligence`	Customer review intelligence
Social Media Strategy	`com.goaimoat/social-media-strategy`	Social media strategy for brands

Architecture

Each server is a ~80-line FastMCP app over streamable HTTP:

python

from fastmcp import FastMCP
mcp = FastMCP(name="GoAI Moat — ...")

@mcp.tool()
def score_brand(brand: str, category: str) -> dict:
    """Score a brand's AI visibility 0-30 across 5 categories."""
    ...

mcp.run(transport="streamable-http", host="127.0.0.1", port=8000)

Open Core

The server code here is open source (MIT). The hosted endpoints and premium data are paid:

Hosted: point any MCP client at https://mcp.goaimoat.com/mcp (free tier = 1 audit/email).
Premium: unlimited audits + data reveal (decision-maker emails) via license — see goaimoat.com/mcp-catalog.html.

License

MIT — build on it, but the hosted service and proprietary data remain GoAI Moat's.

Install

Tools (2)

scrape_urlcrawl_website

Remote endpoint

Streamable HTTP

Hosted server - connect over the network, no local install.

url

https://scrape.mcp.goaimoat.com/mcp

Add to VS Code Add to Cursor

claude_desktop_config.json

json

{
  "mcpServers": {
    "web-scrape": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://scrape.mcp.goaimoat.com/mcp"
      ]
    }
  }
}

Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.