Search your local screen recordings, audio transcripts, and computer activity from screenpipe.
The MCP server enables local multimodal search and control by indexing screen recordings, audio transcripts, and related computer activity. It supports private, local-first workflows and integrates with screenpipe for AI-assisted querying and automation.
๐ ๏ธ Key Features
Local MCP server for index-and-search across screen recordings, transcripts, and activity data
Multimodal discovery combining video, audio, and text sources
Privacy-forward, local-first operation to minimize cloud exposure
Integration-ready with Screenpipe ecosystem and related tools
๐ Use Cases
Fast local search of screen recordings and transcripts
AI-assisted navigation and control of a personal computer
Recalling past activities and events from multimedia logs
Privacy-respecting workflows for offline or on-device use
โก Developer Benefits
Clear MCP-based architecture for extensibility
Readme excerpt and repository-ready metadata for quick integration
Topics covering AI, ML, vision, speech, and local-first privacy
โ ๏ธ Limitations
Source material provides a high-level overview; specifics may vary by deployment
Requires local environment setup (NPX option noted in readmeExcerpt)
MCP server for screenpipe - search your screen recordings, audio transcriptions, and control your computer with AI.
Installation
Option 1: The screenpipe desktop app (Recommended)
The most reliable setup is to install the screenpipe desktop app
and connect Claude Desktop from Settings โ Connections (or during onboarding).
This writes a config that:
uses the bundled bun shipped with the app (an absolute path โ no Node/npx
or PATH dependency, and ~3ร faster cold start), and
injects your SCREENPIPE_LOCAL_API_KEY into the server's env, so the MCP
authenticates instantly instead of running slow key discovery at startup.
Both matter: a config without the key forces the server to discover it via
subprocess fallbacks, which on a cold package cache can stall Claude Desktop's MCP
startup and produce Could not attach to MCP server screenpipe.
Option 2: Manual NPX (no desktop app)
If you're not using the desktop app, edit your Claude Desktop config:
Requires Node/npx on PATH. Pin @latest so the first install doesn't cache a
stale version forever. Get your key with screenpipe auth token. If you omit the
key, the server will try to discover it (bundled bun โ npx โ local DB) โ this works
but is slower and can time out on first run.
Enterprise admins: add SCREENPIPE_ENTERPRISE_TOKEN (and, for orgs running their
own query gateway, SCREENPIPE_TEAM_API_URL) to the same env block to get the
team-* tools โ see Enterprise team tools.
Option 3: HTTP Server (Remote / Network Access)
The MCP server can run over HTTP using the Streamable HTTP transport, allowing remote MCP clients to connect over the network instead of stdio. This is ideal when your AI assistant (e.g., OpenClaw) runs on a different machine than screenpipe.
bash
# loopback only (default)
npx -y screenpipe-mcp --http --port 3031
# expose to your LAN with bearer auth
npx -y screenpipe-mcp --http --listen-on-lan --api-key $(openssl rand -hex 16)
# or from source โ must build first so dist/ exists
bun install && bun run build
bun run start:http -- --port 3031
Tip: npx screenpipe-mcp-http (without --http) does not work โ
npm resolves by package name, and there is no screenpipe-mcp-http
package. The HTTP server ships as a transport inside the
screenpipe-mcp package; use --http as shown above, or invoke the
bin directly with npx -p screenpipe-mcp screenpipe-mcp-http.
The server exposes:
MCP endpoint: http://localhost:3031/mcp โ Streamable HTTP transport (POST for requests, GET for SSE stream)
Health check: http://localhost:3031/health โ always unauthenticated, for monitors
Options:
Flag
Description
Default
--port
Port for the MCP HTTP server
3031
--screenpipe-port
Port where screenpipe API is running
3030
--listen-on-lan
Bind 0.0.0.0 so other devices on the LAN can connect. Requires --api-key.
If your machines are on different networks, expose port 3031 via Tailscale, SSH tunnel, or similar โ see the OpenClaw integration guide for detailed examples.
Note: The HTTP server currently exposes search_content only. The stdio server has the full tool set (export-video, list-meetings, activity-summary, search-elements, frame-context). We're working on bringing HTTP to full parity.
Option 4: From Source
Clone and build from source:
bash
git clone https://github.com/screenpipe/screenpipe
cd screenpipe/packages/screenpipe-mcp
bun install
bun run build
Note: Restart Claude Desktop after making changes.
Enterprise team tools (team-*)
team-search, team-devices and team-records query your whole org instead of
just this machine. They are registered only when an enterprise admin token is
present, and they need two independent settings: a token, and the base URL of
the API that token is valid for.
1. The token
An sk_ent_โฆ enterprise admin token, resolved in this order:
SCREENPIPE_ENTERPRISE_TOKEN env var (MCP config, terminal)
team_api_token in ~/.screenpipe/enterprise.json โ written by the desktop
app's Settings โ Privacy โ Admin Team API Token
No token โ the team-* tools do not appear at all.
Trailing slashes are trimmed, so both โฆ/v1 and โฆ/v1/ work.
If your org runs its own query gateway, you must set this. On the write-only
archive tier your telemetry never reaches the hosted API โ it lands in your own
object storage and is served by a gateway inside your network. The hosted API has
no read path to that data, so leaving the default in place makes every team-*
call fail with HTTP 401, even though the tools show up and the token is valid.
The bearer token is the same either way; only the base URL moves.
Verify which base a running server picked up by asking for team-devices โ the
error text on a missing token also prints the base currently in use.
Known limits
Requires screenpipe-mcp >= 0.19.0.0.18.15 and earlier hardcode the
hosted base and cannot be repointed at a gateway at all. Check with
npm view screenpipe-mcp version, or read serverInfo.version from the MCP
initialize response.
Priority 3 is populated by the desktop app, which writes gateway_url from
the org's policy poll. It needs an admin signed in on that machine; on a
server or CI box use the env var or the flag.
The HTTP transport (--http) exposes search_content only; team-* tools are
stdio-only.
The .mcpb bundle (Claude Desktop extension install) has no UI for these
variables โ use the manual NPX config above for gateway orgs.
Search through recorded content with content type filtering:
all โ OCR + Audio + Accessibility (default)
ocr โ Screen text from screenshots
audio โ Audio transcriptions
input โ User actions (clicks, keystrokes, clipboard, app switches)
accessibility โ Accessibility tree text
parsed โ Compact app-specific messages, emails, tasks, documents, and code review (experimental; may be empty when parsing is disabled or unsupported)
Time range, app/window, and speaker filtering
Parsed data can also be filtered by frame_id or resolved actor_id
Pagination support
export-video
Export screen recordings as video files:
Specify time range with start/end times
Configurable FPS for output video
activity-summary
Get a lightweight compressed activity overview for a time range:
App usage with active minutes and frame counts
Recent accessibility texts
Audio speaker summary
list-meetings
List detected meetings with id, duration, app, attendees, and note snippet. Pass q to filter by substring (title, attendees, notes) โ q searches all meeting history, so omit the time range when looking for a person or topic. Follow up with get-meeting (optionally include_transcript: true) for the full note and speaker-attributed transcript.
search-elements
Search structured UI elements (accessibility tree nodes and OCR text blocks):
Filter by source, role, app, time range
Much lighter than search-content for targeted UI lookups
Returns a compact outline view by default โ a deduped, indented tree of the
text-bearing nodes (#id refs, (off-screen) flags), ~91% fewer tokens than
raw element JSON
Pass purpose: "automation" for automation targeting context with response-local
refs, best-effort stable keys, state, bounds, and allowed actions. Refresh it
before each action; historical database ids are not live control handles.
computer-use remains a legacy alias.
If purpose is omitted, the MCP follows the desktop AI context use setting.
The backward-compatible default remains the read/memory outline.
get-frame-elements
The whole element tree for one frame, as the same compact outline. Pass
purpose: "automation" for the automation targeting view.
frame-context
Get accessibility text, parsed tree nodes, and extracted URLs for a specific frame.
keyword-search
Fast FTS5 keyword search across OCR + audio combined. Returns matches with frame_id, app, timestamp, and text positions.
Manage the meeting store. list-meetings filters by substring; get-meeting returns title/attendees/times/full note (add include_transcript: true for the speaker-attributed transcript). update-meeting writes only the fields you pass. start-meeting and stop-meeting drive manual meeting recording sessions.
Speaker identification workflow. Search by name prefix, list speakers that haven't been named yet, rename a speaker, or merge two speakers when the same person was detected as different ones.
add-tags
Tag a screen frame (vision) or audio chunk (audio) so it can be retrieved later.
update-memory
Create, update, or delete a persistent memory (facts, preferences, decisions the user wants to remember).
send-notification
Send a notification to the screenpipe desktop UI.
control-recording
Start or stop audio recording. This does not pause or resume screen capture.
health-check
Check if screenpipe is running and healthy. Returns recording status, frame/audio stats, and timestamps.
list-audio-devices
List available audio input/output devices for recording.
list-monitors
List available monitors/screens for capture.
list-pipes / create-pipe / run-pipe / pipe-logs
Manage pipes โ scheduled AI automations that run a markdown prompt on a schedule (e.g. "every day at 9am"). list-pipes shows enabled state + schedule; create-pipe creates one; run-pipe triggers a one-off test run; pipe-logs fetches recent execution output.
team-search / team-devices / team-records
Team-tier tools, registered only when an enterprise admin token is configured. team-search runs substring search across the entire org's telemetry, team-devices lists enrolled devices (hostname, OS), and team-records dumps chronological frame, parsed-app, or audio data for a time window. Orgs running their own query gateway must also set SCREENPIPE_TEAM_API_URL โ see Enterprise team tools for the full precedence order.
Example Queries in Claude
"Search for any mentions of 'rust' in my screen recordings"
"Find audio transcriptions from the last hour"
"Show me what was on my screen in VSCode yesterday"
"Export a video of my screen from 2-3pm today"
"Find what John said in our meeting about the database"
"What did I type in Slack today?" (uses content_type=input)
"What did I copy to clipboard recently?" (uses content_type=input)
"Show me accessibility text from Chrome" (uses content_type=accessibility)
Requirements
screenpipe must be running on localhost:3030
Node.js >= 18.0.0
Notes
All timestamps are handled in UTC
Results are formatted for readability in Claude's interface
macOS automation features require accessibility permissions
The MCP tools already return compact, readable text (the element tools follow the desktop capture profile unless the caller sets a purpose). If you instead call the underlying screenpipe REST API directly (e.g. via curl), the list endpoints (/search, /elements, /frames/{id}/elements) accept ?format=csv|tsv for a columnar table (column names written once) and ?fields=a,b,c to select only the columns you need (dotted paths like content.text); the element endpoints also accept ?format=outline (~91% fewer tokens than JSON) or ?format=automation for fresh refs, best-effort keys, actions, state, and bounds. On list-shaped results that is a 70โ91% token cut versus the default JSON, which stays unchanged when no param is set.
Privacy Policy
The Screenpipe MCP server is a local-only bridge between Claude and your
local Screenpipe instance. It does not collect, transmit, or store tool
results, recordings, OCR text, audio transcripts, screenshots, or UI events
on its own.
What this MCP server does
When Claude invokes a tool (search-content, activity-summary, etc.)
the MCP server forwards the request to http://localhost:3030 โ the
Screenpipe daemon running on your machine โ and returns the response.
That's the entire data path.
Data collection
The MCP server sends privacy-preserving crash and error reports to Screenpipe's
Sentry project so we can diagnose startup failures like "server disconnected"
or "could not attach to MCP server". These reports include the MCP package
version, runtime, transport mode, and sanitized exception details. They do not
include tool arguments, tool results, screen content, audio, transcripts,
screenshots, API tokens, or your home-directory path.
To disable crash/error reporting, set any of:
SCREENPIPE_MCP_SENTRY_DISABLED=1, SCREENPIPE_TELEMETRY_DISABLED=1, or
SCREENPIPE_DISABLE_TELEMETRY=1 in the MCP launch environment.
Data usage
Tool calls are passed straight through to your local Screenpipe daemon
and the results stream back to Claude. The MCP server doesn't keep
anything.
Data storage
Nothing is stored by the MCP server itself. Recordings, OCR text,
audio transcripts, and UI events are stored by the Screenpipe app in a
SQLite database under ~/.screenpipe/ on your device. Retention is
whatever you configure inside the Screenpipe app โ typically you
control it via the storage settings panel.
Third-party sharing
The MCP server talks to localhost:3030 for tool calls and to Screenpipe's
Sentry project for sanitized crash/error reports unless disabled as above.
It does not contact Anthropic or send recorded content to Screenpipe's servers.
If you choose to enable optional cloud features inside the Screenpipe
app itself (e.g. cloud sync, cloud AI), those are governed by the
Screenpipe app's privacy policy, not this MCP server's data flow.
Retention
The MCP server has no persistent state. The data your Screenpipe app
captures is retained according to your Screenpipe storage configuration
and is deletable at any time (rm -rf ~/.screenpipe removes everything).