Scrapeer MCP Server
Allows AI agents to run, inspect, and create Scrapeer visual web-scraping flows, bridging human-designed browser automation with agent-driven execution.
README
<p align="center"> <a href="https://www.scrapeer.com"> <img src="assets/scrapeer-logo.svg" alt="Scrapeer logo" width="96" /> </a> </p>
<h1 align="center">Scrapeer MCP Server</h1>
<p align="center"> Run Scrapeer visual web-scraping flows from Claude Code, Codex, Cursor, and VS Code Copilot. </p>
Scrapeer is a visual browser automation and web scraping platform for people who do not want to write scrapers from scratch. Build deterministic scraping workflows in a drag-and-drop editor, watch the browser run step by step, then run those same flows locally or in Scrapeer's cloud.
This MCP server connects AI agents to Scrapeer so they can:
- run saved scraping flows and retrieve structured results
- inspect flow definitions, block configs, execution steps, and run history
- create or patch flows using Scrapeer's block catalog and validation APIs
- check account credits and cancel active cloud runs
The result is a useful split of responsibilities: humans design reliable browser workflows in Scrapeer, and agents can trigger, monitor, debug, and extend those workflows through MCP.
<p align="center"> <img src="assets/scrapeer-product-screenshot.webp" alt="Scrapeer visual flow editor with live browser execution" width="900" /> </p>
Why Scrapeer
Scrapeer is built for glass-box scraping: you can see exactly what the scraper does, inspect each block's output, and fix the workflow when a site changes. Instead of asking an agent to improvise browser steps every time, Scrapeer gives agents a reliable set of saved, validated workflows they can run on demand.
Quick Start
Create a Scrapeer API key at https://app.scrapeer.com/settings#security, then add the server to your MCP client. These examples use npx so users do not need to install the package globally.
Claude Code (.mcp.json)
For a project-scoped Claude Code config, create .mcp.json in the project root:
{
"mcpServers": {
"scrapeer": {
"command": "npx",
"args": ["-y", "@scrapeer/mcp-server"],
"env": { "SCRAPEER_API_KEY": "sk_..." }
}
}
}
For a private user-scoped config, run claude mcp add --scope user --env SCRAPEER_API_KEY=sk_... scrapeer -- npx -y @scrapeer/mcp-server so Claude writes the correct ~/.claude.json entry for your machine.
Codex CLI and IDE extension (~/.codex/config.toml)
[mcp_servers.scrapeer]
command = "npx"
args = ["-y", "@scrapeer/mcp-server"]
[mcp_servers.scrapeer.env]
SCRAPEER_API_KEY = "sk_..."
Cursor (~/.cursor/mcp.json or .cursor/mcp.json)
{
"mcpServers": {
"scrapeer": {
"type": "stdio",
"command": "npx",
"args": ["-y", "@scrapeer/mcp-server"],
"env": { "SCRAPEER_API_KEY": "sk_..." }
}
}
}
VS Code Copilot (.vscode/mcp.json)
{
"servers": {
"scrapeer": {
"type": "stdio",
"command": "npx",
"args": ["-y", "@scrapeer/mcp-server"],
"env": { "SCRAPEER_API_KEY": "sk_..." }
}
}
}
Available Tools
Read
| Tool | Description |
|---|---|
scrapeer_list_flows |
List your saved scraping flows |
scrapeer_get_flow |
Get details about a specific flow |
scrapeer_get_block_catalog |
List the block types available for use in flows, with their custom-field schemas. Call this before any create/update/patch; guessing types or config keys leads to validation failures |
scrapeer_validate_flow |
Dry-run validate a flow JSON without saving |
scrapeer_get_account |
Account info: credit balance, subscription plan, cloud-run availability |
Run
| Tool | Description |
|---|---|
scrapeer_run_flow |
Trigger a cloud run and return immediately with an execution ID |
scrapeer_run_flow_and_wait |
Run a flow and poll until results are ready (recommended) |
scrapeer_get_run_status |
Check the status of a running or completed execution |
scrapeer_get_run_results |
Get structured output data from a completed run |
scrapeer_get_run_steps |
Get block-by-block execution breakdown (useful for debugging failures) |
scrapeer_list_runs |
List execution history, with optional filtering by status or flow |
scrapeer_cancel_run |
Cancel an active cloud execution |
Mutate
| Tool | Description |
|---|---|
scrapeer_create_flow |
Create a new (empty) flow with the given title |
scrapeer_update_flow |
Replace a flow's entire definition (whole-flow overwrite). Prefer scrapeer_patch_flow for incremental edits |
scrapeer_patch_flow |
Apply granular patch operations: add_block, update_block_custom, remove_block, add_edge, remove_edge |
Building flows: recommended sequence
The mutation tools enforce optimistic concurrency. Every save sends the version stamp the caller saw on its last read, and the gateway rejects stale writes with 409 so concurrent edits from a human in the editor and an LLM via MCP cannot silently overwrite each other. The MCP server tracks this version stamp automatically across calls in the same session, so the LLM does not have to manage it manually.
Typical sequences:
Create from scratch:
scrapeer_get_block_catalog -> learn valid block types
scrapeer_create_flow -> returns flow_id (event_id cached)
scrapeer_patch_flow flow_id [...] -> add_block ops; cache -> baseProjectEventID
Modify an existing flow:
scrapeer_get_block_catalog -> learn valid block types
scrapeer_get_flow flow_id -> caches the current event_id
scrapeer_validate_flow {...} -> optional dry-run before commit
scrapeer_patch_flow flow_id [...] -> uses cached event_id automatically
If a 409 fires, the cached event_id is invalidated automatically. Re-call scrapeer_get_flow and retry the mutation.
Configuration
| Variable | Required | Default | Description |
|---|---|---|---|
SCRAPEER_API_KEY |
Yes | - | API key from app.scrapeer.com/settings |
Development
pnpm install
pnpm test
pnpm run build
Tests use msw to mock the Scrapeer API. No real credentials are needed.
推荐服务器
Baidu Map
百度地图核心API现已全面兼容MCP协议,是国内首家兼容MCP协议的地图服务商。
Playwright MCP Server
一个模型上下文协议服务器,它使大型语言模型能够通过结构化的可访问性快照与网页进行交互,而无需视觉模型或屏幕截图。
Magic Component Platform (MCP)
一个由人工智能驱动的工具,可以从自然语言描述生成现代化的用户界面组件,并与流行的集成开发环境(IDE)集成,从而简化用户界面开发流程。
Audiense Insights MCP Server
通过模型上下文协议启用与 Audiense Insights 账户的交互,从而促进营销洞察和受众数据的提取和分析,包括人口统计信息、行为和影响者互动。
VeyraX
一个单一的 MCP 工具,连接你所有喜爱的工具:Gmail、日历以及其他 40 多个工具。
graphlit-mcp-server
模型上下文协议 (MCP) 服务器实现了 MCP 客户端与 Graphlit 服务之间的集成。 除了网络爬取之外,还可以将任何内容(从 Slack 到 Gmail 再到播客订阅源)导入到 Graphlit 项目中,然后从 MCP 客户端检索相关内容。
Kagi MCP Server
一个 MCP 服务器,集成了 Kagi 搜索功能和 Claude AI,使 Claude 能够在回答需要最新信息的问题时执行实时网络搜索。
e2b-mcp-server
使用 MCP 通过 e2b 运行代码。
Neon MCP Server
用于与 Neon 管理 API 和数据库交互的 MCP 服务器
Exa MCP Server
模型上下文协议(MCP)服务器允许像 Claude 这样的 AI 助手使用 Exa AI 搜索 API 进行网络搜索。这种设置允许 AI 模型以安全和受控的方式获取实时的网络信息。