Scrapfly MCP Server

<p align="center"> <a href="https://scrapfly.io"> <img src="https://avatars.githubusercontent.com/u/54183743?s=400&u=5279c1aaea18805aa5cc4fec1053ac2a2cfaac5d&v=4" alt="Scrapfly" width="200"/> </a> </p>

<p align="center"> <strong>Give your AI real-time access to any website</strong> </p>

<p align="center"> <a href="https://scrapfly.io/mcp-cloud">🌐 Landing Page</a> • <a href="https://scrapfly.io/docs/mcp/getting-started">📖 Documentation</a> • <a href="https://scrapfly.io/mcp-cloud/n8n">🎮 Live Demo</a> • <a href="https://scrapfly.io/register">🔑 Get API Key</a> </p>

---

What is Scrapfly MCP?

The Scrapfly MCP Server connects your AI assistants to live web data through the Model Context Protocol. Transform your AI from being limited by training data to having real-time access to any website.

✨ What Your AI Can Do

Capability	Description
🌐 Scrape Live Data	Pull current prices, listings, news, or any webpage content in real-time
🛡️ Bypass Anti-Bot Systems	Automatically handle CAPTCHAs, proxies, JavaScript rendering, and rate limits
⚡ Extract Structured Data	Parse complex websites into clean JSON using AI-powered extraction
📸 Capture Screenshots	Take visual snapshots of pages or specific elements for analysis

🏆 Why Scrapfly?

Built on battle-tested infrastructure used by thousands of developers:

• 99.9% Uptime — Enterprise-grade reliability
• 100+ Countries — Global proxy network with datacenter & residential IPs
• Anti-Bot Bypass — Advanced ASP technology defeats modern protections
• OAuth2 Security — Enterprise authentication for production deployments

📖 Learn more: Why Scrapfly MCP?

---

🚀 Quick Install

Click one of the buttons below to install the MCP server in your preferred IDE:

---

📦 Manual Installation

Standard Configuration

Works with most MCP-compatible tools:

{
  "servers": {
    "scrapfly-cloud-mcp": {
      "type": "http",
      "url": "https://mcp.scrapfly.io/mcp"
    }
  }
}

Cloud Configuration (NPX)

For tools that require a local process:

{
  "mcpServers": {
    "scrapfly": {
      "command": "npx",
      "args": [
        "mcp-remote",
        "https://mcp.scrapfly.io/mcp"
      ]
    }
  }
}

---

🔧 IDE-Specific Setup

<details> <summary><strong>VS Code</strong></summary>

One-Click Install

Manual Install

Follow the VS Code MCP guide or use the CLI:

code --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'

After installation, Scrapfly tools will be available in GitHub Copilot Chat.

📖 Full guide: VS Code Integration </details>

<details> <summary><strong>VS Code Insiders</strong></summary>

One-Click Install

Manual Install

code-insiders --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'

📖 Full guide: VS Code Integration </details>

<details> <summary><strong>Visual Studio</strong></summary>

One-Click Install

Manual Install

1. Open Visual Studio
2. Navigate to GitHub Copilot Chat window
3. Click the tools icon (🛠️) in the chat toolbar
4. Click + Add Server to open the configuration dialog
5. Configure:
   • Server ID: scrapfly-cloud-mcp
   • Type: http/sse
   • URL: https://mcp.scrapfly.io/mcp
6. Click Save

📖 Full guide: Visual Studio MCP documentation </details>

<details> <summary><strong>Cursor</strong></summary>

One-Click Install

Manual Install

1. Go to Cursor Settings → MCP → Add new MCP Server
2. Use the standard configuration above
3. Click Edit to verify or add arguments

📖 Full guide: Cursor Integration </details>

<details> <summary><strong>Claude Code</strong></summary>

Use the Claude Code CLI:

claude mcp add scrapfly-cloud-mcp --url https://mcp.scrapfly.io/mcp

📖 Full guide: Claude Code Integration </details>

<details> <summary><strong>Claude Desktop</strong></summary>

Add to your Claude Desktop configuration file:

macOS: ~/Library/Application Support/Claude/claude_desktop_config.json Windows: %APPDATA%\Claude\claude_desktop_config.json

{
  "mcpServers": {
    "scrapfly": {
      "command": "npx",
      "args": ["mcp-remote", "https://mcp.scrapfly.io/mcp"]
    }
  }
}

📖 Full guide: Claude Desktop Integration </details>

<details> <summary><strong>Cline</strong></summary>

Add to your Cline MCP settings:

{
  "scrapfly-cloud-mcp": {
    "type": "http",
    "url": "https://mcp.scrapfly.io/mcp"
  }
}

📖 Full guide: Cline Integration </details>

<details> <summary><strong>Windsurf</strong></summary>

Follow the Windsurf MCP documentation using the standard configuration.

📖 Full guide: Windsurf Integration </details>

<details> <summary><strong>Zed</strong></summary>

Add to your Zed settings:

{
  "context_servers": {
    "scrapfly-cloud-mcp": {
      "type": "http",
      "url": "https://mcp.scrapfly.io/mcp"
    }
  }
}

📖 Full guide: Zed Integration </details>

<details> <summary><strong>OpenAI Codex</strong></summary>

Create or edit ~/.codex/config.toml:

[mcp_servers.scrapfly-cloud-mcp]
url = "https://mcp.scrapfly.io/mcp"

📖 More info: Codex MCP documentation </details>

<details> <summary><strong>Gemini CLI</strong></summary>

Follow the Gemini CLI MCP guide using the standard configuration. </details>

<details> <summary><strong>OpenCode</strong></summary>

Add to ~/.config/opencode/opencode.json:

{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "scrapfly-cloud-mcp": {
      "type": "http",
      "url": "https://mcp.scrapfly.io/mcp",
      "enabled": true
    }
  }
}

📖 More info: OpenCode MCP documentation </details>

---

🛠️ Available Tools

The Scrapfly MCP Server provides 5 powerful tools covering 99% of web scraping use cases:

Tool	Description	Use Case
scraping_instruction_enhanced	Get best practices & POW token	Always call first!
web_get_page	Quick page fetch with smart defaults	Simple scraping tasks
web_scrape	Full control with browser automation	Complex scraping, login flows
screenshot	Capture page screenshots	Visual analysis, monitoring
info_account	Check usage & quota	Account management

📖 Full reference: Tools & API Specification

Example: Scrape a Page

User: "What are the top posts on Hacker News right now?"

AI: Uses web_get_page to fetch https://news.ycombinator.com and returns current top stories

Example: Extract Structured Data

User: "Get all product prices from this Amazon page"

AI: Uses web_scrape with extraction_model="product_listing" to return structured JSON

📖 More examples: Real-World Examples

---

🔐 Authentication

Scrapfly MCP supports multiple authentication methods:

Method	Best For	Documentation
OAuth2	Production, multi-user apps	OAuth2 Setup
API Key	Personal use, development	API Key Setup
Header Auth	Custom integrations	Header Auth

🔑 Get your API key: Scrapfly Dashboard

---

📊 Configuration Reference

Setting	Value
Server Name	scrapfly-cloud-mcp
Type	Remote HTTP Server
URL	https://mcp.scrapfly.io/mcp
Protocol	MCP over HTTP/SSE

---

🤝 Framework Integrations

Scrapfly MCP also works with AI frameworks and automation tools:

Framework	Documentation
LangChain	LangChain Integration
LlamaIndex	LlamaIndex Integration
CrewAI	CrewAI Integration
OpenAI	OpenAI Integration
n8n	n8n Integration
Make	Make Integration
Zapier	Zapier Integration

📖 All integrations: Integration Index

---

📚 Resources

• 🌐 MCP Cloud Landing Page — Product overview & features
• 🎮 Live n8n Demo — Try it in your browser
• 📖 Full Documentation
• 🛠️ Tools Reference
• 💡 Examples & Use Cases
• ❓ FAQ
• 🔐 Authentication Guide

---

💬 Need Help?

• 📖 Scrapfly Documentation
• 📧 Contact Support
• 🌐 Model Context Protocol

---

<p align="center"> <a href="https://scrapfly.io"> <img src="https://avatars.githubusercontent.com/u/54183743?s=400&u=5279c1aaea18805aa5cc4fec1053ac2a2cfaac5d&v=4" alt="Scrapfly" width="50"/> </a> <br/> <strong>Made with ❤️ by <a href="https://scrapfly.io">Scrapfly</a></strong> <br/> _{The Web Scraping API for Developers} </p>