Broken Link Checker
An MCP server that lets AI assistants check single URLs, scan HTML content, and crawl entire websites for broken links via four tools.
README
Broken Link Checker MCP Server
A Model Context Protocol (MCP) server that provides broken link checking capabilities with streamable HTTP transport. This server enables AI assistants like Claude to check URLs, scan web pages, and crawl entire websites for broken links.
Features
-
Four powerful tools for link checking:
check_url- Verify a single URLcheck_html- Check all links in HTML contentcheck_page- Fetch and check all links on a webpagecheck_site- Recursively crawl and check an entire website
-
Streamable HTTP transport - Serverless-ready, no persistent connections required
-
JSON-RPC 2.0 - Standard MCP protocol support
-
Comprehensive results - Status codes, redirects, response times, and detailed error messages
-
Configurable options - Timeouts, redirect handling, custom user agents
Installation
npm install
npm run build
Usage
Running the Server
Development mode:
npm run dev
Production mode:
npm run build
npm start
The server will start on port 3000 by default (configurable via PORT environment variable).
Endpoints
- Health check:
GET /health - MCP endpoint:
POST /mcp
Using with Claude Code
Add to your MCP settings:
claude mcp add --transport http broken-link-checker http://localhost:3000/mcp
Or manually add to your MCP configuration:
{
"mcpServers": {
"broken-link-checker": {
"transport": "http",
"url": "http://localhost:3000/mcp"
}
}
}
Tools
1. check_url
Check if a single URL is working or broken.
Parameters:
url(string, required) - The URL to checktimeout(number, optional) - Request timeout in milliseconds (default: 30000)followRedirects(boolean, optional) - Whether to follow redirects (default: true)maxRedirects(number, optional) - Maximum number of redirects (default: 5)userAgent(string, optional) - Custom User-Agent string
Example:
{
"tool": "check_url",
"arguments": {
"url": "https://example.com",
"timeout": 10000
}
}
Response:
{
"url": "https://example.com",
"status": 200,
"statusText": "OK",
"broken": false,
"responseTime": 123
}
2. check_html
Check all links within HTML content.
Parameters:
html(string, required) - HTML content to checkbaseUrl(string, required) - Base URL for resolving relative links- All options from
check_url
Example:
{
"tool": "check_html",
"arguments": {
"html": "<a href='/about'>About</a>",
"baseUrl": "https://example.com"
}
}
Response:
{
"totalLinks": 5,
"brokenLinks": 1,
"workingLinks": 4,
"results": [...]
}
3. check_page
Fetch a webpage and check all links on it.
Parameters:
url(string, required) - The URL of the page to check- All options from
check_url
Example:
{
"tool": "check_page",
"arguments": {
"url": "https://example.com"
}
}
Response:
{
"page": {
"url": "https://example.com",
"status": 200,
"broken": false
},
"totalLinks": 25,
"brokenLinks": 2,
"workingLinks": 23,
"links": [...]
}
4. check_site
Recursively crawl and check all links on a website.
Parameters:
url(string, required) - The starting URL of the sitemaxPages(number, optional) - Maximum pages to check (default: 50)- All options from
check_url
Example:
{
"tool": "check_site",
"arguments": {
"url": "https://example.com",
"maxPages": 10
}
}
Response:
{
"totalPages": 10,
"totalLinks": 150,
"brokenLinks": 5,
"workingLinks": 145,
"pages": [...]
}
Conversational Usage Examples
Once connected to Claude Code, you can use natural language:
"Check if https://example.com is working"
"Scan https://mysite.com and find all broken links"
"Crawl https://blog.example.com and report any 404 errors"
"Check all the links on this page: https://docs.example.com/api"
API Examples
Direct HTTP Request
curl -X POST http://localhost:3000/mcp \
-H "Content-Type: application/json" \
-d '{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "check_url",
"arguments": {
"url": "https://example.com"
}
}
}'
List Available Tools
curl -X POST http://localhost:3000/mcp \
-H "Content-Type: application/json" \
-d '{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/list"
}'
Deployment
Docker
Create a Dockerfile:
FROM node:22-alpine
WORKDIR /app
COPY package*.json ./
RUN npm ci --production
COPY dist ./dist
EXPOSE 3000
CMD ["node", "dist/index.js"]
Build and run:
npm run build
docker build -t broken-link-checker-mcp .
docker run -p 3000:3000 broken-link-checker-mcp
Cloud Deployment
This server uses streamable HTTP transport and is serverless-ready. Deploy to:
- Google Cloud Run - Scales to zero when idle
- AWS Elastic Beanstalk - Managed Node.js hosting
- Azure App Service - Integrated deployment
- Render - One-click deployment
- Railway - Git-based deployment
Architecture
This implementation uses:
- Express.js - HTTP server
- MCP SDK - Model Context Protocol implementation
- got - HTTP client for link checking
- parse5 - HTML parsing
- TypeScript - Type-safe implementation
- Zod - Runtime schema validation
Comparison with Original broken-link-checker
This MCP server provides:
- ✅ MCP protocol support for AI integration
- ✅ HTTP transport (stateless, serverless-ready)
- ✅ Simplified, focused API
- ✅ Modern TypeScript implementation
Original library offers:
- Advanced HTML parsing options
- Robot exclusion protocol support
- CLI interface
- EventEmitter-based streaming
- More granular configuration
License
MIT
Contributing
Contributions welcome! This is a reference implementation that can be extended with:
- Additional link checking options
- Better error handling
- Caching layer
- Rate limiting
- Authentication support
- Webhook notifications
Credits
Inspired by broken-link-checker by Steven Vachon.
推荐服务器
Baidu Map
百度地图核心API现已全面兼容MCP协议,是国内首家兼容MCP协议的地图服务商。
Playwright MCP Server
一个模型上下文协议服务器,它使大型语言模型能够通过结构化的可访问性快照与网页进行交互,而无需视觉模型或屏幕截图。
Magic Component Platform (MCP)
一个由人工智能驱动的工具,可以从自然语言描述生成现代化的用户界面组件,并与流行的集成开发环境(IDE)集成,从而简化用户界面开发流程。
Audiense Insights MCP Server
通过模型上下文协议启用与 Audiense Insights 账户的交互,从而促进营销洞察和受众数据的提取和分析,包括人口统计信息、行为和影响者互动。
VeyraX
一个单一的 MCP 工具,连接你所有喜爱的工具:Gmail、日历以及其他 40 多个工具。
Kagi MCP Server
一个 MCP 服务器,集成了 Kagi 搜索功能和 Claude AI,使 Claude 能够在回答需要最新信息的问题时执行实时网络搜索。
graphlit-mcp-server
模型上下文协议 (MCP) 服务器实现了 MCP 客户端与 Graphlit 服务之间的集成。 除了网络爬取之外,还可以将任何内容(从 Slack 到 Gmail 再到播客订阅源)导入到 Graphlit 项目中,然后从 MCP 客户端检索相关内容。
e2b-mcp-server
使用 MCP 通过 e2b 运行代码。
Neon MCP Server
用于与 Neon 管理 API 和数据库交互的 MCP 服务器
Exa MCP Server
模型上下文协议(MCP)服务器允许像 Claude 这样的 AI 助手使用 Exa AI 搜索 API 进行网络搜索。这种设置允许 AI 模型以安全和受控的方式获取实时的网络信息。