Remotion Video Production MCP Server
Enables AI agents to programmatically scaffold Remotion projects, analyze audio for beat-synced scenes, synthesize voiceovers with word-level timecodes, preview frames, and render finished videos.
README
Remotion Video Production MCP Server
A world-class Model Context Protocol (MCP) server that acts as an intelligent bridge for AI agents to analyze audio beats, synthesize voices with Google Gemini TTS, and programmatically construct and render professional videos using Remotion (v4.0+) and React.
Supports BOTH:
- 💻 Local STDIO Transport: For local AI clients (Antigravity, Claude Desktop, Cursor).
- 🌐 Remote Streamable HTTP Transport: For cloud deployments (Render) and web-based AI clients (Claude Web at https://claude.ai/new).
🚀 Key Features
- 🎬 Programmatic Scaffolding: Create zero-config React/Remotion video projects with built-in aspect ratios: TikTok/Reels (
tiktok-916), YouTube (youtube-169), and Social (social-11). - 🎙️ Gemini 3.1 Flash TTS integration: Generate high-fidelity voiced scene dialogues with regional accents, and produce word-level timecodes for kinetic subtitles.
- 🎵 Librosa Audio Beat Sync: Analyze background music to extract BPM, beat boundaries, RMS energy drops/rises, and recommend frame-accurate scene cuts.
- 📸 Visual Preview Snapshots: Instantly render frame snapshots (PNG/JPEG/WebP) at any frame index for AI visual verification.
- ⚡ Headless Rendering: Programmatically compile high-quality MP4/WebM videos with multi-core concurrency control and progress tracking.
- 🔒 Bearer Token Authentication: Secure your HTTP MCP endpoints when deployed to public cloud services.
🛠️ Prerequisites
To run this MCP server and render videos, the host environment requires:
- Node.js (v20.0.0 or higher recommended) and npm.
- Python 3 (v3.10+ recommended) with audio packages installed:
pip install librosa numpy scipy google-genai - Remotion Browser Dependencies: Launching Chrome headless requires Chromium. Install via CLI:
npx @remotion/cli browser ensure
🌐 Remote MCP / Claude Web & Streamable HTTP Deployment
This server supports the MCP Streamable HTTP Transport Specification (@modelcontextprotocol/sdk v1.29.0), allowing web-based clients such as Claude Web (https://claude.ai/new) to connect remotely.
1. Running the HTTP Server Locally
Build and start the Streamable HTTP server:
npm install
npm run build
npm run start:http
By default, the server listens on:
- Health Check:
GET http://localhost:3000/health - MCP Endpoint:
http://localhost:3000/mcp
2. Environment Variables
Create a .env file or export environment variables:
| Environment Variable | Description | Default |
|---|---|---|
PORT |
HTTP Port to listen on | 3000 |
HOST |
Host interface binding | 0.0.0.0 |
MCP_AUTH_TOKEN |
Secret token for Bearer authentication (Authorization: Bearer <token>) |
(Unauthenticated if empty) |
CORS_ORIGIN |
Allowed CORS origins (comma-separated, e.g., https://claude.ai) |
* / Allow all |
GEMINI_API_KEY |
Google Gemini API Key for TTS synthesis | (Synthetic audio fallback) |
3. Securing the HTTP MCP Endpoint
When deploying to a public server, configure MCP_AUTH_TOKEN:
export MCP_AUTH_TOKEN=your-secret-token-here
npm run start:http
Incoming requests to /mcp must include the header:
Authorization: Bearer your-secret-token-here
Requests missing or specifying an invalid token will receive a 401 Unauthorized response.
4. Testing HTTP & Health Endpoints
-
Verify Health Status:
curl http://localhost:3000/health # Response: {"status":"ok","service":"remotion-mcp-server"} -
Verify MCP Initialization:
curl -X POST http://localhost:3000/mcp \ -H "Content-Type: application/json" \ -H "Authorization: Bearer your-secret-token-here" \ -d '{ "jsonrpc": "2.0", "id": 1, "method": "initialize", "params": { "protocolVersion": "2024-11-05", "capabilities": {}, "clientInfo": { "name": "curl-test", "version": "1.0.0" } } }'
5. Deployment to Render (One-Click / Blueprint)
The repository includes a render.yaml blueprint and a production-ready Dockerfile that packages Node 20, Chromium, FFmpeg, and Python audio libraries.
- Push your repository to GitHub.
- Sign in to Render and click New + -> Blueprint.
- Connect your repository (
remotionMcpServer). Render will automatically detectrender.yaml. - Configure environment variables in the Render Dashboard:
MCP_AUTH_TOKEN: Your custom secret token.GEMINI_API_KEY: Your Gemini API key.
- Deploy! Your remote MCP URL will be:
https://YOUR-SERVICE-NAME.onrender.com/mcp
6. Connecting to Claude Web
- Go to https://claude.ai/new.
- Open Custom MCP Connectors settings.
- Enter your remote MCP URL:
https://YOUR-SERVICE-NAME.onrender.com/mcp - If authentication is enabled, configure the
Authorizationheader withBearer <your-mcp-auth-token>. - Save and connect. Claude Web will list all 5 available Remotion tools.
💻 Local STDIO Setup (Antigravity & Local Clients)
Instant One-Command Setup (Recommended)
Copy and paste a single command into your terminal:
🍎 macOS / Linux (Terminal)
curl -fsSL https://raw.githubusercontent.com/ivalenzuela/remotion-mcp-server/main/autoinstall.sh | bash
🪟 Windows (PowerShell)
iwr -useb https://raw.githubusercontent.com/ivalenzuela/remotion-mcp-server/main/autoinstall.ps1 | iex
Manual STDIO Configuration
-
Compile the Server:
git clone https://github.com/ivalenzuela/remotion-mcp-server.git cd remotion-mcp-server npm install npm run build -
Register in AI Client (
mcp_config.json/claude_desktop_config.json):{ "mcpServers": { "remotion": { "command": "node", "args": ["/path/to/remotion-mcp-server/dist/index.js"], "env": { "GEMINI_API_KEY": "YOUR_GEMINI_API_KEY_HERE" } } } }
🤖 Available MCP Tools
All five tools are available identically across STDIO and Streamable HTTP transports:
1. remotion_scaffold_project
Scaffolds a complete React/Remotion project with prebuilt templates, standard layout components, and automatically installs npm dependencies.
- Arguments:
projectName(string, required): Folder name of the target project.template(enum:tiktok-916,youtube-169,social-11, required): Aspect ratio.targetDir(string, required): Parent directory path.
2. remotion_analyze_audio
Performs signal processing on audio files using Python Librosa to return BPM, beat frames, energy profiles, recommended scene cut frame numbers, and aligns SRT subtitles.
- Arguments:
audioPath(string, required): Path to input audio track.srtPath(string, optional): Path to SRT subtitles file.outputPath(string, optional): Path to save the output JSON analysis.fps(number, default30): Target composition frame rate.minSceneDuration(number, default3.5): Minimum seconds between scene cuts.
3. remotion_generate_tts
Synthesizes speech using Google Gemini 3.1 Flash TTS (gemini-3.1-flash-tts-preview) and outputs character-weighted word timecodes. Automatically falls back to clean synthetic audio if GEMINI_API_KEY is not present.
- Arguments:
text(string, required): Dialogue text to synthesize.outputPath(string, required): Path to save generated.wavfile.voice(string, default"Puck"): Gemini prebuilt voice name.accent(string, optional): Optional regional accent instruction.fps(number, default30): Frame rate.
4. remotion_preview_frame
Renders a still snapshot image (PNG/JPEG/WebP) of a specific frame in the composition using Remotion's CLI.
- Arguments:
projectDir(string, required): Path to Remotion project.compositionId(string, required): Target Composition ID.frame(number, default0): Frame index to capture.imageFormat(enum:png,jpeg,webp, defaultpng): Format.props(object, optional): Input React props.
5. remotion_render_video
Compiles a composition into a production-grade video (MP4/WebM).
- Arguments:
projectDir(string, required): Path to Remotion project.compositionId(string, required): Target Composition ID.outputPath(string, optional): Output video path.concurrency(number/string, default"auto"): CPU threads to utilize.codec(string, default"h264"): Target codec.props(object, optional): Input React props.
🎨 Prebuilt React Components
Scaffolded projects include these production-ready layout components:
SubtitleOverlay: Word-by-word active scaling and custom text shadow glows ("Efecto Lupa PRO") for dual-language subtitles.KenBurnsImage: Clean interpolation-based image scaling and translation without CSS animations.AudioSpectrum: Sound frequency spectrum visualizer bars reactively synchronized with the soundtrack.LowerThird: Elegant lower-third pop-ups for social media profiles or name cards.
🧪 Testing & Verification
Run the full E2E test suite to verify tool execution, path resolution, and CLI rendering:
npm test
📄 License
This project is licensed under the MIT License.
推荐服务器
Baidu Map
百度地图核心API现已全面兼容MCP协议,是国内首家兼容MCP协议的地图服务商。
Playwright MCP Server
一个模型上下文协议服务器,它使大型语言模型能够通过结构化的可访问性快照与网页进行交互,而无需视觉模型或屏幕截图。
Magic Component Platform (MCP)
一个由人工智能驱动的工具,可以从自然语言描述生成现代化的用户界面组件,并与流行的集成开发环境(IDE)集成,从而简化用户界面开发流程。
Audiense Insights MCP Server
通过模型上下文协议启用与 Audiense Insights 账户的交互,从而促进营销洞察和受众数据的提取和分析,包括人口统计信息、行为和影响者互动。
VeyraX
一个单一的 MCP 工具,连接你所有喜爱的工具:Gmail、日历以及其他 40 多个工具。
graphlit-mcp-server
模型上下文协议 (MCP) 服务器实现了 MCP 客户端与 Graphlit 服务之间的集成。 除了网络爬取之外,还可以将任何内容(从 Slack 到 Gmail 再到播客订阅源)导入到 Graphlit 项目中,然后从 MCP 客户端检索相关内容。
Kagi MCP Server
一个 MCP 服务器,集成了 Kagi 搜索功能和 Claude AI,使 Claude 能够在回答需要最新信息的问题时执行实时网络搜索。
e2b-mcp-server
使用 MCP 通过 e2b 运行代码。
Neon MCP Server
用于与 Neon 管理 API 和数据库交互的 MCP 服务器
Exa MCP Server
模型上下文协议(MCP)服务器允许像 Claude 这样的 AI 助手使用 Exa AI 搜索 API 进行网络搜索。这种设置允许 AI 模型以安全和受控的方式获取实时的网络信息。