clearml-mcp

clearml-mcp

A lightweight Model Context Protocol (MCP) server that enables AI assistants to interact with ClearML experiments, models, and projects.

Category
访问服务器

README

ClearML MCP Server

ClearML MCP

PyPI version Python 3.10+ License: MIT

A lightweight Model Context Protocol (MCP) server that enables AI assistants to interact with ClearML experiments, models, and projects. Get comprehensive ML experiment context and analysis directly in your AI conversations.

✨ Features

  • 🔍 Experiment Discovery: Find and analyze ML experiments across projects
  • 📊 Performance Analysis: Compare model metrics and training progress
  • 📈 Real-time Metrics: Access training scalars, validation curves, and convergence analysis
  • 🏷️ Smart Search: Filter tasks by name, tags, status, and custom queries
  • 📦 Artifact Management: Retrieve model files, datasets, and experiment outputs
  • 🌐 Cross-platform: Works with all major AI assistants and code editors

📋 Requirements

  • uv (installation guide) for uvx command
  • ClearML account with valid API credentials in ~/.clearml/clearml.conf

🚀 Quick Start

Prerequisites

You need a configured ClearML environment with your credentials in ~/.clearml/clearml.conf:

[api]
api_server = https://api.clear.ml
web_server = https://app.clear.ml
files_server = https://files.clear.ml
credentials {
    "access_key": "your-access-key",
    "secret_key": "your-secret-key"
}

Get your credentials from ClearML Settings.

Installation

# Install from PyPI
pip install clearml-mcp

# Or run directly with uvx (no installation needed)
uvx clearml-mcp

🔌 Integrations

<details> <summary><strong>🤖 Claude Desktop</strong></summary>

Add to your Claude Desktop configuration:

macOS: ~/Library/Application Support/Claude/claude_desktop_config.json Windows: %APPDATA%/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "clearml": {
      "command": "uvx",
      "args": ["clearml-mcp"]
    }
  }
}

Alternative with pip installation:

{
  "mcpServers": {
    "clearml": {
      "command": "python",
      "args": ["-m", "clearml_mcp.clearml_mcp"]
    }
  }
}

</details>

<details> <summary><strong>⚡ Cursor</strong></summary>

Add to your Cursor settings (Ctrl/Cmd + , → Search "MCP"):

{
  "mcp.servers": {
    "clearml": {
      "command": "uvx",
      "args": ["clearml-mcp"]
    }
  }
}

Or add to .cursorrules in your project:

When analyzing ML experiments or asking about model performance, use the clearml MCP server to access experiment data, metrics, and artifacts.

</details>

<details> <summary><strong>🔥 Continue</strong></summary>

Add to your Continue configuration (~/.continue/config.json):

{
  "mcpServers": {
    "clearml": {
      "command": "uvx",
      "args": ["clearml-mcp"]
    }
  }
}

</details>

<details> <summary><strong>🦾 Cody</strong></summary>

Add to your Cody settings:

{
  "cody.experimental.mcp": {
    "servers": {
      "clearml": {
        "command": "uvx",
        "args": ["clearml-mcp"]
      }
    }
  }
}

</details>

<details> <summary><strong>🧠 Other AI Assistants</strong></summary>

For any MCP-compatible AI assistant, use this configuration:

{
  "mcpServers": {
    "clearml": {
      "command": "uvx",
      "args": ["clearml-mcp"]
    }
  }
}

Compatible with:

  • Zed Editor
  • OpenHands
  • Roo-Cline
  • Any MCP-enabled application </details>

🛠️ Available Tools

The ClearML MCP server provides 14 comprehensive tools for ML experiment analysis:

📊 Task Operations

  • get_task_info - Get detailed task information, parameters, and status
  • list_tasks - List tasks with advanced filtering (project, status, tags, user)
  • get_task_parameters - Retrieve hyperparameters and configuration
  • get_task_metrics - Access training metrics, scalars, and plots
  • get_task_artifacts - Get artifacts, model files, and outputs

🤖 Model Operations

  • get_model_info - Get model metadata and configuration details
  • list_models - Browse available models with filtering
  • get_model_artifacts - Access model files and download URLs

📁 Project Operations

  • list_projects - Discover available ClearML projects
  • get_project_stats - Get project statistics and task summaries
  • find_project_by_pattern - Find projects matching name patterns
  • find_experiment_in_project - Find specific experiments within projects

🔍 Analysis Tools

  • compare_tasks - Compare multiple tasks by specific metrics
  • search_tasks - Advanced search by name, tags, comments, and more

💡 Usage Examples

Demo

asciicast

Once configured, you can ask your AI assistant questions like:

  • "Show me the latest experiments in the 'computer-vision' project"
  • "Compare the accuracy metrics between tasks task-123 and task-456"
  • "What are the hyperparameters for the best performing model?"
  • "Find all failed experiments from last week"
  • "Get the training curves for my latest BERT fine-tuning"

🏗️ Development

Setup

# Clone and setup with UV
git clone https://github.com/prassanna-ravishankar/clearml-mcp.git
cd clearml-mcp
uv sync

# Run locally
uv run python -m clearml_mcp.clearml_mcp

Available Commands

# Run tests with coverage
uv run task coverage

# Lint and format
uv run task lint
uv run task format

# Type checking
uv run task type

# Run examples
uv run task consolidated-debug  # Full ML debugging demo
uv run task example-simple      # Basic integration
uv run task find-experiments    # Discover real experiments

Testing with MCP Inspector

# Test the MCP server directly
npx @modelcontextprotocol/inspector uvx clearml-mcp

🚨 Troubleshooting

<details> <summary><strong>Connection Issues</strong></summary>

"No ClearML projects accessible"

  • Verify your ~/.clearml/clearml.conf credentials
  • Test with: python -c "from clearml import Task; print(Task.get_projects())"
  • Check network access to your ClearML server

Module not found errors

  • Try bunx clearml-mcp instead of uvx clearml-mcp
  • Or use direct Python: python -m clearml_mcp.clearml_mcp </details>

<details> <summary><strong>Performance Issues</strong></summary>

Large dataset queries

  • Use filters in list_tasks to limit results
  • Specify project_name to narrow scope
  • Use task_status filters (completed, running, failed)

Slow metric retrieval

  • Request specific metrics instead of all metrics
  • Use compare_tasks with metric names for focused analysis </details>

🤝 Contributing

Contributions welcome! This project uses:

  • UV for dependency management
  • Ruff for linting and formatting
  • Pytest for testing with 69% coverage
  • GitHub Actions for CI/CD

See our testing philosophy and linting approach for development guidelines.

📄 License

MIT License - see LICENSE for details.

🔗 Links


Created by Prass, The Nomadic Coder

推荐服务器

Baidu Map

Baidu Map

百度地图核心API现已全面兼容MCP协议,是国内首家兼容MCP协议的地图服务商。

官方
精选
JavaScript
Playwright MCP Server

Playwright MCP Server

一个模型上下文协议服务器,它使大型语言模型能够通过结构化的可访问性快照与网页进行交互,而无需视觉模型或屏幕截图。

官方
精选
TypeScript
Magic Component Platform (MCP)

Magic Component Platform (MCP)

一个由人工智能驱动的工具,可以从自然语言描述生成现代化的用户界面组件,并与流行的集成开发环境(IDE)集成,从而简化用户界面开发流程。

官方
精选
本地
TypeScript
Audiense Insights MCP Server

Audiense Insights MCP Server

通过模型上下文协议启用与 Audiense Insights 账户的交互,从而促进营销洞察和受众数据的提取和分析,包括人口统计信息、行为和影响者互动。

官方
精选
本地
TypeScript
VeyraX

VeyraX

一个单一的 MCP 工具,连接你所有喜爱的工具:Gmail、日历以及其他 40 多个工具。

官方
精选
本地
graphlit-mcp-server

graphlit-mcp-server

模型上下文协议 (MCP) 服务器实现了 MCP 客户端与 Graphlit 服务之间的集成。 除了网络爬取之外,还可以将任何内容(从 Slack 到 Gmail 再到播客订阅源)导入到 Graphlit 项目中,然后从 MCP 客户端检索相关内容。

官方
精选
TypeScript
Kagi MCP Server

Kagi MCP Server

一个 MCP 服务器,集成了 Kagi 搜索功能和 Claude AI,使 Claude 能够在回答需要最新信息的问题时执行实时网络搜索。

官方
精选
Python
e2b-mcp-server

e2b-mcp-server

使用 MCP 通过 e2b 运行代码。

官方
精选
Neon MCP Server

Neon MCP Server

用于与 Neon 管理 API 和数据库交互的 MCP 服务器

官方
精选
Exa MCP Server

Exa MCP Server

模型上下文协议(MCP)服务器允许像 Claude 这样的 AI 助手使用 Exa AI 搜索 API 进行网络搜索。这种设置允许 AI 模型以安全和受控的方式获取实时的网络信息。

官方
精选