ComfyMCP Studio

ComfyMCP Studio is an MCP (Model Context Protocol) server for generating 2D game assets using AI workflows powered by ComfyUI.

What you get

• ComfyUI-backed generation
  • Production-quality SDXL/SD1.5 workflows
• High-quality outputs by default
  • Render at preset resolution (SDXL-native) then downscale for cleaner details
• Consistent character animations (img2img)
  • Generate multiple poses from a single reference image
• Viewpoint control with ControlNet (top-down / side / front / 3/4)
  • Generate top-down assets with stronger camera-angle consistency
• Presets for common game styles
  • Icon, character, tileset, top-down presets, pixel presets
• Post-processing
  • Resize, remove background, add outline
• Unity export + batch generation

Requirements

• Python: 3.10+
• ComfyUI: running locally (default 127.0.0.1:8188)
• Stable Diffusion checkpoint
  • SDXL recommended (default configured: sd_xl_base_1.0.safetensors)
• (Optional) ControlNet models
  • Required only for generate_with_viewpoint / generate_topdown_asset

Installation

# Navigate to the project
cd path/ComfyAI-MCP-GameAssets

# Create virtual environment
python -m venv venv
venv\Scripts\activate

# Install dependencies
pip install -r requirements.txt

Configuration

Copy .env.example to .env and configure:

BACKEND_TYPE=comfyui
COMFYUI_HOST=127.0.0.1
COMFYUI_PORT=8188
COMFYUI_CHECKPOINT=sd_xl_base_1.0.safetensors

OUTPUT_DIR=./output
UNITY_ASSETS_DIR=C:/Projects/MyGame/Assets

ComfyUI setup

• Start ComfyUI (example):

python main.py --listen 0.0.0.0 --port 8188

• Checkpoint
  • Make sure your checkpoint exists in ComfyUI (example: ComfyUI/models/checkpoints/).
  • This server reads COMFYUI_CHECKPOINT from .env.

ControlNet setup (for viewpoint locking)

If you use viewpoint tools, you must install a ControlNet model in: ComfyUI/models/controlnet/

• SDXL depth model (example)
  • diffusers_xl_depth_full.safetensors

Restart ComfyUI after adding models.

If you see HTTP 400 Bad Request when calling /prompt, it usually means:

• The controlnet_model name is wrong, or
• The ControlNet nodes/models are not installed/available.

Run as MCP server (Windsurf)

Add this to your MCP settings (or copy from mcp_config.json):

{
  "mcpServers": {
    "comfymcp-studio": {
      "command": "python",
      "args": ["-m", "server.main"],
      "cwd": "path/ComfyAI-MCP-GameAssets",
      "env": {
        "BACKEND_TYPE": "comfyui",
        "COMFYUI_HOST": "127.0.0.1",
        "COMFYUI_PORT": "8188"
      }
    }
  }
}

Tools

• ping - Backend health check
• list_available_presets - Lists preset names + configs
• generate_sprite - Single image generation from prompt
• generate_icons - Batch icons + optional atlas
• generate_tileset - Tileable tiles by theme
• generate_character - Character generation (prompt-driven)
• generate_character_animations - Img2img multi-pose animations from a reference image
• generate_with_viewpoint - ControlNet depth-guided generation for stable camera angle
• generate_topdown_asset - Convenience wrapper for top-down assets (prop, character, creature, tile, effect)
• process_image - Resize / remove background / add outline
• create_sprite_atlas - Combine images to spritesheet
• export_to_unity - Export output PNGs into a Unity project folder
• batch_generate - Batch generation with prompts

Presets

You can list presets via list_available_presets.

General

• default - General purpose game asset
• icon / icon_item - Game icons
• character / character_portrait - Character sprites
• tileset - Seamless tileable textures
• environment - Background/environment art
• prop - Game props (3/4 view)

Top-down (ControlNet)

• topdown_prop - Top-down props
• topdown_character - Top-down characters
• topdown_creature - Top-down creatures/enemies
• topdown_tile - Top-down tiles

Effects & UI

• effect / magic_effect - VFX and spell effects
• ui_button / ui_frame - UI elements

Creatures

• creature - Fantasy creatures/monsters

Style-specific

• handpainted - Hand-painted art style
• flat_ui - Flat design UI
• isometric - Isometric game assets
• pixel_art / pixel_character - Pixel art style
• pixel_16 / pixel_32 / pixel_64 - Specific pixel sizes

Testing

Quick smoke test

python test_generate.py --list-presets
python test_generate.py --preset icon --size 256 --steps 20 --seed 42 --save

ControlNet viewpoint tests

# Top-down prop (depth ControlNet)
python test_controlnet.py --tests prop --size 512 --strength 0.95 --save

# Top-down character (wrapper tool)
python test_controlnet.py --tests character --size 512 --strength 1.0 --save

# Multi-view for the same object
python test_controlnet.py --tests multi --views topdown,side,front,3/4 --size 512 --strength 0.90 --save

Character animation tests (img2img)

# Requires a local reference image
python test_character_animation.py --ref path\\to\\reference.png --poses idle,walking,attacking --denoise 0.35 --seed 42 --save

Output

Generated images are saved under OUTPUT_DIR when you call tools with save_to_file=true. Typical folders:

• output/controlnet/
• output/icons/
• output/characters/
• output/tilesets/

Troubleshooting

• HTTP 400 Bad Request from ComfyUI /prompt
  • Check ControlNet model file exists in ComfyUI/models/controlnet/
  • Verify the exact filename passed as controlnet_model
  • Restart ComfyUI after installing models
• Results still not top-down
  • Increase control_strength (try 0.90 to 1.0)
  • Use preset=topdown_character/topdown_prop
• Duplicated/fragmented weapons/armor
  • Add explicit constraints to prompt: single character, one sword, one shield

License

MIT