AI Web Tester

AI Web Tester

Enables AI coding agents to autonomously interact with and test web applications in a real browser, providing DOM/Accessibility tree extraction, runtime telemetry, screenshot capture, and Markdown test reports.

Category
访问服务器

README

<div align="center">

🌐 AI Web Tester

The Autonomous Eyes & Hands for AI Coding Agents in the Browser

TypeScript Playwright Model Context Protocol Node.js License

<p align="center"> <b>Give your AI coding assistant (OpenCode, Antigravity, Claude Code, Cursor, Windsurf) the power to interact with, explore, test, and fix real web applications like a Senior QA Engineer.</b> </p>

</div>

[!IMPORTANT] 📖 Looking for step-by-step setup instructions or local development setup? Check out the Complete Installation & Setup Guide (INSTALL.md) for 1-command installer wizards, agent-specific guides (OpenCode, Antigravity, Claude Code, Cursor, Windsurf), and troubleshooting tips.


💡 The Missing Piece in AI Coding

AI coding agents can write complex code, refactor components, and fix syntax errors. But there has always been a fundamental blind spot: AI agents cannot see or experience the application running in a real browser.

A login page might have clean code, yet:

  • The submit button fails to trigger in specific browser states.
  • An unhandled JavaScript exception silently crashes the React hydration root.
  • Form validation passes invalid email formats or crashes on edge-case inputs.
  • Dynamic modals or infinite scrolls break user navigation.

ai-web-tester bridges this gap. It acts as the high-speed sensory and motor system for AI agents, allowing them to autonomously open URLs (localhost or live), test multi-step user scenarios, catch runtime errors, take visual snapshots of bugs, and compile professional Markdown reports.


⚡ Key Highlights

1. 🧠 Senior QA Testing Matrices Built-in

Your AI agent doesn't just "click a button" — it executes comprehensive, multi-layer test matrices:

  • Empty / Required Field Validation: Checks HTML5 & custom error states when mandatory fields are omitted.
  • Format Violations & Boundary Limits: Tests invalid email syntax, password length boundaries, and type constraints.
  • Wrong Credentials & State Integrity: Verifies 401 alert banners and error handling without application crashes.
  • Security & Injection Guardrails: Evaluates handling of special characters, SQLi patterns (' OR '1'='1), and XSS strings.
  • Happy Path (End-to-End Success): Completes full user flows and validates state changes, cookies, and redirects.

2. 🪶 >90% Token Reduction (Semantic State Compression)

Raw HTML DOM dumps consume tens of thousands of LLM tokens and cause selector hallucinations. ai-web-tester prunes the DOM and extracts a clean, numbered Accessibility (ARIA) Tree:

🌐 Current Page: "Customer Portal"
[1] textbox "Email" (required, placeholder="name@domain.com")
[2] textbox "Password" (type=password)
[3] button "Sign In"
[4] link "Forgot Password?"

The AI agent interacts simply by referencing deterministic IDs: click(ref=3) or fill(ref=1, "admin@test.com").

3. 🚀 Lightweight & Headless by Default

Runs entirely in the background using headless Chromium. It consumes minimal RAM and CPU, ensuring your computer stays fast and quiet while your agent audits your application.

4. 📸 Smart Error-Triggered Screenshots

No wasted disk space or clutter. Screenshots are captured automatically only when an anomaly occurs (console error, network 500, unhandled exception, or broken selector) and saved directly into ./artifacts/ with direct clickable links in the report.

5. 🚨 360° Runtime Telemetry & Crash Watchdog

Silently observes browser lifecycle events:

  • console.error & console.warn interceptor with precise stack traces.
  • Unhandled JavaScript runtime exceptions (pageerror).
  • Failed HTTP network responses (4xx / 5xx) and broken asset requests.
  • Main-thread freeze & infinite loop detection via watchdog timeout guards.

6. 📄 Automated Markdown (.md) Test Reports

Compiles test results into standardized, human-readable Markdown documents with YAML frontmatter at ./test-reports/report-[runId].md:

  • Overall status (PASSED, FAILED, WARNING) and duration metrics.
  • Complete step-by-step audit log with and status indicators.
  • Exact error traces and reproduction steps.
  • Embedded links to screenshot artifacts.
  • Actionable fix recommendations for the developer or AI agent.

🧙 1-Command Universal Setup Wizard

Easily configure ai-web-tester for any AI agent on your machine with one interactive command:

node dist/cli.js init

Or target a specific agent directly:

# For OpenCode
node dist/cli.js init -a opencode

# For Antigravity
node dist/cli.js init -a antigravity

# For Claude Code / Claude Desktop
node dist/cli.js init -a claude

# For Cursor
node dist/cli.js init -a cursor

# For Windsurf / Roo Code
node dist/cli.js init -a windsurf

# For ALL agents at once
node dist/cli.js init -a antigravity opencode claude cursor windsurf

🤖 Supported AI Agent Ecosystems

Agent Configuration Location Integration Type
OpenCode ~/.config/opencode/config.json Native MCP + Skills
Antigravity ~/.gemini/config/mcp_config.json Native MCP + Global Skills
Claude Code / Desktop claude_desktop_config.json Stdio MCP Server
Cursor ~/.cursor/mcp.json Project / Global MCP
Windsurf / Roo Code ~/.codeium/windsurf/mcp_config.json Universal MCP

🛠️ Model Context Protocol (MCP) Tools

When connected via MCP, your AI coding agent gains access to 6 specialized tools:

┌─────────────────────────────────────────────────────────────┐
│                    AI Web Tester MCP Engine                 │
└──────────────────────────────┬──────────────────────────────┘
                               │
   ┌───────────────────────────┼───────────────────────────┐
   ▼                           ▼                           ▼
browser_open               browser_act              browser_inspect
(Launch & scan DOM)     (click, fill, scroll)     (Refresh state & logs)
   │                           │                           │
   ▼                           ▼                           ▼
browser_screenshot          browser_report           browser_close
(Capture image artifact)   (Export .md summary)     (Clean session teardown)
Tool Name Key Parameters Description
browser_open url (required), headless?, width?, height? Opens the target URL in Chromium, extracts interactive elements with ref IDs, and returns initial state.
browser_act action (click, fill, hover, press, select, scroll, screenshot), ref?, value? Executes an interaction on a referenced element with built-in auto-scroll and retry logic.
browser_inspect (none) Refreshes and returns the active page state, interactive refs, and captured runtime errors.
browser_screenshot name?, fullPage? Manually captures a visual screenshot and saves it to ./artifacts/.
browser_report title?, outputPath? Compiles test execution history, telemetry, and screenshots into a structured .md report.
browser_close (none) Safely terminates the browser session and frees all system memory.

🖥️ Standalone CLI Usage

You can also run automated browser tests directly from your terminal:

# 1. Quick inspection of interactive elements on any page
node dist/cli.js open http://localhost:3000

# 2. Run automated health check & compile a Markdown report
node dist/cli.js test http://localhost:3000 --title "Homepage Smoke Test"

# 3. Start the MCP Server over stdio manually
node dist/cli.js serve-mcp

📋 Sample Markdown Test Report Output

When your test finishes, ai-web-tester generates a report like this:

---
test_run_id: "rep-1723651234-a8f2"
title: "Authentication Flow - Senior QA Matrix"
target_url: "http://localhost:3000/login"
status: "PASSED"
duration_ms: 3420
total_steps: 5
passed_steps: 5
failed_steps: 0
issues_count: 0
timestamp: "2026-08-14T23:45:00.000Z"
---

# 📋 Laporan Hasil Pengujian: Authentication Flow - Senior QA Matrix

## 📊 Ringkasan Eksekusi
* **Target URL**: `http://localhost:3000/login`
* **Status Keseluruhan**: ✅ PASSED
* **Durasi Pengujian**: 3.42 detik (3420 ms)
* **Total Langkah**: 5 (✅ 5 Passed | ❌ 0 Failed)
* **Total Isu/Error**: 0

---

## 🚶 Urutan Langkah Pengujian (Execution Steps)**Step 1**: `CLICK` on [ref=3] (button "Sign In") — *Tested empty field validation***Step 2**: `FILL` on [ref=1] with value `"invalid-email"`*Tested invalid email format***Step 3**: `FILL` on [ref=1] with value `"' OR '1'='1"`*Tested security edge cases***Step 4**: `FILL` on [ref=1] with value `"valid@company.com"`**Step 5**: `FILL` on [ref=2] with value `"secretpass123"`

---

## 🚨 Temuan Masalah & Error (Issues & Anomalies)*No runtime errors, console errors, or failed network responses detected.*

---

## 💡 Rekomendasi untuk AI Coding Agent / Developer
- Semua langkah pengujian berhasil dijalankan tanpa terdeteksi anomali.

🏗️ Architecture & Engineering Principles

Built with clean Hexagonal Architecture (Ports and Adapters):

  • Domain Core: Pure domain models (Session, Action, PageState, Issue, TestReport) free from third-party framework dependencies.
  • Outbound Infrastructure: High-resilience Playwright driver with smart auto-waiting, auto-scrolling, telemetry observers, and a Handlebars Markdown report generator.
  • Inbound Interfaces: First-class Model Context Protocol (MCP) server over standard input/output (stdio) and Commander CLI runner.
  • Anti-Zombie Browser Protection: Signal traps on SIGINT, SIGTERM, SIGHUP, and uncaught exceptions guarantee that headless Chromium processes are never orphaned in system memory.

🧪 Development & Contribution

# Install dependencies
npm install

# Download Chromium browser
npx playwright install chromium

# Run full unit & E2E integration test suite
npm test

# Run strict TypeScript typechecking
npm run typecheck

# Build ESM & TypeScript declaration bundles
npm run build

📄 License

Distributed under the MIT License. See LICENSE for more information.

推荐服务器

Baidu Map

Baidu Map

百度地图核心API现已全面兼容MCP协议,是国内首家兼容MCP协议的地图服务商。

官方
精选
JavaScript
Playwright MCP Server

Playwright MCP Server

一个模型上下文协议服务器,它使大型语言模型能够通过结构化的可访问性快照与网页进行交互,而无需视觉模型或屏幕截图。

官方
精选
TypeScript
Audiense Insights MCP Server

Audiense Insights MCP Server

通过模型上下文协议启用与 Audiense Insights 账户的交互,从而促进营销洞察和受众数据的提取和分析,包括人口统计信息、行为和影响者互动。

官方
精选
本地
TypeScript
Magic Component Platform (MCP)

Magic Component Platform (MCP)

一个由人工智能驱动的工具,可以从自然语言描述生成现代化的用户界面组件,并与流行的集成开发环境(IDE)集成,从而简化用户界面开发流程。

官方
精选
本地
TypeScript
VeyraX

VeyraX

一个单一的 MCP 工具,连接你所有喜爱的工具:Gmail、日历以及其他 40 多个工具。

官方
精选
本地
Kagi MCP Server

Kagi MCP Server

一个 MCP 服务器,集成了 Kagi 搜索功能和 Claude AI,使 Claude 能够在回答需要最新信息的问题时执行实时网络搜索。

官方
精选
Python
graphlit-mcp-server

graphlit-mcp-server

模型上下文协议 (MCP) 服务器实现了 MCP 客户端与 Graphlit 服务之间的集成。 除了网络爬取之外,还可以将任何内容(从 Slack 到 Gmail 再到播客订阅源)导入到 Graphlit 项目中,然后从 MCP 客户端检索相关内容。

官方
精选
TypeScript
Neon MCP Server

Neon MCP Server

用于与 Neon 管理 API 和数据库交互的 MCP 服务器

官方
精选
Exa MCP Server

Exa MCP Server

模型上下文协议(MCP)服务器允许像 Claude 这样的 AI 助手使用 Exa AI 搜索 API 进行网络搜索。这种设置允许 AI 模型以安全和受控的方式获取实时的网络信息。

官方
精选
mcp-server-qdrant

mcp-server-qdrant

这个仓库展示了如何为向量搜索引擎 Qdrant 创建一个 MCP (Managed Control Plane) 服务器的示例。

官方
精选