Katalon True Platform MCP: design tests, run with AI, upload reports, assess release readiness.
Katalon True Platform MCP server focused on test design and execution workflows, including running tests, uploading reports, and assessing release readiness. It is described as “True Skills” for testing skills for agents in the Katalon True Platform, aligned with Model Context Protocol (MCP).
🛠️ Key Features
Design tests for agent workflows
Run tests with AI
Upload reports
Assess release readiness
Model Context Protocol (MCP) integration
🚀 Use Cases
AI-assisted test design and execution
Sharing test results via report uploads
Release readiness assessment based on test outcomes
⚡ Developer Benefits
Supports agentic AI testing and test management workflows
Includes tooling/topic alignment for testing and automation: QA, testing, test-automation, test-management, testops
⚠️ Limitations
Available source data provides a high-level description only (no specific tool list or commands).
Ask your coding agent to read a requirement, design the test cases, run them with AI, upload the reports, and tell you whether the release is safe to ship. The skills do the platform work through the Katalon MCP, so the agent operates your real project instead of guessing at it.
An example session. Your requirement keys, suites, and verdicts come from your own workspace.
Quickstart
1. Install the skills. The skills CLI detects the agent you already run (70+ supported) and drops the skills into its native directory.
bash
npx skills add katalon-labs/true-skills
2. Point it at your Katalon workspace. Add the MCP server to your agent's config file (the install section says which file yours is):
First connect opens a browser OAuth flow and lets you pick your workspace. Nothing to fill in, no tokens to paste, no keys to store.
3. Ask for something real.
text
Set up Katalon MCP and verify my projects.
Create manual tests from requirement CEL-6 and link them.
Which requirements in this sprint have no test coverage?
Run that suite with AI and summarize what broke.
Generate a Playwright script from test case TC-1042.
Upload my Playwright report to Katalon and verify the run.
Is release 3.2 safe to ship?
Or hand over the whole chain: "Analyze CEL-6, design and import the cases, build a suite, run it with AI, and tell me if we can ship."
Start where you are
Four jobs. Say the situation in your own words and the agent picks the skill.
You are a
You say
It starts at
Manual tester QA analyst, test analyst
I just got requirement CEL-6 and need cases · Run this suite with AI and tell me what broke · Is this failure the app or my test
Not connected yet? Start at platform-setup, which everyone runs once.
Not sure which one you are, or the request spans several? Ask true-platform-testing and it routes by role and by stage. The full map from intent to skill, including what to fall back to for the parts not built yet, is in lifecycle-map.md.
The skills
Eighteen skills, one folder each under skills/. The agent picks the right one from its description, so you rarely name a skill yourself.
Turns quality goals into scope, ranks the work by requirement coverage and risk, and builds the folder and suite structure that acts as the executable plan.
Sizes a test cycle from scope, risk, and historical execution data, resources it across the manual and automated lanes, and states the uncertainty instead of inventing precision.
Reads a requirement or free text, designs atomic manual cases with ISTQB techniques as reference, skips duplicates, imports only what is missing, and links each case back to the requirement.
Designs the data a case runs on, decides what must exist before a run, keeps literals out of the step text, and resets state afterwards so the next run starts clean.
Organizes folders and suites, finds assets at scale, and produces a requirement to case to suite traceability report with coverage percentage and orphans.
Reviews coverage, case quality, and flakiness before anything enters the pipeline, and returns Approve, Approve with fixes, or Reject plus the specific weak cases.
Turns platform quality data into the few metrics that answer a stakeholder question, trended across releases, as a summary a manager can present upward.
Seven stages, each owned by a skill. The loop closes when maintenance feeds its gap list back into the plan.
platform-setup sits before all seven, connecting the MCP. Every skill states which Katalon MCP tools it uses and where the platform stops. Full stage map: lifecycle-map.md. Every tool in one line each: mcp-tool-index.md. A self-contained visual for humans: docs/lifecycle.html.
Where the boundary is
Each skill names its limits up front so the agent does not promise work the platform cannot do.
Through the MCP: list projects and repositories, read requirements, create and update and link test cases, manage suites and folders, create manual runs, start Run with AI, poll AI sessions, read results, fetch quality metrics, and file ALM-linked defects.
Not through the MCP: creating requirements, creating a formal Test Plan entity, guaranteeing an AI run finishes, or inspecting the live app UI without a browser tool. A named suite plus a release or sprint association stands in for the Test Plan entity.
Some work is a product surface rather than an API call: object capture and resilience design in Studio, custom fields and Git config and governance in the TestOps UI, self-healing and Time Capsule and TrueTest regeneration, and rerun, terminate, and Live Monitor. The full list is in unavailable-capabilities.md.
This repository conforms to the Agent Plugins specification 1.0.0: plugin.json + skills/ + mcp.json at the repo root form a portable plugin any conformant client can load directly, and plugins/katalon-true-platform/ ships the same contract as a standalone plugin directory. Skills follow the Agent Skills format. Point your standard-aware client at either directory; mcp.json already declares the canonical endpoint as a streamable-http server, so there is nothing to fill in.
Claude Code plugin marketplace
bash
claude plugin marketplace add katalon-labs/true-skills
claude plugin install katalon-true-platform@katalon-true-platform-marketplace
Developing against a checkout:
bash
claude --plugin-dir plugins/katalon-true-platform
The plugin ships the skills and an .mcp.json. If your setup does not auto-load the bundled MCP, add it manually.
VS Code (agent mode) - skills in .github/skills/ load automatically; prompt files stay available as /platform-setup etc. Start the katalon-prod-mcp server when VS Code offers it: it signs you in through the browser OAuth flow and you pick your workspace. Nothing to configure, no token pasting.
Copilot CLI - the same skills are auto-discovered (/skills list to see them). The MCP server auto-loads from .github/mcp.json with no edits; or register it interactively with /mcp add (type http, same URL). The CLI does not read .vscode/mcp.json.
Copilot coding agent & code review - read .github/skills/ from your repository automatically. Neither surface supports OAuth remote MCP servers yet, so keep Katalon platform operations in VS Code or the CLI for now.
Cursor project rules
bash
cp -R <checkout>/.cursor .cursor
Rules in .cursor/rules/*.mdc load by description when relevant. MCP config lives in .cursor/mcp.json.
Kiro steering docs
bash
cp -R <checkout>/.kiro .kiro
Steering docs use manual inclusion, so reference one in chat with #true-platform-testing. MCP config lives in .kiro/settings/mcp.json.
Kiro Crew app
Kiro Crew installs this as an app — apps/katalon-testing-skills/ carries an app.json manifest that registers all 18 skills and the katalon-prod-mcp server on install. From the dashboard's Apps page, install from the local path, or submit the repo to the Kiro Crew app registry so it appears under Apps → Discover. First MCP connect opens the browser OAuth flow and a workspace picker.
bash
# local/developer install: point Kiro Crew at the app directory
apps/katalon-testing-skills/
Rules in .windsurf/rules/*.md trigger on their description. Add the MCP under Settings → MCP, or in ~/.codeium/windsurf/mcp_config.json.
Cline project rules
bash
cp -R <checkout>/.clinerules .clinerules
Cline loads every file in .clinerules/. Add the MCP through its MCP Servers panel.
Continue rules and MCP block
bash
cp -R <checkout>/.continue .continue
Rules live in .continue/rules/*.md, the MCP block in .continue/mcpServers/katalon.yaml.
Anything else via AGENTS.md
Point your agent at AGENTS.md. It indexes every skill and tells the agent to open skills/<name>/SKILL.md. Use the root .mcp.json for the server config.
Connect the Katalon MCP
One endpoint serves every workspace: https://platform.katalon.io/mcp. Sign-in presents a workspace picker, so there is no subdomain to look up. The canonical shape lives in .mcp.json:
Complete the browser OAuth flow that opens on first connect.
Pick your workspace.
Reload the agent if the tools do not show up.
On a dedicated Katalon domain, substitute https://<your-sub-domain>.katalon.io/mcp.
Auth is browser OAuth only. Never paste passwords, API tokens, cookies, JWTs, MFA codes, or OAuth callback URLs into chat, and never commit them. The skills enforce this.
How it is built
The skill bodies live once. Everything each agent needs is generated from them, so no adapter can drift.
text
skills/ 13 SKILL.md files plus references/
|
| node scripts/build-adapters.mjs deterministic, checked in CI
v
Claude Code · Codex · Copilot · Cursor · Kiro · Windsurf · Cline · Continue · AGENTS.md
|
| every adapter points at the same server
v
Katalon MCP -> requirements, test cases, suites, Run with AI, results, defects
The skills are plain markdown that runs inside the agent you already use. This repository collects nothing. Platform operations go to your own Katalon workspace over OAuth, and what Katalon does with that data is covered by the Katalon Privacy Policy.
