Contract testing and quality gates for spreadsheets created by AI agents.
io.github.helloo1568/sheetspec MCP Server
This MCP server provides contract testing and quality gates for spreadsheets created by AI agents. It focuses on catching spreadsheet delivery errors before an AI agent reports completion. The project is associated with tools and validation workflows related to spreadsheet formats and Excel/XLSX generation.
🛠️ Key Features
Contract testing for AI-generated spreadsheets
Quality gates to prevent delivery errors
Spreadsheet validation for Excel/XLSX outputs
🚀 Use Cases
Verifying spreadsheets produced by AI agents
Enforcing data quality checks before downstream use
Ensuring Excel/Spreadsheet compliance in automated pipelines
⚡ Developer Benefits
Early detection of spreadsheet delivery errors
Integration into MCP-server-based testing/validation workflows
Reusable validation practices for Python-based spreadsheet work
⚠️ Limitations
Based on the provided description: details of specific tools and test mechanics are not included beyond contract testing and quality gates.
Catch spreadsheet delivery errors before an AI agent says "done."
SheetSpec validates .xlsx workbooks against reviewed, lockable acceptance contracts.
It catches missing formulas, duplicate identifiers, wrong totals, invalid data types, and
unauthorized template edits, then returns structured issues at worksheet, cell, or range
level that an agent can repair.
It provides deterministic Excel/XLSX validation, contract testing, and quality gates
for workbooks created or modified by AI agents. It is not another Excel chatbot or a
silent auto-fixer.
text
user requirements -> reviewed contract -> locked acceptance target
-> agent creates or edits Excel -> SheetSpec validates independently
-> structured repair issues -> agent repairs and revalidates -> deliver after passing
SheetSpec Agent Gate demo
Why agents need an independent gate
An agent can create a workbook that opens successfully and looks plausible while still
shipping hidden errors. Asking the same agent to "check its work" is useful, but it is
not an independent acceptance test: the agent can overlook the same mistake, reinterpret
the requirement, or change the target while repairing the file.
SheetSpec separates creation from acceptance:
Capability
Risk addressed
Reviewed contracts
Business requirements being guessed from workbook structure
Contract locks
Acceptance-target changes going undetected after work begins
Independent validation
"The file saved" being treated as "the task is correct"
Structured repair issues
Vague retries without a rule, worksheet, cell, expected value, or actual value
Protected baseline ranges
Unauthorized template value or formula changes going undetected
SheetSpec validates only the rules you declare. A passing result means the declared
contract passed; it does not claim that every unstated business assumption is correct.
Try SheetSpec
SheetSpec requires Python >=3.11,<3.15. With
uv, you can run it without installing it permanently.
1. Verify the CLI
bash
uvx sheetspec --version
Or install it with pip:
bash
pip install sheetspec
2. Run the included broken/fixed demo
bash
git clone --depth 1 https://github.com/helloo1568/SheetSpec.git
cd SheetSpec
uv sync
uv run python examples/create_demo.py
uv run sheetspec lock examples/sales-report.spec.yaml \
--baseline examples/sales-report-template.xlsx \
--output examples/sales-report.spec.lock.demo.json
uv run sheetspec check examples/sales-report-broken.xlsx \
--spec examples/sales-report.spec.yaml \
--lock examples/sales-report.spec.lock.demo.json \
--format text
uv run sheetspec check examples/sales-report-fixed.xlsx \
--spec examples/sales-report.spec.yaml \
--lock examples/sales-report.spec.lock.demo.json \
--format json
The broken workbook demonstrates missing month headers, duplicate orders, text stored
as an amount, missing and inconsistent formulas, a wrong total, and protected-template
changes. The fixed workbook passes the same locked contract. Its JSON summary includes:
MCP makes SheetSpec callable. The included Agent Skill defines when it should be called,
and CI can enforce the same acceptance contract after the agent finishes.
Results are deterministically ordered and capped at 500 visible issues while preserving
the total issue count.
How the Agent Gate works
flowchart LR
A["Describe requirements"] --> B["Draft acceptance contract"]
B --> C["Human reviews contract"]
C --> D["Lock contract"]
D --> E["Agent creates or edits Excel"]
E --> F["Validate independently"]
F -->|failed| G["Read structured issues and repair"]
G --> F
F -->|passed| H["Deliver workbook and report"]
The contract lock stores SHA-256 hashes for the normalized contract and optional
baseline workbook. It detects changes; Git history, review, and CI remain the security
boundary.
The test suite launches a real STDIO subprocess, initializes an MCP client session,
lists all tools, and calls workbook inspection and validation end to end.
Agent Skill
Install skills/sheetspec/ in the agent's skill directory. The skill instructs the
agent not to change the contract merely to pass validation, edit the workbook during
validation, claim formula results were verified when cached values are missing, or
claim delivery success while error-level issues remain. Contract locks and CI provide
the enforceable checks around that workflow.
Technical boundaries
.xlsx workbooks are read-only; SheetSpec does not modify the source workbook.
openpyxl does not recalculate arbitrary Excel formulas.
Complex external formulas, VBA, Power Query, and pivot-table semantics are outside
the v0.1 scope.
passed means all declared checks passed, not that the entire business model is
universally correct.
Workbooks above 50 MB and rules covering more than 100,000 cells are rejected.
Results expose at most 500 visible issues while preserving the total issue count.
Roadmap
0.2: optional LibreOffice recalculation, JUnit/SARIF output, and rule plugins;
0.3: more templates, interactive MCP reports, and constrained repair helpers;
long term: a standard quality gate for spreadsheet-producing agents.
Open source
SheetSpec uses an original validation engine and depends on openpyxl, Pydantic,
PyYAML, Typer, Jinja2, and the MCP Python SDK. See
THIRD_PARTY_NOTICES.md.