com.rubrkit/rubrkit
Official30 toolsMCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
Rubric-based evaluation and auditing tools for AI and LLM output quality.
Captured live from the server via tools/list.
rubrkit_search_api_docs
Search the canonical docs/api Markdown guides and OpenAPI operation summaries.
Parameters (2)
- querystringrequired
- limitinteger
rubrkit_read_api_doc
Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path.
Parameters (1)
- slugOrPathstringrequired
rubrkit_read_openapi_contract
Read the canonical docs/api/openapi.yaml contract.
No parameters.
rubrkit_create_artifact_bundle
Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys.
Parameters (4)
- namestringrequired
- descriptionstring | null
- customRubricobject
- settingsobject
rubrkit_list_artifact_bundles
List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys.
Parameters (2)
- statusstring
- limitinteger
rubrkit_read_artifact_bundle
Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys.
Parameters (1)
- artifactBundleIdstringrequired
rubrkit_delete_artifact_bundle
Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys.
Parameters (1)
- artifactBundleIdstringrequired
rubrkit_hard_delete_artifact_bundle
Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API keys.
Parameters (1)
- artifactBundleIdstringrequired
rubrkit_upload_artifact_files
Upload one or more text files into an artifact bundle. Requires files:write for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- filesarrayrequired
rubrkit_list_artifact_files
List files in an artifact bundle. Requires files:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- limitinteger
rubrkit_read_artifact_file
Read the latest file metadata and content. Requires files:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- fileIdstringrequired
rubrkit_update_artifact_file
Write a new editable version for a file. Requires files:write for API keys.
Parameters (5)
- artifactBundleIdstringrequired
- fileIdstringrequired
- contentstringrequired
- mediaTypestring
- messagestring
rubrkit_start_audit
Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys.
Parameters (10)
- artifactBundleIdstringrequired
- targetFileIdstring
- targetVersionNumberinteger
- artifactBundleVersionNumberinteger
- rubricKeystring
- artifactTypestring
- customRequirementsarray
- modelTierstring
- reasoningEffortstring
- forceboolean
rubrkit_list_audits
List persisted audit history. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- limitinteger
rubrkit_read_audit
Read a single audit run. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- auditRunIdstringrequired
rubrkit_apply_audit_rewrite
Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- auditRunIdstringrequired
rubrkit_convert_to_rubr_flow
Start an async rubr_flow conversion job. Requires rubr_flow:convert for API keys.
Parameters (7)
- artifactBundleIdstringrequired
- targetFileIdstring
- targetVersionNumberinteger
- artifactBundleVersionNumberinteger
- outputPathstring
- modelTierstring
- reasoningEffortstring
rubrkit_list_rubr_flow_conversions
List conversion history. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- limitinteger
rubrkit_read_rubr_flow_conversion
Read one conversion report. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- conversionIdstringrequired
rubrkit_poll_job
Read async job progress. Requires jobs:read for API keys.
Parameters (1)
- jobIdstringrequired
rubrkit_list_job_events
Read append-only job progress events. Requires jobs:read for API keys.
Parameters (2)
- jobIdstringrequired
- limitinteger
rubrkit_list_artifact_bundle_versions
List bundle-level version events. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- limitinteger
rubrkit_restore_artifact_bundle_version
Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys.
Parameters (3)
- artifactBundleIdstringrequired
- versionNumberintegerrequired
- messagestring
rubrkit_list_file_versions
List immutable versions for a file. Requires files:read for API keys.
Parameters (3)
- artifactBundleIdstringrequired
- fileIdstringrequired
- limitinteger
rubrkit_restore_file_version
Restore a prior file version by creating a new version. Requires files:write for API keys.
Parameters (4)
- artifactBundleIdstringrequired
- fileIdstringrequired
- versionNumberintegerrequired
- messagestring
rubrkit_run_evals
Start an async eval run. Requires evals:run for API keys.
Parameters (11)
- artifactBundleIdstringrequired
- auditRunIdstring
- sourceFileVersionIdstring
- sourceFileIdstring
- sourceVersionNumberinteger
- candidateFileVersionIdstring
- candidateFileIdstring
- candidateVersionNumberinteger
- rubricVersionstring
- maxCasesinteger
- testCasesarray
rubrkit_list_evals
List eval history. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- limitinteger
rubrkit_read_eval
Read one eval run. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- evalRunIdstringrequired
rubrkit_export_proof_report
Start an async proof report job with export storage enabled by default. Requires evals:run for API keys.
Parameters (11)
- artifactBundleIdstringrequired
- evalRunIdstring
- auditRunIdstring
- sourceFileVersionIdstring
- sourceFileIdstring
- sourceVersionNumberinteger
- candidateFileVersionIdstring
- candidateFileIdstring
- candidateVersionNumberinteger
- rubricVersionstring
- includeExportboolean
rubrkit_read_proof_report
Read one proof report. Requires artifact_bundles:read for API keys.
Parameters (2)
- artifactBundleIdstringrequired
- proofReportIdstringrequired
README not available yet.
Install
claude_desktop_config.json
{
"mcpServers": {
"rubrkit": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://www.rubrkit.com/api/v1/mcp"
]
}
}
}Desktop config is stdio-only; this bridges via mcp-remote. Native remote: Settings > Connectors.