Skills/PyPI/mcp-quality

mcp-quality@0.8.0

VERIFIED· not started

Publisher claims: "The CI quality suite for MCP servers — lint, contract-test, benchmark, and load-test your MCP server before you ship it." Observed in sandbox: no network, touches nothing outside the project, writes no memory.

Registry PyPI (MCP server)Publisher swarmproof · publishing for 78 daysInstalls 151Last detonated 6d ago
$claude mcp add mcp-quality -- uvx mcp-quality
WatchReport an issue

Coverage

Not started: dependency install failed; the server itself was not observed.
Tested
the dependency install step · every file read, file written and host contacted by what ran
Not tested
server startup · the tool list · tool behavior

What this means for the label: Verified here covers what ran. The server's tools were not exercised with a real credential, so nothing about their behavior is asserted; the credential summary below says what to do with that.

Before you give it your token

It will ask for
ANTHROPIC_API_KEYOPENAI_API_KEYConfiguration, not credentials: GITHUB_SHA
Where it talks to
no vendor host named in the codeAlso example.test — not the publisher's domain; check what for before connecting.
What the honeypot saw
no credential files read · no network
What we could not test
server startup · the tool list · tool behavior

Connect it with a scoped credential, under the guard, and read the third-party hosts first. The code names example.test as well as its own vendor. The guard injects ANTHROPIC_API_KEY, OPENAI_API_KEY only into requests to the host you bind (and its subdomains) and refuses the rest.

$vet-skills run --net declared -- uvx mcp-quality

Never paste a credential into a chat, a ticket or a report, including ours. How the guard holds it.

Is [email protected] safe to install?

KillerSkills ran it in the KillerSkills honeypot sandbox (2 scenarios; not started: dependency install failed; the server itself was not observed) on 2026-11-08 and scored it 83/100 (Verified). In what ran, nothing we could detect went wrong: no undeclared network egress, no credential reads, no persistent instruction writes. What it does with a real credential was not observed; the static findings and the publisher carry the rest of the score. Summary: no network, touches nothing outside the project, writes no memory.

Behavior trace

Honeypot run · 0 s · 2 scenarios · 0 deviations
t+CategoryObserved action
0.0sprocessno install scripts in bundle
0.2sprocessdependency install exit 1 ·
0.2sclaimednot started: dependency install failed (exit 1); the server itself was not observed
0.2sprocessscript backend runs setup only
0.2sprocessno install scripts to re-run

Static findings

HIGH
Access to sensitive file pathssrc/mcp_quality/security/path_traversal.py:5 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system filesconstraining it, so ``../../etc/passwd`` escapes the intended root. We can't *prove* aFix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
MEDIUM
npx invocation of non-well-known packagescripts/leaderboard.py:46 · npx invocation of non-well-known package — may execute untrusted code"npx -y @modelcontextprotocol/server-sequential-thinking"),Fix: Pin versions and sources; vendor anything fetched at install time.
AST06
MEDIUM
npx invocation of non-well-known packagescripts/leaderboard.py:47 · npx invocation of non-well-known package — may execute untrusted codeServerSpec("filesystem", "server-filesystem", "npx -y @modelcontextprotocol/server-filesystem /tmp"),Fix: Pin versions and sources; vendor anything fetched at install time.
AST06
HIGH
Access to sensitive file pathssrc/mcp_quality/security/path_traversal.py:89 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files"constraint — a traversal payload (e.g. '../../etc/passwd') could escape "Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
MEDIUM
npx invocation of non-well-known packagescripts/leaderboard.py:44 · npx invocation of non-well-known package — may execute untrusted codeServerSpec("memory", "server-memory", "npx -y @modelcontextprotocol/server-memory"),Fix: Pin versions and sources; vendor anything fetched at install time.
AST06
MEDIUM
Python subprocess execution detectedsrc/mcp_quality/security/adapters.py:73 · Python subprocess execution detectedproc = subprocess.run( # noqa: S603 - invoking a user-approved scannerFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST05
MEDIUM
Python subprocess execution detectedsrc/mcp_quality/cli.py:460 · Python subprocess execution detectedsubprocess.run(step, check=True, capture_output=True, text=True) # noqa: S603Fix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST05
MEDIUM
npx invocation of non-well-known packagescripts/leaderboard.py:43 · npx invocation of non-well-known package — may execute untrusted codeServerSpec("everything", "server-everything", "npx -y @modelcontextprotocol/server-everything"),Fix: Pin versions and sources; vendor anything fetched at install time.
AST06
MEDIUM
npx invocation of non-well-known packagescripts/leaderboard.py:190 · npx invocation of non-well-known package — may execute untrusted codefor spec in specs: # sequential: parallel npx downloads thrash disk/networkFix: Pin versions and sources; vendor anything fetched at install time.
AST06

Cost to the agent

Instructions loaded
≈5,038 tok
3 files · 81 in bundle
Tool list per prompt
≈0 tok
0 tools · 0 per tool
Handshake
no reply
launch to tools/list, stdio
Undocumented tools
0
description under 20 chars · avg 0

Tokens estimated at four characters each. The tool list is re-read by the agent on every turn, so it is the number to compare between servers that do the same job: ranked across the index.

Known vulnerabilities

No advisories in OSV for mcp-quality@0.8.0 as of 6d ago. This is the package itself, not its dependencies.