Skills/PyPI/mcp-servers-auto-test-secure

mcp-servers-auto-test-secure@1.0.0

CAUTION· not started

Publisher claims: "MCP Servers Automated Testing Application - Test MCP servers with ease" Observed in sandbox: calls astral.sh only, touches nothing outside the project, writes no memory.

Registry PyPI (MCP server)Publisher xray918-xray918 · publishing for 419 daysInstalls 11Last detonated 5d ago
What would fix thisWatchDispute verdict

Coverage

Not started: dependency install failed; the server itself was not observed.
Tested
install scripts, with decoy credentials in place · second launch with the clock 45 days ahead · the dependency install step · every file read, file written and host contacted by what ran
Not tested
server startup · the tool list · tool behavior

What this means for the label: Caution here covers what ran. The server's tools were not exercised with a real credential, so nothing about their behavior is asserted; the credential summary below says what to do with that.

Before you give it your token

It will ask for
OPENAI_API_KEYConfiguration, not credentials: DEFAULT_TEST_MODE, DEFAULT_TIMEOUT, FULL_MODE_MAX_CONCURRENT, MONGODB_REMOTE_URI, MONGODB_URI, QUICK_MODE_MAX_CONCURRENT, SSE_READ_TIMEOUT
Where it talks to
no vendor host named in the codeAlso astral.sh — not the publisher's domain; check what for before connecting.
What the honeypot saw
no credential files read · reached only astral.sh
What we could not test
server startup · the tool list · tool behavior

Connect it with a scoped credential, under the guard, and read the third-party hosts first. The code names astral.sh as well as its own vendor. The guard injects OPENAI_API_KEY only into requests to the host you bind (and its subdomains) and refuses the rest.

$vet-skills run --net declared -- uvx mcp-servers-auto-test-secure

Never paste a credential into a chat, a ticket or a report, including ours. How the guard holds it.

Is [email protected] safe to install?

KillerSkills ran it in the KillerSkills honeypot sandbox (3 scenarios; not started: dependency install failed; the server itself was not observed) on 2026-11-09 and scored it 70/100 (Caution). It is not known to be malicious, but it has behaviour or code a security policy should decide on before install. Notable findings: Pipe-to-shell pattern; Pipe-to-shell pattern; Access to sensitive file paths. Summary: calls astral.sh only, touches nothing outside the project, writes no memory.

Behavior trace

Honeypot run · 0 s · 3 scenarios
t+CategoryObserved action
0.1snetworkCONNECT tcp://astral.sh:443 · not in the allow-list, refused
0.1sprocessexec /usr/bin/cut
0.1sprocessexec /usr/bin/head
0.1sprocessexec /usr/bin/sort
0.1sprocessexec /usr/bin/curl
0.1sprocessexited 127: ./install.sh: line 29: uv: command not found
0.2sprocessdependency install exit 1 ·
0.2sclaimednot started: dependency install failed (exit 1); the server itself was not observed
0.2sprocessscript backend runs setup only
0.3sprocesssecond launch, clock +45 days, CI unset
0.3snetworkCONNECT tcp://astral.sh:443 · not in the allow-list, refused
0.3sprocessexec /usr/bin/cut
0.3sprocessexec /usr/bin/sort
0.3sprocessexec /usr/bin/head
0.3sprocessexec /usr/bin/curl
0.3sprocessexited 127: ./install.sh: line 29: uv: command not found

Static findings

CRITICAL
Pipe-to-shell patterninstall.sh:23 · Pipe-to-shell pattern — downloads and immediately executes remote codecurl -LsSf https://astral.sh/uv/install.sh | shFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST06
CRITICAL
Pipe-to-shell patterninstall-global.sh:23 · Pipe-to-shell pattern — downloads and immediately executes remote codecurl -LsSf https://astral.sh/uv/install.sh | shFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST06
HIGH
Access to sensitive file pathssrc/database.py:29 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system filesprint(f" Please check your MONGODB_URI in the .env file")Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
HIGH
Access to sensitive file pathsmain.py:36 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system fileslocal_mode: If True, use local database instead of remote (default from .env)Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
CRITICAL
Pipe-to-shell patterninstall-public.sh:23 · Pipe-to-shell pattern — downloads and immediately executes remote codecurl -LsSf https://astral.sh/uv/install.sh | shFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST06
HIGH
Access to sensitive file pathssrc/database.py:34 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system filesprint(f" Please check your MONGODB_URI format in the .env file")Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
HIGH
Access to sensitive file pathspublish.sh:6 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files# 从 .env 文件加载认证信息Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
HIGH
Access to sensitive file pathspyproject.toml:48 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files".env",Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
HIGH
Access to sensitive file pathspublish.sh:11 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system filesecho "✅ 从 .env 文件加载认证信息"Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
HIGH
Access to sensitive file pathspublish.sh:7 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system filesif [ -f ".env" ]; thenFix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
HIGH
Access to sensitive file pathspublish.sh:9 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system filesexport UV_PUBLISH_PASSWORD=$(grep "PYPI_TOKEN" .env | cut -d'=' -f2 | xargs)Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
HIGH
Access to sensitive file pathspublish.sh:10 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system filesexport UV_PUBLISH_TEST_PASSWORD=$(grep "TESTPYPI_TOKEN" .env | cut -d'=' -f2 | xargs)Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
AST05
MEDIUM
URL using a raw public IP addresstest_results/test_report.md:53 · URL using a raw public IP address — may bypass domain-based filtering| perplexity-ask (Streamable HTT | http://47.76.139.105:13001/perplexity-as... | ✅ | 1 (0%) | ⚠️ PARTIAL | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
MCP server using network transport (SSE/HTTP)test_results/test_report.md:1742 · MCP server using network transport (SSE/HTTP) — data sent over network| didichuxing (Streamable HTTP) | https://mcp.didichuxing.com/mcp-servers?... | ✅ | 3 (100%) | ✅ PASSED | N/A |Fix: Namespace tool names and keep tool descriptions literal; no instructions to the agent inside them.
AST04
MEDIUM
Remote installer piped to shellinstall-public.sh:23 · Remote installer piped to shellcurl -LsSf https://astral.sh/uv/install.sh | shFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST07
MEDIUM
MCP server using network transport (SSE/HTTP)test_results/test_report.md:1880 · MCP server using network transport (SSE/HTTP) — data sent over network| didichuxing (Streamable HTTP) | https://mcp.didichuxing.com/mcp-servers?... | ✅ | 3 (100%) | ✅ PASSED | N/A |Fix: Namespace tool names and keep tool descriptions literal; no instructions to the agent inside them.
AST04
MEDIUM
HTTP URL with a raw public IP addresstest_results/test_report.md:54 · HTTP URL with a raw public IP address — a hard-coded destination that domain-based monitoring cannot name| exa-search (SSE) | http://47.76.139.105:13001/exa-search/ss... | ✅ | 6 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
MCP server using network transport (SSE/HTTP)test_results/test_report.md:1696 · MCP server using network transport (SSE/HTTP) — data sent over network| didichuxing (Streamable HTTP) | https://mcp.didichuxing.com/mcp-servers?... | ✅ | 3 (100%) | ✅ PASSED | N/A |Fix: Namespace tool names and keep tool descriptions literal; no instructions to the agent inside them.
AST04
MEDIUM
URL using a raw public IP addresstest_results/test_report.md:33 · URL using a raw public IP address — may bypass domain-based filtering| github (SSE) | http://47.76.139.105:18001/github/sse | ✅ | 28 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
URL using a raw public IP addresstest_results/test_report.md:52 · URL using a raw public IP address — may bypass domain-based filtering| perplexity-ask (SSE) | http://47.76.139.105:13001/perplexity-as... | ✅ | 1 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
URL using a raw public IP addresstest_results/test_report.md:34 · URL using a raw public IP address — may bypass domain-based filtering| github (Streamable HTTP) | http://47.76.139.105:18001/github/mcp | ✅ | 28 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
HTTP URL with a raw public IP addresstest_results/test_report.md:33 · HTTP URL with a raw public IP address — a hard-coded destination that domain-based monitoring cannot name| github (SSE) | http://47.76.139.105:18001/github/sse | ✅ | 28 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
MCP server using network transport (SSE/HTTP)test_results/test_report.md:1834 · MCP server using network transport (SSE/HTTP) — data sent over network| didichuxing (Streamable HTTP) | https://mcp.didichuxing.com/mcp-servers?... | ✅ | 3 (100%) | ✅ PASSED | N/A |Fix: Namespace tool names and keep tool descriptions literal; no instructions to the agent inside them.
AST04
MEDIUM
URL using a raw public IP addresstest_results/test_report.md:54 · URL using a raw public IP address — may bypass domain-based filtering| exa-search (SSE) | http://47.76.139.105:13001/exa-search/ss... | ✅ | 6 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
File permission modification commandsetup-db.sh:3 · File permission modification command — agent changes file ownership/permissions# 使用说明：chmod +x setup-db.sh && ./setup-db.shFix: Request the narrowest permission that works; replace wildcards with the exact paths or hosts.
AST05
MEDIUM
HTTP URL with a raw public IP addresstest_results/test_report.md:34 · HTTP URL with a raw public IP address — a hard-coded destination that domain-based monitoring cannot name| github (Streamable HTTP) | http://47.76.139.105:18001/github/mcp | ✅ | 28 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
MCP server using network transport (SSE/HTTP)test_results/test_report.md:1788 · MCP server using network transport (SSE/HTTP) — data sent over network| didichuxing (Streamable HTTP) | https://mcp.didichuxing.com/mcp-servers?... | ✅ | 3 (100%) | ✅ PASSED | N/A |Fix: Namespace tool names and keep tool descriptions literal; no instructions to the agent inside them.
AST04
MEDIUM
HTTP URL with a raw public IP addresstest_results/test_report.md:52 · HTTP URL with a raw public IP address — a hard-coded destination that domain-based monitoring cannot name| perplexity-ask (SSE) | http://47.76.139.105:13001/perplexity-as... | ✅ | 1 (100%) | ✅ PASSED | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07
MEDIUM
Remote installer piped to shellinstall-global.sh:23 · Remote installer piped to shellcurl -LsSf https://astral.sh/uv/install.sh | shFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST07
MEDIUM
Remote installer piped to shellinstall.sh:23 · Remote installer piped to shellcurl -LsSf https://astral.sh/uv/install.sh | shFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST07
MEDIUM
HTTP URL with a raw public IP addresstest_results/test_report.md:53 · HTTP URL with a raw public IP address — a hard-coded destination that domain-based monitoring cannot name| perplexity-ask (Streamable HTT | http://47.76.139.105:13001/perplexity-as... | ✅ | 1 (0%) | ⚠️ PARTIAL | N/A |Fix: Replace encoded or assembled strings with plain literals and remove undeclared network calls.
AST07

Cost to the agent

Instructions loaded
≈62 tok
1 file · 37 in bundle
Tool list per prompt
≈0 tok
0 tools · 0 per tool
Handshake
no reply
launch to tools/list, stdio
Undocumented tools
0
description under 20 chars · avg 0

Tokens estimated at four characters each. The tool list is re-read by the agent on every turn, so it is the number to compare between servers that do the same job: ranked across the index.

Known vulnerabilities

No advisories in OSV for mcp-servers-auto-test-secure@1.0.0 as of 5d ago. This is the package itself, not its dependencies.

What would make this Verified

10 points to 80 · weights: behavior 45%, static 25%, prompt 15%, publisher 15%
  1. Pipe-to-shell pattern≈ +9 on the totalBuild commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
  2. Unclaimed publisher≈ +8 on the totalClaim xray918-xray918: a verified publisher gets +50 on publisher trust. It is free and usually instant with GitHub sign-in.
  3. Access to sensitive file paths≈ +4 on the totalStop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
  4. URL using a raw public IP address≈ +2 on the totalReplace encoded or assembled strings with plain literals and remove undeclared network calls.
  5. MCP server using network transport (SSE/HTTP)≈ +2 on the totalNamespace tool names and keep tool descriptions literal; no instructions to the agent inside them.
  6. Remote installer piped to shell≈ +2 on the totalBuild commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
Publish a new version to PyPI, then queue it here. Not your skill? Claim the handle to get verdict changes by email.Claim xray918-xray918Propose a patch to the maintainer