mcp-evals@2.0.1

CAUTION

Publisher claims: "GitHub Action for evaluating MCP server tool calls using LLM-based scoring" Observed in sandbox: no network, touches nothing outside the project, writes no memory.

Registry npm (MCP server)Publisher mclenhard · joined 0 days agoInstalls 173KLast detonated 2 h ago

Dispute verdict

Behavior trace

Honeypot run · 2 s · 2 scenarios · 0 deviations

t+CategoryObserved action

0.0sprocessno install scripts in bundle

1.9sprocessdependency install exit 1

2.1sprocessexec /usr/bin/timeout

2.1sprocessexited 1: Node.js v22.23.4

2.1sclaimedno tools/list reply (exit 1)

2.1sprocessscript backend runs setup only

Static findings

CRITICAL

Access to sensitive file pathsdist/cli.js:7 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files

AST05

CRITICAL

Access to sensitive file pathsdist/index.js:84 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files

AST05

HIGH

npx invocation of non-well-known packagedist/cli.js:23 · npx invocation of non-well-known package — may execute untrusted code

AST06

HIGH

npx invocation of non-well-known packageREADME.md:124 · npx invocation of non-well-known package — may execute untrusted code

AST06

HIGH

File permission modification commandpackage.json:25 · File permission modification command — agent changes file ownership/permissions

AST05

CRITICAL

Access to sensitive file pathsdist/yaml-loader.js:50 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files

AST05

CRITICAL

Access to sensitive file pathsdist/index.js:9 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files

AST05

HIGH

npx invocation of non-well-known packagedist/cli.js:17 · npx invocation of non-well-known package — may execute untrusted code

AST06

HIGH

npx invocation of non-well-known packageREADME.md:121 · npx invocation of non-well-known package — may execute untrusted code

AST06

CRITICAL

Access to sensitive file pathsdist/yaml-loader.js:43 · Access to sensitive file paths — SSH keys, AWS credentials, env files, or system files

AST05

MEDIUM

File type combined with upload actiondist/metrics.js:39 · File type combined with upload action — agent may exfiltrate local data files

AST07