buildkite@r7
CAUTION· install onlyPublisher claims: "Buildkite MCP lets agents interact with Buildkite Builds, Jobs, Logs, Packages and Test Suites" Observed in sandbox: no network, touches nothing outside the project, writes no memory.
Coverage
Nothing executable in the bundle ran; the trace covers the install step only.- Tested
- every file read, file written and host contacted by what ran
- Not tested
- use of the skill by an agent
What this means for the label: Caution here covers what ran. The server's tools were not exercised with a real credential, so nothing about their behavior is asserted; the credential summary below says what to do with that.
Before you give it your token
- It will ask for
ANTHROPIC_API_KEYBUILDKITE_AGENT_ACCESS_TOKENBUILDKITE_API_TOKENCURSOR_API_KEYDD_API_KEYDOCKERHUB_PASSWORDENTRY_TOKENEVAL_COMPARE_BUILDKITE_API_TOKENGITHUB_TOKENJEV_TOKENMCP_EVAL_FRAMEWORK_JEV_TOKENor--with-token/--api-token/--api-token-from-1passwordConfiguration, not credentials: AGENT_PATH, ANNOTATE_MESSAGES, ANNOTATION_CONTEXT_PREFIX, ANTHROPIC_BASE_URL, BK_SHIM_REAL_BK, BK_SHIM_REQUEST_LOG, BUILDKITE_AGENT_ENDPOINT, BUILDKITE_GRAPHQL_ENDPOINT, BUILDKITE_REQUEST_LOG, BUILDKITE_REST_API_ENDPOINT, PROJECT_PATH, REFERENCE_PATH, RUN_KEY, TEST_API, TEST_EXIT, TEST_PATH- Where it talks to
- no vendor host named in the codeAlso buildkite.com, cursor.com, githubusercontent.com, api.example, storage.example, api.invalid, invalid.test, typesafe.ai — not the publisher's domain; check what for before connecting.
- What the honeypot saw
- no credential files read · no network
- What we could not test
- use of the skill by an agent
Connect it with a scoped credential, under the guard, and read the third-party hosts first. The code names buildkite.com, cursor.com, githubusercontent.com, api.example, storage.example, api.invalid, invalid.test, typesafe.ai as well as its own vendor. The guard injects ANTHROPIC_API_KEY, BUILDKITE_AGENT_ACCESS_TOKEN, BUILDKITE_API_TOKEN, CURSOR_API_KEY, DD_API_KEY, DOCKERHUB_PASSWORD, ENTRY_TOKEN, EVAL_COMPARE_BUILDKITE_API_TOKEN, GITHUB_TOKEN, JEV_TOKEN, MCP_EVAL_FRAMEWORK_JEV_TOKEN only into requests to the host you bind (and its subdomains) and refuses the rest.
Never paste a credential into a chat, a ticket or a report, including ours. How the guard holds it.
Is buildkite@r7 safe to install?
KillerSkills ran it in the KillerSkills honeypot sandbox (1 scenario; nothing executable in the bundle ran; the trace covers the install step only) on 2026-11-12 and scored it 68/100 (Caution). It is not known to be malicious, but it has behaviour or code a security policy should decide on before install. Notable findings: Destructive file system command detected; Hidden zero-width characters detected; Hidden zero-width characters detected. Summary: no network, touches nothing outside the project, writes no memory.
Behavior trace
Honeypot run · 0 s · 1 scenarios · 0 deviationsStatic findings
RUN curl -fsSL https://deb.nodesource.com/setup_${NODE_VERSION}.x | bash - \Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.// reduced to TerseLogEntry, so search_logs matches the {ts,c,rn} formatFix: Build commands from fixed arguments; do not interpolate untrusted strings into a shell.RUN curl -fsS https://cursor.com/install | bashFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.echo "--- 🧑🏻⚖️ [$ENTRY] yilong"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.-o /usr/local/bin/shfmt && chmod +x /usr/local/bin/shfmtFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own."<details open><summary>🧑🏻⚖️ [\(.entry)] yilong — verdicts</summary>\n",Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.-o /usr/local/bin/yq && chmod +x /usr/local/bin/yqFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.RUN curl -fsS https://cursor.com/install | bashFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.RUN curl -fsSL https://deb.nodesource.com/setup_${NODE_VERSION}.x | bash - \Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.…ith it. Produce self-contained Markdown candidates suitable for `evals/expected/<prompt>/<scenario.id>/root_cause.md` and `fix.md`. The harness supplies `reference_path…Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.&& rm -rf /var/lib/apt/lists/*Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.&& rm -rf /var/lib/apt/lists/*Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.chmod +x "$dir/bin/bk"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.RUN chown -R agent:agent /workspaceFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.echo "Error: cursor-agent not found on PATH (install: curl -fsS https://cursor.com/install | bash)"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.echo "ERROR: cursor-agent not found on PATH (install: curl -fsS https://cursor.com/install | bash)" >&2Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.echo "ERROR: cursor-agent not found on PATH (install: curl -fsS https://cursor.com/install | bash)" >&2Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.metrics = subprocess.run([str(self.root / "scripts/dd-metrics.sh")], check=True,Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.HTTP_PROXY='http://fixture-proxy-user:[email protected]:1')Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.console.log(" -o <file> Save output to file (only when streaming from stdin)");Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.echo "Error: cursor-agent not found on PATH (install: curl -fsS https://cursor.com/install | bash)"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.return subprocess.run([self.node, str(SCRIPTS / 'bk-request-log-shim.mjs'), *args],Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run([str(self.root / "scripts/dd-publish.sh")],Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.# prompt Name of a template under prompts/<prompt>.md. Rendered with theFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run([str(self.scripts / "babystand.sh")], cwd=self.root, capture_output=True, text=True,Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.rendered = subprocess.check_output(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.markdown = subprocess.run(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run([str(self.scripts / "klaren.sh"), str(self.transcript),Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.then copy the reviewed content into `evals/expected/<prompt>/<scenario.id>/root_cause.md` orFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run([str(self.scripts / "dd-publish.sh")], check=True, capture_output=True, text=True,Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.(self.root / "run.tools.txt").write_text('{"tool":"get_logs","input":{"job":"failing"}}\n')Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.chmod +x "$dir/bk"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.console.log(" cat <input-file> | chat-parser - -o <output-file>");Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.payload = subprocess.run(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.# expected/<prompt>/<scenario.id>/{root_cause,fix}.md. Use a newFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.chmod +x "$dir/bk"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.# expected/<prompt>/<scenario.id>/{root_cause,fix}.mdFix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.chown -R agent:agent "$(pwd)"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.console.log(" cat <input-file> | chat-parser -");Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.metrics = subprocess.run([str(self.root / "scripts/dd-metrics.sh")], check=True,Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.subprocess.run([str(self.root / "scripts/yilong.sh")], env=env, capture_output=True, text=True, check=True)Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.return subprocess.run(["bash", str(root / "scripts/babystand.sh")],Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.return subprocess.check_output(["git", "-c", "user.name=Fixture", "-c", "[email protected]",Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.chown -R agent:agent "$(pwd)"Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.console.log("Usage: chat-parser <input-file>");Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.subprocess.run(['openssl', 'req', '-x509', '-newkey', 'rsa:2048', '-nodes', '-days', '1',Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run([str(self.root / "scripts/yilong.sh"), str(self.judge)],Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.result = subprocess.run(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.summary = subprocess.check_output(Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.('sudo -u agent -- bk build view 123', ['bk build view']),Fix: Put hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.Cost to the agent
Tokens estimated at four characters each. Skills load their instruction text when triggered; the figure is what that costs.
Known vulnerabilities
Vulnerability advisories (OSV) cover npm and PyPI packages; this registry has no advisory database.
What would make this Verified
12 points to 80 · weights: behavior 45%, static 25%, prompt 15%, publisher 15%- Unclaimed publisher≈ +8 on the totalClaim buildkite: a verified publisher gets +50 on publisher trust. It is free and usually instant with GitHub sign-in.
- Destructive file system command detected≈ +4 on the totalBuild commands from fixed arguments; do not interpolate untrusted strings into a shell.
- Hidden zero-width characters detected≈ +4 on the totalPut hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.
- Remote installer piped to shell≈ +2 on the totalPut hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.
- Pipe-to-shell pattern≈ +2 on the totalPut hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.
- File permission modification command≈ +2 on the totalPut hosts, commands and strings in plain source. Decoding at runtime looks identical to malware and costs points on its own.