checkly-cli-skills@1.0.22
CAUTION· install onlyPublisher claims: "Comprehensive Checkly CLI command reference and Monitoring as Code workflows. Use when user mentions Checkly CLI, monitoring as code, synthetic monitoring, API checks, browser checks, Playwright testing, GitHub Check re-runs, gRPC/SSL/traceroute monitors, check deployment, account plans, entitlements, organization usage, credits, or npx checkly commands. Routes to specialized sub-skills for auth, config, checks, monitors, testing, deployment, imports, account plan and usage, constructs, and advanced patterns. Triggers on checkly, GitHub Check Re-run button, repository_dispatch, monitoring as code, synthetic monitoring, checkly cli, npx checkly." Observed in sandbox: reads credential files.
Coverage
Bundled scripts ran with no arguments; no agent task scenario for this bundle.- Tested
- 4 of 4 bundled scripts run with no arguments, with decoy credentials in the environment · every file read, file written and host contacted by what ran
- Not tested
- use of the skill by an agent
What changed since 1.0.19
vet-skills diff checkly-cli-skills 1.0.19 1.0.22This version reaches for something 1.0.19 did not: 2 new hosts (checklyhq.com, registry.npmjs.org) · 2 new credential variables (API_TOKEN, TEST_PASSWORD) · 2 new credential files (~/.npmrc, ~/work/acme-api/.npmrc). Compared from the two recorded runs, not from source.
- New hosts
- checklyhq.com, registry.npmjs.org
- New credential variables
- API_TOKEN, TEST_PASSWORD
- New credential files
- ~/.npmrc, ~/work/acme-api/.npmrc
The guard can hold an update like this until someone approves it (runtime.on_change: hold). A change that only shows with a real credential, or on a path the run did not reach, is not in a trace and so not in this comparison.
Is [email protected] safe to install?
KillerSkills ran it in the KillerSkills honeypot sandbox (2 scenarios; bundled scripts ran with no arguments; no agent task scenario for this bundle) on 2026-11-17 and scored it 74/100 (Caution). It is not known to be malicious, but it has behaviour or code a security policy should decide on before install. Notable findings: Access to sensitive file paths; Access to sensitive file paths; Access to sensitive file paths. Summary: reads credential files.
Behavior trace
Honeypot run · 25 s · 2 scenariosStatic findings
…Y` or `CHECKLY_ACCOUNT_ID` are still set in the shell or loaded from a project `.env`. `npx checkly logout` can clear saved local-session credentials but cannot rem…Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.// It is NOT required by Checkly CLI itself. Define it in your .env or CI secretsFix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.Use `npx checkly assets` after you have a result ID from `npx checkly checks get --result ...`, `npx checkly test-sessions get`, or Checkly UI failure details.Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly checks run --tags production,apiFix: Pin versions and sources; vendor anything fetched at install time.npx checkly test --reporter=githubFix: Pin versions and sources; vendor anything fetched at install time.npx checkly loginFix: Pin versions and sources; vendor anything fetched at install time.npx checkly test --reporter=jsonFix: Pin versions and sources; vendor anything fetched at install time.- Reviewed upstream release `8.14.1`, PR checkly/checkly-cli#1390, and `npx --yes [email protected] deploy --help` on 2026-07-09.Fix: Pin versions and sources; vendor anything fetched at install time.… name: checkly-assets description: List and download Checkly result assets with npx checkly assets. Use when investigating failed checks or test sessions and needing logs,…Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly switch --account-id <account-id>Fix: Pin versions and sources; vendor anything fetched at install time.…ise unloadable config can still be tolerated by trigger-only workflows, so use `npx checkly validate` when the config itself must be proved valid. Human-readable diagnosti…Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly checks list --tag production --output jsonFix: Pin versions and sources; vendor anything fetched at install time.npx checkly test --reporter=dotFix: Pin versions and sources; vendor anything fetched at install time.… check deployment, account plans, entitlements, organization usage, credits, or npx checkly commands. Routes to specialized sub-skills for auth, config, checks, monitors, …Fix: Pin versions and sources; vendor anything fetched at install time.…entials/endpoints before starting the process: in the shell, command prefix or `.env` of the invocation directory. Keep application test variables separate from CLI…Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.# .env.testFix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose."Requires Node.js 22.13.0 or later, plus a Checkly account and API key (signup at checklyhq.com/signup or via 'npx checkly login').",Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly assets list --result-id <result-id>Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly loginFix: Pin versions and sources; vendor anything fetched at install time."Credentials can be set via environment variables (CHECKLY_API_KEY, CHECKLY_ACCOUNT_ID) or stored in platform-specific Checkly CLI configuration via 'npx checkly login'.",Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly logoutFix: Pin versions and sources; vendor anything fetched at install time.npx checkly whoamiFix: Pin versions and sources; vendor anything fetched at install time.… stderr disables them. A global CLI, `pnpm dlx checkly`, or version-qualified `npx checkly` delegates to the project's installed CLI. A version mismatch prints which versi…Fix: Pin versions and sources; vendor anything fetched at install time.- Added `npx checkly switch --account-id <id>` account-switching guidance instead of manual config deletion.Fix: Pin versions and sources; vendor anything fetched at install time.- Reviewed upstream release `8.11.0` and `npx -y [email protected]` help output on 2026-07-03.Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly test --reporter=listFix: Pin versions and sources; vendor anything fetched at install time.npx checkly checks run --check-id <check-id>Fix: Pin versions and sources; vendor anything fetched at install time.…rce the account-specific limit. Do not assume that entitlement is present: run `npx checkly test` with the target account and treat its validation or API response as autho…Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly test --reporter=ciFix: Pin versions and sources; vendor anything fetched at install time.Parse `./checkly-json-report.json`, or the path in `CHECKLY_REPORTER_JSON_OUTPUT`, rather than piping stdout into a JSON parser.Fix: Remove the call, or declare the host in frontmatter and explain in the README what is sent and why.Set authentication environment variables before the command starts; loading another `.env` from config/check code cannot change the authenticated account or endpoint mid-run. See `checkly-auth`.Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.# From .env fileFix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.// Set them in your local .env or CI/CD secrets as needed for your app.Fix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.…` can initialize an empty directory in CI/agent mode, including creating package.json. Agent output uses `status: "success"` or `status: "error"` with `message`; failures exit 1. …Fix: Remove the call, or declare the host in frontmatter and explain in the README what is sent and why.npx checkly checks run --check-id <check-id-1>,<check-id-2> --output jsonFix: Pin versions and sources; vendor anything fetched at install time.- Added `npx checkly deploy --preserve-resources` guidance for detaching resources removed from code while keeping run history and UI management.Fix: Pin versions and sources; vendor anything fetched at install time.- Added destructive-project cleanup guidance for `npx checkly destroy`, including async progress, idempotent missing-project handling, `--preserve-resources`, and `--cancel-in-progress-deployment`.Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly test --env-file=.env.testFix: Stop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.--- name: checkly-test description: Test Checkly checks locally using npx checkly test command, including filtering, reporters, retry strategies, and debugging w…Fix: Pin versions and sources; vendor anything fetched at install time.…anization contract usage, credits, projections, and per-period consumption with npx checkly account plan and account usage. Use when reviewing plan availability, private-l…Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly members --role read_only --status activeFix: Pin versions and sources; vendor anything fetched at install time.…orkspace's dependency inputs—the lockfile plus every workspace member's `package.json` and `.npmrc`, whether or not that member is in the bundle—plus the bundle's own install inputs, including registry configuration and the resolved embedd…Fix: Remove the call, or declare the host in frontmatter and explain in the README what is sent and why.npx checkly membersFix: Pin versions and sources; vendor anything fetched at install time.…ode root when required npx checkly import plan --root src/__checks__ ``` Both `npx checkly import` and `npx checkly import plan` expose the plan command surface. By defau…Fix: Pin versions and sources; vendor anything fetched at install time.testCommand: 'npx playwright test --project=chromium',Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly import --previewFix: Pin versions and sources; vendor anything fetched at install time.--- name: checkly-deploy description: Deploy Checkly checks to production with npx checkly deploy, including force deployment, preview changes, and CI/CD integration stra…Fix: Pin versions and sources; vendor anything fetched at install time.…orkspace's dependency inputs—the lockfile plus every workspace member's `package.json` and `.npmrc`, whether or not that member is in the bundle—plus the bundle's own install inputs, including registry configuration and the resolved embedd…Fix: Remove the call, or declare the host in frontmatter and explain in the README what is sent and why.npx checkly testFix: Pin versions and sources; vendor anything fetched at install time.npx checkly validateFix: Pin versions and sources; vendor anything fetched at install time.npx checkly test --verboseFix: Pin versions and sources; vendor anything fetched at install time.runLocation: string, // Default location for 'npx checkly test'Fix: Pin versions and sources; vendor anything fetched at install time.Test Checkly checks locally with `npx checkly test`.Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly deploy --dry-run > deploy-plan.jsonFix: Pin versions and sources; vendor anything fetched at install time.npx checkly test __checks__/api.check.tsFix: Pin versions and sources; vendor anything fetched at install time.npx checkly import plan --root src/__checks__Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly testFix: Pin versions and sources; vendor anything fetched at install time.…GITHUB_OUTPUT) ``` ### JSON reporter JSON is written to `./checkly-json-report.json` (override with `CHECKLY_REPORTER_JSON_OUTPUT`). Parse that file; stdout contains a brief summary, saved-file notice and sess…Fix: Remove the call, or declare the host in frontmatter and explain in the README what is sent and why.npx checkly members --search alice --output jsonFix: Pin versions and sources; vendor anything fetched at install time.npx checkly members update [email protected] --email --role read_run --dry-runFix: Pin versions and sources; vendor anything fetched at install time.…s description: List and manage Checkly account members and pending invites with npx checkly members. Use when auditing account access, filtering members by role/status, up…Fix: Pin versions and sources; vendor anything fetched at install time.…es the deployed association. See `checkly-constructs` for migration warnings. `npx checkly pw-test` exits 1 when no checks match. Its `--timeout` starts when a check actu…Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly deployFix: Pin versions and sources; vendor anything fetched at install time.npx checkly validateFix: Pin versions and sources; vendor anything fetched at install time.testCommand: 'npx playwright test',Fix: Pin versions and sources; vendor anything fetched at install time.…ccount-specific limit. Do not assume the entitlement is present: validate with `npx checkly test` against the target account. Older or self-hosted APIs that do not expose …Fix: Pin versions and sources; vendor anything fetched at install time.# Writes ./checkly-json-report.json (override with CHECKLY_REPORTER_JSON_OUTPUT)Fix: Remove the call, or declare the host in frontmatter and explain in the README what is sent and why.npx checkly deploy --previewFix: Pin versions and sources; vendor anything fetched at install time.npx checkly testFix: Pin versions and sources; vendor anything fetched at install time.…nager environment document are supported; pnpm emits this document when `package.json` declares a `packageManager` field. Version detection, pruning, and subset verification read only the application document, pnpm's regenerated output shi…Fix: Remove the call, or declare the host in frontmatter and explain in the README what is sent and why.npx checkly deploy --plan-token <plan-token>Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly validateFix: Pin versions and sources; vendor anything fetched at install time.npx checkly import planFix: Pin versions and sources; vendor anything fetched at install time.npx checkly deployFix: Pin versions and sources; vendor anything fetched at install time.if ! npx checkly whoami &> /dev/null; thenFix: Pin versions and sources; vendor anything fetched at install time.echo " npx checkly login" >&2Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly account plan --search browser --output jsonFix: Pin versions and sources; vendor anything fetched at install time.npx checkly import planFix: Pin versions and sources; vendor anything fetched at install time.echo " npx checkly test" >&2Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly validate --verify-runtime-dependenciesFix: Pin versions and sources; vendor anything fetched at install time.…terms, measured credit use and projections. Confirm the effective account with `npx checkly whoami --output json` before interpreting results. Usage requires a current use…Fix: Pin versions and sources; vendor anything fetched at install time.echo " 3. Test the adopted project: npx checkly test" >&2Fix: Pin versions and sources; vendor anything fetched at install time.if npx checkly test; thenFix: Pin versions and sources; vendor anything fetched at install time.echo "❌ Not authenticated. Run 'npx checkly login' first." >&2Fix: Pin versions and sources; vendor anything fetched at install time.echo " 2. Apply the reviewed plan: npx checkly import apply --plan-id <plan-id> --no-commit" >&2Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly account plan --output jsonFix: Pin versions and sources; vendor anything fetched at install time.echo " npx checkly deploy" >&2Fix: Pin versions and sources; vendor anything fetched at install time.npx checkly account plan <ENTITLEMENT_KEY> --output jsonFix: Pin versions and sources; vendor anything fetched at install time.Cost to the agent
Tokens estimated at four characters each. Skills load their instruction text when triggered; the figure is what that costs.
Known vulnerabilities
Vulnerability advisories (OSV) cover npm and PyPI packages; this registry has no advisory database.
What would make this Verified
6 points to 80 · weights: behavior 45%, static 25%, prompt 15%, publisher 15%- Reads credential files≈ +27 on the totalThe sandbox saw reads under ~/.ssh, ~/.aws, ~/.npmrc, ~/.config or similar. Read only files inside the project, and only the ones the task needs. Seen: ~/work/acme-api/.npmrc, ~/.npmrc.
- Unclaimed publisher≈ +8 on the totalClaim vince-winkintel: a verified publisher gets +50 on publisher trust. It is free and usually instant with GitHub sign-in.
- Touches files outside the project≈ +7 on the totalKeep reads and writes inside the working directory, or declare the exact paths in `filesystem:` and explain why in the README.
- Access to sensitive file paths≈ +4 on the totalStop enumerating or reading credential locations; take secrets from a declared environment variable the user sets on purpose.
- npx invocation of non-well-known package≈ +2 on the totalPin versions and sources; vendor anything fetched at install time.
- File type combined with upload action≈ +2 on the totalRemove the call, or declare the host in frontmatter and explain in the README what is sent and why.