rag-evalset@1.0.0
VERIFIEDPublisher claims: "基于 ragas SDK 从文档语料构建生产级双层 RAG 评估集：同一份评估集既支持标准 IR 排序指标（Recall@K/Precision@K/MRR/NDCG@K，基于 gold chunk ID 自算），也支持 ragas LLM 裁判指标（faithfulness/answer_relevancy/context_precision/context_recall/answer_correctness）。当用户要求构建 RAG 评估集/评测数据集/生成测试问题、上线前 RAG 回归测试、或用 IR 指标衡量检索质量并配合 ragas 评估时使用。" Observed in sandbox: no network, touches nothing outside the project, writes no memory.
Is [email protected] safe to install?
KillerSkills ran it in the KillerSkills honeypot sandbox (1 scenario) on 2026-10-27 and scored it 90/100 (Verified). It did what it claims and nothing else we could detect: no undeclared network egress, no credential reads, no persistent instruction writes. Summary: no network, touches nothing outside the project, writes no memory.
Behavior trace
Honeypot run · 0 s · 1 scenarios · 0 deviationst+CategoryObserved action
0.0sprocessno install scripts in bundle
0.0sprocessscript backend runs setup only
0.0sprocessscript backend runs setup only
Static findings
MEDIUM
Python subprocess execution detectedscripts/make_runs.py:123 · Python subprocess execution detectedFix: Build commands from fixed arguments, never from interpolated strings; prefer an API client over shelling out.
AST05MEDIUM
Process kill commandSKILL.md:137 · Process kill command — agent can terminate processesFix: Build commands from fixed arguments; do not interpolate untrusted strings into a shell.
AST05