All skills & plugins / Codex official plugins

Plugin Eval

Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.

Pre-approved tools

No allowed-tools or tools list in its SKILL.md, command or agent files, so the agent asks before using tools as usual.

Hooks

No hooks.

MCP servers and apps

None.

Bundled code

37 code files (JavaScript, Python, TypeScript):

• plugin-eval/src/index.js
• plugin-eval/src/cli.js
• src/evaluators/python.js
• src/evaluators/typescript.js
• src/evaluators/coverage.js
• src/evaluators/plugin.js
• src/evaluators/skill.js
• src/evaluators/code.js
• src/core/baseline.js
• src/core/scoring.js
• src/core/analyze.js
• src/core/compare.js
• src/core/benchmark-workspace.js
• src/core/observed-usage.js
• src/core/improvement-brief.js
• and 22 more

Network calls

No HTTP or socket call pattern found in the code.

Starts other programs

8 files. First match per file:

• plugins/plugin-eval/src/evaluators/python.js:24

  const match = /^(\s*)(?:async\s+def|def)\s+([A-Za-z0-9_]+)\s*\(([^)]*)\)\s*:/.exec(line);

• plugins/plugin-eval/src/evaluators/typescript.js:31

  const match = startMatchers.map((matcher) => matcher.exec(line)).find(Boolean);

• plugins/plugin-eval/src/evaluators/coverage.js:51

  const lineRateMatch = /line-rate="([^"]+)"/.exec(text);

• plugins/plugin-eval/src/core/benchmark-workspace.js:1

  import { execFile } from "node:child_process";

• plugins/plugin-eval/src/core/benchmark.js:1

  import { spawn } from "node:child_process";

Credentials referenced

No key, token or secret environment variable found in code or MCP config.

Static scan of commit 0722921 on 2026-10-27. Signals are patterns found in the files, not a verdict: a network call can be the whole point of a skill. Read the linked lines before you decide. How the scan works.