Agent Review for pi

A pi coding-agent extension that reviews tool calls and tool output with an LLM reviewer, hard-denies access to secrets, and gates risky actions behind user approval.

Install

pi install git:github.com/everettmorgan/pi-agent-review@v0.1.0

Or add it to settings.json:

{
  "packages": ["git:github.com/everettmorgan/pi-agent-review@v0.1.0"]
}

For local development, place the directory at ~/.pi/agent/extensions/agent-review and run /reload in pi.

Commands

• /agent-review status — current config and the last request/output review
• /agent-review on / off — enable or disable review for this session
• /agent-review config — interactive menu to toggle the review stages
• /agent-review input on|off — review tool calls before they run
• /agent-review output on|off — review tool output for leaks
• /agent-review model — pick a reviewer model (current, or provider/model)
• /agent-review test <tool-name> <json-args> — dry-run a request review

How it works

Review runs in two stages, each independently toggleable.

Request review (before a tool runs). A deterministic gate hard-denies access to secret paths (.env, ~/.ssh, key files, credential stores) for any tool. Everything else goes to the reviewer model, which approves low-risk actions and denies risky ones. Denied calls are blocked; reviewer or config failures block (fail-closed).

Output review (after a tool runs). Tool output is checked for secrets, credentials, keys, and tokens. A confirmed leak withholds the output from the model and transcript and stops the turn. If the reviewer can't run, the unreviewed output is withheld.

User approval. When the reviewer denies a call the user wants, the agent calls request_user_approval, which shows the full tool name and arguments for confirmation. An approval is recorded with a unique nonce and a ~10 minute expiry, and describes the approved action. On the next call to that tool, the reviewer is shown the approved action and authorizes the call if it matches that action's scope — so the retry need not be byte-identical. The grant is consumed only on a terminal approve, authorizes one execution, and never overrides hard-safety denials.

Logging. Each review appends a log entry to the chat history with its verdict and reasoning. Entries persist in the transcript but are not sent to the model.

Config

Optional, at ~/.pi/agent/agent-review/config.json:

{
  "review": {
    "reviewInput": true,
    "reviewOutput": true,
    "timeoutMs": 30000,
    "denyOnReviewerFailure": true,
    "consecutiveDenialLimit": 3,
    "rollingDenialLimit": 10
  },
  "reviewer": {
    "type": "direct-model",
    "provider": "current",
    "model": "current"
  }
}

provider/model of current use the active session model. Enable/disable state is session-scoped and never written to this file.

Development

npm test        # vitest
npm run typecheck
npm run lint    # xo

See docs/architecture.md for the module layout and CONTRIBUTING.md for the contribution workflow.