review-skill

$npx mdskill add existential-birds/beagle/review-skill

Reviews PRs for Agent Skill structural validity and design quality.

  • Automates structural and design review of changed Agent Skills.
  • Depends on git diff, SKILL.md, and plugin.json files.
  • Compares changed files against structural checks in references.
  • Writes review results to a specified output file path.

SKILL.md

.github/skills/review-skillView on GitHub ↗
---
name: review-skill
description: Reviews PRs that add or modify Agent Skills, checking structural validity, design quality, and marketplace consistency. Use when reviewing skill file changes, auditing SKILL.md quality, or running automated skill PR reviews.
disable-model-invocation: true
---

# Skill Review

Review Agent Skill PRs for structural validity, design quality, and marketplace consistency.

## Arguments

- `$ARGUMENTS`: Output file path for review results (required, passed by the calling harness or the user)
- `--base <branch>`: Base branch for diff comparison (default: `main`)

## Workflow

### Step 1: Parse Arguments

Extract the output path from `$ARGUMENTS`. If no path is provided, default to `.review-output.md`. Extract `--base` if provided, otherwise default to `main`.

### Step 2: Identify Changed Skills

```bash
git diff --name-only $(git merge-base HEAD <base>)..<HEAD> | grep -E '(SKILL\.md|skills/[^/]+/)'
```

Group changed files by skill directory. Each unique skill directory is a review target. If no skill files changed, write "No skill files changed" to the output path and stop.

### Step 3: Read Each Changed Skill End-to-End

For each changed skill:
1. Read the full `SKILL.md` (not just diff lines)
2. Read all files in the skill directory (references, scripts)
3. Note the parent plugin directory and locate its `plugin.json`

### Step 4: Run Structural Checks (HIGH Confidence)

Apply every check in [references/structural-checks.md](references/structural-checks.md). These are binary pass/fail — violations are clear-cut.

Structural violations are HIGH confidence because they can be verified mechanically.

### Step 5: Run Design Checks (MEDIUM Confidence)

Apply every check in [references/design-checks.md](references/design-checks.md). These require judgment — flag only when the issue is clear, not when the approach is merely different from what you'd choose.

Design issues are MEDIUM confidence because they involve subjective assessment.

### Step 6: Run Marketplace Checks (HIGH Confidence)

Apply every check in [references/marketplace-checks.md](references/marketplace-checks.md). These verify the skill integrates correctly with the marketplace it belongs to.

Marketplace violations are HIGH confidence because they can be verified by reading manifest files.

### Step 7: Load and Apply Verification Protocol

Load the [review-verification-protocol](../review-verification-protocol/SKILL.md) skill. Before reporting any finding, verify:

1. You read the actual skill content, not just the diff context
2. The issue is real, not a style preference
3. The issue applies to skill files specifically (not general code review concerns)
4. You can point to the specific line that proves the issue

Remove any finding you cannot verify.

### Step 8: Write Output

Write all findings to the output path specified in Step 1, using the exact format below.

## Output Format

```markdown
## Review Summary

[1-2 sentence overview of findings across all reviewed skills]

## Issues

### Critical (Blocking)

1. [FILE:LINE] ISSUE_TITLE
   - Issue: Description of what's wrong
   - Why: Why this matters for skill quality or marketplace health
   - Fix: Specific recommended fix
   - Confidence: HIGH

### Major (Should Fix)

N. [FILE:LINE] ISSUE_TITLE
   - Issue: ...
   - Why: ...
   - Fix: ...
   - Confidence: HIGH|MEDIUM

### Minor (Nice to Have)

N. [FILE:LINE] ISSUE_TITLE
   - Issue: ...
   - Why: ...
   - Fix: ...
   - Confidence: HIGH|MEDIUM

### Informational (For Awareness)

N. [FILE:LINE] SUGGESTION_TITLE
   - Suggestion: ...
   - Rationale: ...
   - Confidence: MEDIUM

## Verdict

Ready: Yes | No | With fixes 1-N
Rationale: [1-2 sentences — only Critical and Major items block approval]
```

Every issue gets a sequential number. Every issue includes `Confidence: HIGH|MEDIUM`. The Verdict ignores Minor and Informational items.

## Severity Calibration

### Critical (Block Merge)

- Invalid or missing YAML frontmatter (skill won't load)
- Missing required `name` or `description` field
- SKILL.md exceeds 500 lines (performance degradation)
- Name collision with existing skill in the marketplace

### Major (Should Fix)

- `name` violates format rules (not kebab-case, too long, reserved word)
- `description` missing "what" or "when" component, wrong person, or exceeds 1024 chars
- Nested reference chains (references that reference other references)
- Description too vague to trigger accurately
- Structured output with no format template or example
- Windows-style paths in file references

### Minor (Nice to Have)

- Time-sensitive content (hardcoded dates, "recently", "new")
- Inconsistent terminology across skill files
- Progressive disclosure not used when SKILL.md is dense
- Workflows missing validation steps
- Missing cross-reference (SKILL.md links to file that doesn't exist)

### Informational (For Awareness)

- Trigger keyword overlap with existing marketplace skills
- Suggestions for additional reference files
- Opportunities to improve description specificity
- Script lacks `--help` or uses interactive prompts

## Re-Review Rules

On subsequent review passes after fixes are applied:
1. ONLY verify that previously flagged issues were addressed correctly
2. Do NOT introduce new findings unrelated to previous issues
3. Accept Minor items that weren't fixed — do not re-flag
4. The goal of re-review is verification, not discovery

## References

- **Structural checks**: [references/structural-checks.md](references/structural-checks.md) — frontmatter, naming, line limits, path format
- **Design checks**: [references/design-checks.md](references/design-checks.md) — description quality, progressive disclosure, degrees of freedom
- **Marketplace checks**: [references/marketplace-checks.md](references/marketplace-checks.md) — name collision, plugin.json consistency, trigger overlap

More from existential-birds/beagle

SkillDescription
adr-decision-extractionUse when you need to mine a conversation, session transcript, or design discussion for architectural decisions before writing ADRs. Identifies problem-solution pairs, trade-off debates, technology choices, and explicit \"[ADR]\" tags. Triggers on \"what decisions did we make\", \"extract decisions from this chat\", \"find the choices in our discussion\", or \"summarize architectural decisions\". Also useful after long planning sessions to capture decisions that were made implicitly. Does NOT write ADR documents \u2014 use adr-writing or write-adr for that.
adr-writingUse when writing or formatting an ADR document using the MADR template, applying Definition of Done (E.C.A.D.R.) criteria, or verifying ADR completeness. Triggers on \"write the ADR\", \"format as MADR\", \"check ADR quality\", \"mark gaps in ADR\". Also triggers when a decision has been extracted and needs to become a document. Does NOT extract decisions from conversations (use adr-decision-extraction) or orchestrate the full extract-confirm-write workflow (use write-adr).
agent-architecture-analysisUse when auditing an agent codebase against the 12-Factor Agents methodology, reviewing LLM-powered system architecture, or assessing agentic app compliance. Triggers on \"analyze agent architecture\", \"12-factor audit\", \"how compliant is this agent\", or \"evaluate this LLM app\". Also applies when comparing frameworks or planning agent improvements. Not for quick checklists \u2014 this performs deep per-factor codebase analysis with file-level evidence.
app-intents-code-reviewReviews App Intents code for intent structure, entities, shortcuts, and parameters. Use when reviewing code with import AppIntents, @AppIntent, AppEntity, AppShortcutsProvider, or @Parameter.
artifact-analysisUse when the user wants a cited, structured read of local documents and project knowledge. Triggers on: \"analyze these docs\", \"scan my project for context\", \"read the docs folder\", \"summarize what's in .beagle/concepts/\", \"extract context from docs/\", \"what's in this folder\", \"go read everything in X and tell me what's there\". Also invoked programmatically by other beagle skills (prfaq-beagle Ignition, brainstorm-beagle reference points, strategy-interview context grounding) via the companion contract. Does NOT trigger on codebase lookups (\"find this function\", \"search the repo\"), web research (use web-research), LLM-as-judge evaluation (use llm-judge), or document editing (use humanize-beagle). Produces a written scan plan, parallel-subagent findings, and a cited synthesis report on disk — never inline prose, never unsourced claims.
axum-code-reviewReviews axum web framework code for routing patterns, extractor usage, middleware, state management, and error handling. Use when reviewing Rust code that uses axum, tower, or hyper for HTTP services. Covers axum 0.7+ patterns including State, Path, Query, Json extractors.
brainstorm-beagleUse when the user has a fuzzy idea and wants to shape it into a concrete project spec before planning or building. Triggers on: \"brainstorm this\", \"I have an idea for...\", \"help me think through this project\", \"what should I build\", \"spec this out\". Also catches vague feature descriptions needing structured questioning to clarify scope. Does NOT write code, plan implementation, review strategy docs, or run strategy interviews \u2014 produces a WHAT/WHY spec through dialogue, not a HOW plan.
bubbletea-code-reviewReviews BubbleTea TUI code for proper Elm architecture, model/update/view patterns, and Lipgloss styling. Use when reviewing terminal UI code using charmbracelet/bubbletea.
cloudkit-code-reviewReviews CloudKit code for container setup, record handling, subscriptions, and sharing patterns. Use when reviewing code with import CloudKit, CKContainer, CKRecord, CKShare, or CKSubscription.
combine-code-reviewReviews Combine framework code for memory leaks, operator misuse, and error handling. Use when reviewing code with import Combine, AnyPublisher, @Published, PassthroughSubject, or CurrentValueSubject.