kb-answer

$npx mdskill add techwolf-ai/ai-first-toolkit/kb-answer

Answers questions using your project's knowledge base with citations.

  • Solves the problem of answering questions from documented knowledge rather than general knowledge.
  • Depends on a local knowledge base in kb/ directory and an index file kb/index.md.
  • Navigates the index by keyword or category, then reads relevant files and follows related links.
  • Delivers answers with literal quotes from KB files to prevent hallucinations.

SKILL.md

.github/skills/kb-answerView on GitHub ↗
---
name: kb-answer
description: |
  Answer questions using your project's knowledge base with evidence-backed citations.
  Every answer must cite literal quotes from KB files to prevent hallucinations.
  Use this for any question that should be answered from documented knowledge rather than general knowledge.
---

# KB Answer Workflow

Follow these steps in order for every question. For multiple independent questions, use parallel agents.

## Prerequisites

Check that `kb/` exists in the project root. If not, tell the user to run `/setup-knowledge-base` first.

## Step 1: Navigate Using the Index

**Always start by reading the KB index:**
```
kb/index.md
```

The index provides:
- **Keyword Lookup**: find the right file by keyword
- **Category overview**: all files grouped by topic

If the index is empty or outdated, run the index script first:
```bash
python3 scripts/kb-index.py
```

### Quick Navigation

1. Check the keyword lookup table for matching terms
2. Go to the matching file(s)
3. If no keyword match, browse the category that best fits the question. Categories can be nested (e.g., `security/access/`) — drill down into sub-groups when a broad category has them.

## Step 2: Read Relevant Files

Based on the index navigation:
1. Read the most relevant file first
2. Check `related:` links in the frontmatter if the file references other entries
3. Read additional files if the first doesn't fully cover the question

## Step 3: Search (if needed)

If the index doesn't point to the right file, run the search script to rank entries by keyword across title, tags, description, category, and body:

```bash
python3 scripts/kb-search.py "your keyword"
```

Options worth knowing:
- `--category security` restricts to a category (matches nested children like `security/access` too).
- `--tag mfa` filters by frontmatter tag (repeatable).
- `--limit 5` caps results.
- `--json` for a machine-readable list (useful when chaining into another step).

Fall back to the Grep tool with path `kb/` only if the search script misses a term (e.g., regex-only patterns).

## Step 4: Check Active Scope

If `kb/scopes/` contains scope files beyond `_default.yaml`:
1. Ask the user which scope applies (if not already established in this conversation)
2. Read the active scope file
3. Apply `in_scope`, `out_of_scope`, and `notes` to shape your answer

If only `_default.yaml` exists, skip this step.

## Step 5: Formulate Answer

### Answer Format

**Yes/No questions**: Start with "Yes" or "No", followed by 1 sentence.

**Other questions**: Answer directly in 1-3 sentences. Add detail only if needed.

**If format requirements are provided**: Follow them exactly.

### Citation Requirements

Every claim in your answer MUST be backed by a literal quote from a KB file.

Format each citation as:

```
> "exact quote copied from the KB file"
> Source: kb/category/filename.md
```

**Rules:**
- Copy the quote character-for-character. Do not paraphrase, summarize, or rephrase.
- If you cannot find a literal quote supporting a claim, do not make that claim.
- **Include markdown formatting verbatim.** If the source says `**Confidential**: ...`, your quote must be `**Confidential**: ...`, not `Confidential: ...`. If the source uses bullet list dashes, include them. Missing markdown is the #1 reason `kb-verify.py` flags citations. The script has a normalized-match fallback that will PASS with a warning, but strict mode will FAIL, so always copy formatting literally.
- For long passages, prefer quoting a single self-contained sentence. When a multi-line quote is unavoidable (e.g., a bulleted list that must be cited as one block), use the multi-line form:
  ```
  > "first line of the quote
  > second line
  > last line"
  > Source: kb/category/filename.md
  ```
  The verifier joins the `>` lines back into one quote and checks the whole block. Single-line blocks are still preferred for robustness.

### What to Avoid

- Don't over-elaborate. Match answer depth to question depth.
- Don't pad with "more details available upon request".
- Don't start with summary phrases like "Based on our documentation...". Go straight to the answer.
- Be honest about limitations. If something isn't in the KB, say so.

### If Information is Missing

1. State clearly what information is not in the KB
2. Provide what can be answered from available info
3. Do not make up or infer information not in the KB
4. Suggest which KB entry should be created to cover the gap

## Step 6: Verify Citations

After formulating your answer, verify all citations are accurate by running:

```bash
python3 scripts/kb-verify.py <<'EOF'
{your answer with citations}
EOF
```

The script checks that every quoted string exists in the referenced KB file. It runs two passes:
1. **Strict**: the quote is byte-exact (including markdown markers and whitespace).
2. **Normalized** (fallback): markdown markers (`**`, `*`, `_`, `` ` ``) and whitespace are stripped from both sides before comparison. Reported as `PASS (normalized)`.

Target strict passes. If the script reports `PASS (normalized)`, re-copy the quote with its original markdown so the next verify run is clean.

- All citations PASS (strict or normalized): present the answer.
- Any citation FAIL: re-read the source file, copy the exact text (including markdown), and verify again.
- Use `python3 scripts/kb-verify.py --strict answer.md` when you want to guarantee byte-exact citations (e.g., before publishing to a customer).

Do not present an answer with any FAIL citations.

## Handling Multiple Questions

**Related questions** (same topic): Group together, share file reads.

**Independent questions**: Use parallel agents, each following this workflow.

Example:
```
Q1: "What encryption do we use?"     -> security
Q2: "Who are our customers?"         -> general
Q3: "What's our SLA?"                -> security

Group 1 (security): Q1 + Q3
Group 2 (general): Q2
```

More from techwolf-ai/ai-first-toolkit

SkillDescription
ai-firstifyAnalyze, re-engineer, or bootstrap projects to align with AI-first design principles. Use when asked to review, audit, improve, 'ai-firstify', or start a new project. Performs deep analysis across 7 dimensions, actively restructures existing projects, or guides new project setup through discovery questions. Based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp.
brainstorm-linkedinGenerate LinkedIn post ideas from external sources (files, URLs, research). Use when the user provides source material (PDFs, URLs, articles) to brainstorm topics. NOT for writing or developing drafts - use write-linkedin-post instead.
brainstorm-opinionGenerate opinion piece ideas from recent LinkedIn posts (last 30 days). Use when asked to find opinion topics, brainstorm article ideas, or cross-pollinate content between LinkedIn and opinion pieces.
build-mcpBuild an MCP server end to end, tailored to how it will be used. Use when asked to build an MCP, create an MCP server, wrap an API as a tool, make a tool for Claude, expose a service to an agent, build a Claude connector, or turn a service into MCP tools. Asks up front who the server is for (just me, my org, or public) and what it wraps, then walks through analyze, build, deploy, scale, and distribute with steps tailored to that answer. Builds on the example-skills:mcp-builder skill for implementation depth.
content-studioEntry point for the TechWolf content-studio plugin. Use to understand the workflow, pick the right content skill, or start setup for a new author/repository.
customer-statusSynthesised view of account health and activity for managers overseeing customer-facing teams (Sales, CS, Professional Services, Presales). Scans project channels, email threads, and Notion pages to surface status, risks, and upcoming milestones, without requiring the manager to trawl through individual channels. Supports proactive account management.
goal-promptTurn a task, plan, or feature request into a ready-to-paste Claude Code /goal command — a single completion condition with a measurable end state, a demonstrable proof, and the constraints that must not drift. Use when the user says "give me a goal", "goal prompt", "make this a /goal", "turn this into a goal", or wants an autonomous long-running objective for Claude Code.
kb-import|
kb-refresh|
one-on-one-prepDeep-dive preparation for 1:1 meetings with direct reports. Surfaces recent work, wins, friction, wellbeing signals, and development goal progress, anchored in the org's performance framework, organizational values, and management best practices. Produces a prep sheet with suggested conversation topics, not a script.