kp-pipeline-orchestration

$npx mdskill add Tibsfox/gsd-skill-creator/kp-pipeline-orchestration

Orchestrates knowledge pack pipeline with batch scheduling and dependency ordering.

  • Coordinates 35-pack generation across 7 phases with 5 packs per batch.
  • Depends on chipset.yaml and kp-content-pipeline.yaml for pack definitions.
  • Resolves cross-pack dependencies to prevent forward references within batches.
  • Triggers validation and review after each batch completes successfully.

SKILL.md

.github/skills/kp-pipeline-orchestrationView on GitHub ↗
---
name: kp-pipeline-orchestration
description: "Orchestrates knowledge pack content generation pipeline: batch scheduling, completion tracking, cross-pack dependency ordering, and validation triggering. Use when coordinating pack generation across phases 245-251."
metadata:
  extensions:
    gsd-skill-creator:
      triggers:
        intents:
          - "knowledge.*pipeline"
          - "pack.*batch"
          - "pack.*schedule"
          - "pack.*orchestrat"
        files:
          - "infra/packs/knowledge/chipset.yaml"
          - "infra/packs/knowledge/teams/kp-content-pipeline.yaml"
        contexts:
          - "knowledge pack pipeline"
          - "pack batch scheduling"
        threshold: 0.7
      token_budget: "1.0%"
      version: 1
      enabled: true
      plan_origin: "244-chipset-agent-definitions"
      phase_origin: "244"
---

# Pipeline Orchestration

## Purpose

Coordinates the 35-pack content generation pipeline using a map-reduce pattern. Manages batch scheduling (7 phases x 5 packs), tracks completion state across phases, resolves cross-pack dependency ordering to prevent forward references, and triggers validation/review after each batch completes.

## Capabilities

- 7-phase batch scheduling: phases 245-251 with 5 packs per batch
- Cross-pack dependency ordering within batches (e.g., MATH-101 before PHYS-101)
- Completion state tracking per pack per phase
- Validation gate triggering after batch generation
- Review assignment after validation passes
- Progress reporting across all 35 packs
- Retry coordination for packs that fail validation

## Key Modules

| Module | Purpose |
|--------|---------|
| `infra/packs/knowledge/chipset.yaml` | Master agent/skill/team/pack definitions |
| `infra/packs/knowledge/teams/kp-content-pipeline.yaml` | Pipeline team topology and stages |
| `src/knowledge/registry.ts` | Pack registry for completion verification |
| `src/knowledge/content-validator.ts` | Content validator for batch validation gates |

## Usage Examples

**Batch scheduling:**
```
Phase 245: MATH-101, SCI-101, TECH-101, ENGR-101, PHYS-101 (Core Academic batch 1)
Phase 246: CHEM-101, READ-101, CRIT-101, PROB-101, COMM-101 (Core Academic batch 2)
Phase 247: HIST-101, GEO-101, MFAB-101, BUS-101, STAT-101 (Core Academic batch 3)
Phase 248: CODE-101, DATA-101, LANG-101, PSYCH-101, ENVR-101 (Applied batch 1)
Phase 249: NUTR-101, ECON-101, WRIT-101, LOG-101, DIGLIT-101 (Applied batch 2)
Phase 250: PHILO-101, THEO-101, PE-101, NATURE-101, DOMESTIC-101 (Specialized batch 1)
Phase 251: ART-101, MUSIC-101, TRADE-101, ASTRO-101, LEARN-101 (Specialized batch 2)

After each batch: kp-validator runs schema checks, kp-reviewer runs quality review.
```

## Dependencies

- Pack runtime API (src/knowledge/) for registry and validation
- Chipset YAML for pack-to-agent and pack-to-phase mapping
- Pipeline team YAML for coordination topology

## Token Budget Rationale

1.0% budget reflects the orchestration metadata (chipset, pipeline team, batch schedule). The coordinator reads definitions but does not hold pack content in context.

More from Tibsfox/gsd-skill-creator

SkillDescription
3d-interaction-designDesign heuristics for three-dimensional interaction — input modalities (6DoF controllers, gaze, gesture, voice), selection and manipulation techniques (ray-cast, virtual hand, go-go, world-in-miniature), navigation (teleport, continuous, redirected walking), and feedback loops (haptic, audio, visual). Covers Fitts' law in 3D, discoverability vs affordance, safe-zone design, and comfort/simulator sickness mitigation. Use when designing VR/AR interactions, immersive walkthroughs, or any input system where the user's body is the controller.
accessibility-patternsProvides web accessibility best practices for semantic HTML, ARIA, keyboard navigation, color contrast, and screen reader patterns. Use when building UI components, reviewing accessibility, or when user mentions 'a11y', 'accessibility', 'ARIA', 'screen reader', 'keyboard navigation', 'WCAG'.
active-listeningActive listening techniques for effective communication. Covers attending behaviors, paraphrasing, reflective listening, clarifying questions, empathic response, barriers to listening, listening in conflict, and cross-cultural listening. Use when building listening skills, improving understanding in conversation, mediating disputes, or analyzing communication breakdowns.
adversarial-pr-reviewAdversarial spec-compliance PR review — cross-references diffs against approved specs, verifies runtime claims against source, detects competing PRs, audits scope/convention compliance. Use before merging.
agile-methodsAgile and Lean software development methodologies for iterative, adaptive project execution. Covers Scrum (roles, ceremonies, artifacts), Kanban (WIP limits, flow metrics), XP (TDD, pair programming, CI), SAFe overview, Lean Software Development (Poppendieck's 7 principles), user stories (INVEST criteria), estimation via story points and velocity, and the Agile Manifesto's values and principles. Includes Cynefin framework for methodology selection and GSD's relationship to Agile as a structured Lean variant.
algebraic-reasoningSymbolic manipulation, equation solving, and algebraic structures for mathematical reasoning. Covers distributive law, factoring, completing the square, linear through polynomial equation solving, systems of equations (substitution, elimination, Gaussian elimination, matrix methods), algebraic structures (groups, rings, fields), modular arithmetic, polynomial theory, and inequalities. Use when solving equations, simplifying expressions, working with algebraic structures, or performing symbolic manipulation.
algorithmic-awarenessUnderstanding how algorithmic systems shape what users see, know, and do -- from recommendation feeds to search ranking to credit scoring to hiring software. Covers the mechanics of recommendation systems, algorithmic bias and its sources, personalization's effects on information diets, opacity and accountability, AI limitations (hallucination, confident wrongness), and the human-in-the-loop question. Use when a learner needs to think critically about why particular content reached them.
algorithms-data-structuresAlgorithms and data structures from first principles through advanced analysis. Covers sorting (bubble, insertion, selection, merge, quick, heap, radix), searching (linear, binary, BFS, DFS, Dijkstra, A*), fundamental data structures (arrays, linked lists, stacks, queues, hash tables, trees, heaps, graphs, tries), complexity analysis (Big-O, Big-Omega, Big-Theta, amortized), recurrence relations, and algorithm design paradigms (divide-and-conquer, greedy, dynamic programming, backtracking). Use when analyzing, selecting, implementing, or comparing algorithms and data structures.
aminet-browserAminet search and browse: full-text search, category tree navigation, architecture filtering, package detail, and curated collections. Use when searching, browsing, or managing package collections.
aminet-emulatorFS-UAE emulator configuration and launch: hardware profiles, ROM management, WHDLoad integration, config generation, and state snapshots. Use when configuring emulation, managing ROMs, or launching Amiga software.