reproducibility-verification

$npx mdskill add yogsoth-ai/de-anthropocentric-research-engine/reproducibility-verification

Verifies experiment reproducibility using ICC and seed-based re-runs

  • Assesses consistency of results across multiple experiment re-runs with varied seeds
  • Relies on statistical tools for ICC calculation and variance decomposition
  • Compares original results to re-run outputs to determine reproducibility thresholds
  • Delivers structured reproducibility assessment with ICC scores and variance breakdown
SKILL.md
.github/skills/reproducibility-verificationView on GitHub ↗
---
name: reproducibility-verification
description: "Verify result reproducibility via re-runs with different seeds and ICC comparison"
version: 1.0.0
category: experiment-execution
type: sop
execution: subagent
prompt: ./prompt.md
used-by:
  - result-analysis
  - result-validation-loop
shared-with: experiment-design
input: experiment design, original results, re-run parameters (n_reruns, seeds)
output: reproducibility assessment with ICC scores and variance decomposition
---

# SOP: Reproducibility Verification

Re-run the experiment with different seeds and compare results to assess reproducibility via ICC and variance analysis.

Subagent — spawned via subagent-spawning/spawn-agent skill.
More from yogsoth-ai/de-anthropocentric-research-engine