protocol-element-extraction

$npx mdskill add yogsoth-ai/de-anthropocentric-research-engine/protocol-element-extraction

Extracts evaluation protocol parameters from a paper's description of a specific benchmark

  • Locates and extracts all relevant protocol parameters across five categories.
  • Depends on locating evaluation/experimental setup sections within the paper content.
  • Uses natural language processing to identify and extract protocol parameters accurately.
  • Provides a structured protocol specification with completeness assessment for review.

SKILL.md

.github/skills/protocol-element-extractionView on GitHub ↗
---
name: protocol-element-extraction
description: Extract evaluation protocol parameters from papers
execution: subagent
prompt: ./prompt.md
input: paper_content, benchmark_name
used-by: benchmark-archaeology
---

# Protocol Element Extraction SOP

Extract all evaluation protocol parameters from a paper's description of how it evaluated on a specific benchmark. Captures the implementation details that affect reproducibility.

## Input

- **paper_content**: Full text or relevant sections of the paper
- **benchmark_name**: The specific benchmark whose evaluation protocol to extract

## Procedure

1. Locate evaluation/experimental setup sections
2. Extract all protocol parameters across 5 categories
3. Flag parameters that are ambiguous or unstated
4. Compare against original benchmark protocol (if known)
5. Note any deviations or innovations in protocol

## Output

Structured protocol specification with completeness assessment.

More from yogsoth-ai/de-anthropocentric-research-engine

SkillDescription
abductive-hypothesis-generationStrategy: 面对异常的最佳解释推理
ablation-brainstormRemove components one by one, observe system changes to reveal hidden dependencies and generate ideas from structural gaps.
ablation-component-mappingMap system architecture to ablatable units for ablation studies
ablation-designDesign ablation studies to isolate component contributions in ML systems
ablation-executionRemove components one by one from a system, record the response/impact of each removal.
abp-vulnerability-classificationClassify assumptions on 2 axes — load-bearing (how much conclusion depends on it) × vulnerable (how likely to be false). Focuses attention on High-Load × High-Vulnerable quadrant.
abstraction-extractionExtract abstract principles from concrete domain cases. Strips domain-specific details to reveal transferable mechanisms.
abstraction-ladderPerform bisociation at multiple abstraction levels
abstraction-ladderingMove between concrete and abstract framings — 3 levels up (Why?) and 3 levels down (How?) to find the most productive research level.
abstraction-to-designAbstract biological principle to design principle. Bridge from biology to engineering.