benchmark-challenge

$npx mdskill add yogsoth-ai/de-anthropocentric-research-engine/benchmark-challenge

Identify and negate benchmark assumptions to reveal hidden constraints

  • Analyzes best practices for hidden biases and assumptions.
  • Depends on domain context and identified benchmark parameters.
  • Decides by deconstructing assumptions and testing their validity.
  • Delivers results through recommendations or new approaches.

SKILL.md

.github/skills/benchmark-challengeView on GitHub ↗
---
name: benchmark-challenge
description: Identify and negate benchmark assumptions. Deconstruct best practices to reveal hidden constraints and open new spaces.
execution: subagent
prompt: ./prompt.md
input: benchmark_or_best_practice (string), domain_context (string)
used-by: anti-benchmark, sacred-cow-hunting
---

# Benchmark Challenge

Identify and negate benchmark assumptions.

## Execution

Subagent — spawned via subagent-spawning/spawn-agent skill.

## Why Subagent

Benchmark challenge requires deep analysis of why a best practice exists, what assumptions it encodes, and what happens when those assumptions are violated. Benefits from dedicated critical focus.

More from yogsoth-ai/de-anthropocentric-research-engine

SkillDescription
abductive-hypothesis-generationStrategy: 面对异常的最佳解释推理
ablation-brainstormRemove components one by one, observe system changes to reveal hidden dependencies and generate ideas from structural gaps.
ablation-component-mappingMap system architecture to ablatable units for ablation studies
ablation-designDesign ablation studies to isolate component contributions in ML systems
ablation-executionRemove components one by one from a system, record the response/impact of each removal.
abp-vulnerability-classificationClassify assumptions on 2 axes — load-bearing (how much conclusion depends on it) × vulnerable (how likely to be false). Focuses attention on High-Load × High-Vulnerable quadrant.
abstraction-extractionExtract abstract principles from concrete domain cases. Strips domain-specific details to reveal transferable mechanisms.
abstraction-ladderPerform bisociation at multiple abstraction levels
abstraction-ladderingMove between concrete and abstract framings — 3 levels up (Why?) and 3 levels down (How?) to find the most productive research level.
abstraction-to-designAbstract biological principle to design principle. Bridge from biology to engineering.