bio-workflows-cnv-pipeline
$
npx mdskill add GPTomics/bioSkills/bio-workflows-cnv-pipelineDetect copy number variants from sequencing data using CNVkit.
- Analyzes exome and targeted sequencing panels for copy number alterations.
- Depends on CNVkit, GATK, and related copy number analysis tools.
- Validates coverage, calling counts, and known variant presence at checkpoints.
- Delivers segmented results with visualization and annotation outputs.
SKILL.md
.github/skills/bio-workflows-cnv-pipelineView on GitHub ↗
---
name: bio-workflows-cnv-pipeline
description: End-to-end copy number variant detection workflow from BAM files. Covers CNVkit analysis for exome/targeted sequencing with visualization and annotation. Use when detecting copy number alterations from sequencing data.
tool_type: mixed
primary_tool: CNVkit
workflow: true
depends_on:
- copy-number/cnvkit-analysis
- copy-number/cnv-visualization
- copy-number/cnv-annotation
qc_checkpoints:
- after_coverage: "Uniform coverage across targets"
- after_calling: "Reasonable CNV count, expected ploidy"
- after_annotation: "Known CNVs detected if present"
---
## Version Compatibility
Reference examples tested with: CNVkit 0.9+, GATK 4.5+
Before using code patterns, verify installed versions match. If versions differ:
- CLI: `<tool> --version` then `<tool> --help` to confirm flags
If code throws ImportError, AttributeError, or TypeError, introspect the installed
package and adapt the example to match the actual API rather than retrying.
# CNV Pipeline
**"Detect copy number variants from my sequencing data"** → Orchestrate CNVkit coverage analysis, segmentation, calling, visualization, and annotation for exome or targeted sequencing panels.
Complete workflow for detecting copy number variants from exome or targeted sequencing data.
## Workflow Overview
```
BAM files (tumor/normal or germline)
|
v
[1. Target Preparation] --> Create/access target BED
|
v
[2. Coverage Calculation] --> Read depth per target
|
v
[3. Reference Creation] --> Pool of normals
|
v
[4. CNV Calling] --------> Log2 ratios, segmentation
|
v
[5. Visualization] ------> Scatter plots, heatmaps
|
v
[6. Annotation] ---------> Gene-level CNVs
|
v
CNV calls with gene annotations
```
## Primary Path: CNVkit
### Step 1: Prepare Target Regions
```bash
# If using exome capture kit BED
cnvkit.py target capture_targets.bed \
--annotate refFlat.txt \
--split \
-o targets.bed
# Access regions (off-target for WGS-like sensitivity)
cnvkit.py access genome.fa \
-o access.bed
cnvkit.py antitarget targets.bed \
--access access.bed \
-o antitargets.bed
```
### Step 2: Calculate Coverage
```bash
# For each sample
for bam in *.bam; do
sample=$(basename $bam .bam)
# Target coverage
cnvkit.py coverage $bam targets.bed \
-o coverage/${sample}.targetcoverage.cnn
# Antitarget coverage
cnvkit.py coverage $bam antitargets.bed \
-o coverage/${sample}.antitargetcoverage.cnn
done
```
### Step 3: Create Reference (Pool of Normals)
```bash
# From normal samples
cnvkit.py reference \
coverage/normal*.targetcoverage.cnn \
coverage/normal*.antitargetcoverage.cnn \
--fasta genome.fa \
-o reference.cnn
# Or flat reference (no normals available)
cnvkit.py reference \
--fasta genome.fa \
--targets targets.bed \
--antitargets antitargets.bed \
-o flat_reference.cnn
```
### Step 4: Call CNVs
```bash
for bam in tumor*.bam; do
sample=$(basename $bam .bam)
# Fix and segment
cnvkit.py fix \
coverage/${sample}.targetcoverage.cnn \
coverage/${sample}.antitargetcoverage.cnn \
reference.cnn \
-o cnv/${sample}.cnr
# Segment
cnvkit.py segment cnv/${sample}.cnr \
-o cnv/${sample}.cns
# Call integer copy numbers
cnvkit.py call cnv/${sample}.cns \
-o cnv/${sample}.call.cns
done
```
### Step 5: Visualization
```bash
# Scatter plot for single sample
cnvkit.py scatter cnv/tumor1.cnr \
-s cnv/tumor1.cns \
-o plots/tumor1_scatter.pdf
# Chromosome-specific
cnvkit.py scatter cnv/tumor1.cnr \
-s cnv/tumor1.cns \
-c chr17 \
-o plots/tumor1_chr17.pdf
# Diagram (chromosome ideogram)
cnvkit.py diagram cnv/tumor1.cnr \
-s cnv/tumor1.cns \
-o plots/tumor1_diagram.pdf
# Heatmap for multiple samples
cnvkit.py heatmap cnv/*.cns \
-o plots/cohort_heatmap.pdf
```
### Step 6: Export and Annotation
```bash
# Export to various formats
cnvkit.py export seg cnv/*.cns -o cnv/cohort.seg
cnvkit.py export vcf cnv/tumor1.call.cns -o cnv/tumor1.vcf
# Gene-level summary
cnvkit.py genemetrics cnv/tumor1.cnr \
-s cnv/tumor1.cns \
--threshold 0.2 \
-o cnv/tumor1_genes.tsv
# Filter for significant CNVs
awk '$6 < -0.4 || $6 > 0.3' cnv/tumor1_genes.tsv > cnv/tumor1_significant_genes.tsv
```
## Batch Processing Script
```bash
#!/bin/bash
set -e
TARGETS="targets.bed"
REFERENCE="reference.cnn"
OUTDIR="cnv_results"
mkdir -p ${OUTDIR}/{coverage,cnv,plots}
# Process all tumor samples
for bam in tumor*.bam; do
sample=$(basename $bam .bam)
echo "Processing ${sample}..."
# Coverage
cnvkit.py coverage $bam ${TARGETS} \
-o ${OUTDIR}/coverage/${sample}.targetcoverage.cnn
# Fix
cnvkit.py fix \
${OUTDIR}/coverage/${sample}.targetcoverage.cnn \
${OUTDIR}/coverage/${sample}.antitargetcoverage.cnn \
${REFERENCE} \
-o ${OUTDIR}/cnv/${sample}.cnr
# Segment
cnvkit.py segment ${OUTDIR}/cnv/${sample}.cnr \
-o ${OUTDIR}/cnv/${sample}.cns
# Call
cnvkit.py call ${OUTDIR}/cnv/${sample}.cns \
-o ${OUTDIR}/cnv/${sample}.call.cns
# Plot
cnvkit.py scatter ${OUTDIR}/cnv/${sample}.cnr \
-s ${OUTDIR}/cnv/${sample}.cns \
-o ${OUTDIR}/plots/${sample}.pdf
done
# Cohort heatmap
cnvkit.py heatmap ${OUTDIR}/cnv/*.cns -o ${OUTDIR}/plots/heatmap.pdf
```
## Germline CNV Calling
```bash
# For germline analysis (no tumor-normal)
cnvkit.py batch sample*.bam \
--normal normal*.bam \
--targets targets.bed \
--fasta genome.fa \
--output-reference reference.cnn \
--output-dir cnv_output \
--scatter --diagram
# Or use flat reference
cnvkit.py batch sample.bam \
--method hybrid \
--targets targets.bed \
--fasta genome.fa \
--output-dir cnv_output
```
## Parameter Recommendations
| Step | Parameter | Value |
|------|-----------|-------|
| target | --split | Yes (for WES) |
| segment | --method | cbs (default) |
| call | --ploidy | 2 (adjust if known) |
| call | --purity | Estimate if tumor |
| genemetrics | --threshold | 0.2 |
## Troubleshooting
| Issue | Likely Cause | Solution |
|-------|--------------|----------|
| Noisy signal | Low coverage | Increase sequencing depth |
| No CNVs | Flat reference, normal sample | Check reference creation |
| Many small CNVs | Over-segmentation | Increase segment min size |
| Batch effects | Different capture kits | Match samples to correct reference |
## Complete Pipeline Script
```bash
#!/bin/bash
set -e
GENOME="genome.fa"
TARGETS="capture_targets.bed"
REFFLAT="refFlat.txt"
NORMAL_BAMS="normal*.bam"
TUMOR_BAMS="tumor*.bam"
OUTDIR="cnv_results"
mkdir -p ${OUTDIR}/{coverage,cnv,plots,annotation}
# Step 1: Prepare targets
cnvkit.py target ${TARGETS} --annotate ${REFFLAT} --split -o ${OUTDIR}/targets.bed
cnvkit.py access ${GENOME} -o ${OUTDIR}/access.bed
cnvkit.py antitarget ${OUTDIR}/targets.bed --access ${OUTDIR}/access.bed -o ${OUTDIR}/antitargets.bed
# Step 2: Coverage (normals)
for bam in ${NORMAL_BAMS}; do
sample=$(basename $bam .bam)
cnvkit.py coverage $bam ${OUTDIR}/targets.bed -o ${OUTDIR}/coverage/${sample}.targetcoverage.cnn
cnvkit.py coverage $bam ${OUTDIR}/antitargets.bed -o ${OUTDIR}/coverage/${sample}.antitargetcoverage.cnn
done
# Step 3: Reference
cnvkit.py reference ${OUTDIR}/coverage/normal*.cnn --fasta ${GENOME} -o ${OUTDIR}/reference.cnn
# Step 4-5: Process tumors
for bam in ${TUMOR_BAMS}; do
sample=$(basename $bam .bam)
cnvkit.py coverage $bam ${OUTDIR}/targets.bed -o ${OUTDIR}/coverage/${sample}.targetcoverage.cnn
cnvkit.py coverage $bam ${OUTDIR}/antitargets.bed -o ${OUTDIR}/coverage/${sample}.antitargetcoverage.cnn
cnvkit.py fix ${OUTDIR}/coverage/${sample}.targetcoverage.cnn \
${OUTDIR}/coverage/${sample}.antitargetcoverage.cnn \
${OUTDIR}/reference.cnn -o ${OUTDIR}/cnv/${sample}.cnr
cnvkit.py segment ${OUTDIR}/cnv/${sample}.cnr -o ${OUTDIR}/cnv/${sample}.cns
cnvkit.py call ${OUTDIR}/cnv/${sample}.cns -o ${OUTDIR}/cnv/${sample}.call.cns
cnvkit.py scatter ${OUTDIR}/cnv/${sample}.cnr -s ${OUTDIR}/cnv/${sample}.cns -o ${OUTDIR}/plots/${sample}.pdf
cnvkit.py genemetrics ${OUTDIR}/cnv/${sample}.cnr -s ${OUTDIR}/cnv/${sample}.cns -o ${OUTDIR}/annotation/${sample}_genes.tsv
done
echo "Pipeline complete. Results in ${OUTDIR}/"
```
## Related Skills
- copy-number/cnvkit-analysis - CNVkit details
- copy-number/cnv-visualization - Plotting options
- copy-number/cnv-annotation - Gene annotations
- copy-number/gatk-cnv - GATK alternative
More from GPTomics/bioSkills
- bio-admet-predictionPredicts ADMET properties using ADMETlab 3.0 API or DeepChem models. Estimates bioavailability, CYP inhibition, hERG liability, and 119 toxicity endpoints with uncertainty quantification. Filters for PAINS and other structural alerts. Use when filtering compounds for drug-likeness or prioritizing leads by predicted safety.
- bio-alignment-amplicon-clippingTrim PCR primers from aligned reads in amplicon-panel BAMs using samtools ampliconclip. Use when processing SARS-CoV-2 ARTIC, hereditary cancer panels, ctDNA hot-spot panels, or any amplicon assay where primer-derived bases would falsely confirm reference at primer footprints.
- bio-alignment-filteringFilter alignments by flags, mapping quality, and regions using samtools view and pysam. Use when extracting specific reads, removing low-quality alignments, or subsetting to target regions.
- bio-alignment-indexingCreate and use BAI/CSI indices for BAM/CRAM files using samtools and pysam. Use when enabling random access to alignment files or fetching specific genomic regions.
- bio-alignment-ioRead, write, and convert multiple sequence alignment files using Biopython Bio.AlignIO. Supports Clustal, PHYLIP, Stockholm, FASTA, Nexus, and other alignment formats for phylogenetics and conservation analysis. Use when reading, writing, or converting alignment file formats.
- bio-alignment-msa-parsingParse and analyze multiple sequence alignments using Biopython. Extract sequences, identify conserved regions, analyze gaps, work with annotations, and manipulate alignment data for downstream analysis. Use when parsing or manipulating multiple sequence alignments.
- bio-alignment-msa-statisticsCalculate alignment statistics including sequence identity, conservation scores, substitution matrices, and similarity metrics. Use when comparing alignment quality, measuring sequence divergence, and analyzing evolutionary patterns.
- bio-alignment-multiplePerform multiple sequence alignment using MAFFT, MUSCLE5, ClustalOmega, or T-Coffee. Guides tool and algorithm selection based on dataset size, sequence divergence, and downstream application. Use when aligning three or more homologous sequences for phylogenetics, conservation analysis, or evolutionary studies.
- bio-alignment-pairwisePerform pairwise sequence alignment using Biopython Bio.Align.PairwiseAligner. Use when comparing two sequences, finding optimal alignments, scoring similarity, and identifying local or global matches between DNA, RNA, or protein sequences.
- bio-alignment-sortingSort alignment files by coordinate or read name using samtools and pysam. Use when preparing BAM files for indexing, variant calling, or paired-end analysis.