首页 > 组学教程 > CHIP分析qc解读报告链接
2022
11-20

CHIP分析qc解读报告链接

QC Report



general
Report generated at 2021-01-13 22:36:11
Title Demo-H3K27me3
Description This is a  input JSON for Demo-H3K27me3.
Pipeline version v1.3.4
Pipeline type histone
Genome mm10
Aligner bowtie2
Sequencing endedness OrderedDict([('rep1', {'paired_end': True}), ('rep2', {'paired_end': True}), ('ctl1', {'paired_end': True}), ('ctl2', {'paired_end': True})])
Peak caller macs2


Report QC介绍基本信息,说明:

  • 报告发布时间

  • 报告类型atac

  • 比对基因组使用的是什么,如mm10,hg38,rn6

  • 比对软件bowtie2

  • 测序类型为双端测序(paired end)

  • peak caller 软件为 macs2


Alignment quality metrics (比对质量检测)


SAMstat (raw unfiltered BAM) (原始比对质量检测)


rep1 rep2 ctl1 ctl2
Total Reads 32765368 36715350 37764744 56655974
Total Reads (QC-failed) 0 0 0 0
Duplicate Reads 0 0 0 0
Duplicate Reads (QC-failed) 0 0 0 0
Mapped Reads 30605153 34442186 36046712 53778547
Mapped Reads (QC-failed) 0 0 0 0
% Mapped Reads 93.4 93.8 95.5 94.89999999999999
Paired Reads 32765368 36715350 37764744 56655974
Paired Reads (QC-failed) 0 0 0 0
Read1 16382684 18357675 18882372 28327987
Read1 (QC-failed) 0 0 0 0
Read2 16382684 18357675 18882372 28327987
Read2 (QC-failed) 0 0 0 0
Properly Paired Reads 28956602 32820494 34391790 51050556
Properly Paired Reads (QC-failed) 0 0 0 0
% Properly Paired Reads 88.4 89.4 91.10000000000001 90.10000000000001
With itself 29925008 33702510 35310142 52610300
With itself (QC-failed) 0 0 0 0
Singletons 680145 739676 736570 1168247
Singletons (QC-failed) 0 0 0 0
% Singleton 2.1 2.0 2.0 2.1
Diff. Chroms 242724 193541 133840 201009
Diff. Chroms (QC-failed) 0 0 0 0


原始数据比对基因组过程的质控:

  • Total Reads,为全部reads数。

  • duplicate Reads,为重复reads数,需要去除。

  • Mapped Reads,为mapping到基因组上的reads数。

  • % Mapped Reads,为reads的mapping率。
    (大于90%非常好,大于80%较好,较低时可考虑是否是实验的特殊处理或其他污染导致。)

  • Properly Paired Reads,正确匹配的双端reads。

  • % Properly Paired Reads,reads 双端匹配率。

  • With itself,双端匹配到基因组上的reads。

  • singleton,只有单端匹配到基因组上的reads。

  • % singleton,只有单端的匹配率。

  • Diff.Chroms,没有匹配到基因组上的数据。


Marking duplicates (filtered BAM) (重复数据标记检测)


rep1 rep2 ctl1 ctl2
Unpaired Reads 0 0 0 0
Paired Reads 12197827 13976665 12342448 18114406
Unmapped Reads 0 0 0 0
Unpaired Duplicate Reads 0 0 0 0
Paired Duplicate Reads 1012356 1157778 957195 1482042
Paired Optical Duplicate Reads 72362 83973 66941 116859
% Duplicate Reads 8.2995 8.2836 7.7553 8.1816


Filtered out (samtools view -F 1804):

  • read unmapped (0x4)

  • mate unmapped (0x8, for paired-end)

  • not primary alignment (0x100)

  • read fails platform/vendor quality checks (0x200)

  • read is PCR or optical duplicate (0x400)


说明:
Duplicate Reads是由于PCR过度扩增,导致的完全一致的reads,这些reads在分析时需要去除。利用samtools过滤掉的数据包括:

  • unmapped的reads(单端/双端)

  • 没有唯一匹配的reads

  • 本身质量差的reads

  • PCR重复产生的duplicate reads



SAMstat (filtered/deduped BAM) (过滤掉线粒体reads及重复reads后的质量检测)


rep1 rep2 ctl1 ctl2
Total Reads 22370942 25637774 22770506 33264728
Total Reads (QC-failed) 0 0 0 0
Duplicate Reads 0 0 0 0
Duplicate Reads (QC-failed) 0 0 0 0
Mapped Reads 22370942 25637774 22770506 33264728
Mapped Reads (QC-failed) 0 0 0 0
% Mapped Reads 100.0 100.0 100.0 100.0
Paired Reads 22370942 25637774 22770506 33264728
Paired Reads (QC-failed) 0 0 0 0
Read1 11185471 12818887 11385253 16632364
Read1 (QC-failed) 0 0 0 0
Read2 11185471 12818887 11385253 16632364
Read2 (QC-failed) 0 0 0 0
Properly Paired Reads 22370942 25637774 22770506 33264728
Properly Paired Reads (QC-failed) 0 0 0 0
% Properly Paired Reads 100.0 100.0 100.0 100.0
With itself 22370942 25637774 22770506 33264728
With itself (QC-failed) 0 0 0 0
Singletons 0 0 0 0
Singletons (QC-failed) 0 0 0 0
% Singleton 0.0 0.0 0.0 0.0
Diff. Chroms 0 0 0 0
Diff. Chroms (QC-failed) 0 0 0 0


Filtered and duplicates removed


说明:

  • duplicate reads,对过滤后的reads进行质控。表格说明同上。


Sequence quality metrics (filtered/deduped BAM) (测序质量检测)

1618993419064091882.png1618993433767025415.png


                                                  rep1                                                              rep2


Open chromatin assays are known to have significant GC bias. Please take this            into consideration as necessary.


说明:

  • 红色线条为每条序列在基因组特定位置的均一化覆盖度,

  • 蓝色线条为每条序列的平均碱基的质量

  • 绿色线条为每条碱基的GC含量,正常一般分布在50%左右,

每条序列的平均碱基的质量参考说明:

Phred分值 不正确的碱基识别 碱基正确识别率 Q.sorce
10 1/10 90% Q10
20 1/100 99% Q20
30 1/1000 99.9% Q30
40 1/10000 99.99% Q40

Library complexity quality metrics (文库复杂度质量检测)


Library complexity (filtered non-mito BAM) (文库复杂度)


rep1 rep2 ctl1 ctl2
Total Fragments 12197510 13975709 12339741 18110126
Distinct Fragments 11191647 12825074 11392158 16645601
Positions with Two Read 878017 1003321 812861 1253221
NRF = Distinct/Total 0.917535 0.917669 0.923209 0.919132
PBC1 = OneRead/Distinct 0.916077 0.916322 0.924052 0.919924
PBC2 = OneRead/TwoRead 11.67678 11.712997 12.95049 12.218665


Mitochondrial reads are filtered out by default.        The non-redundant fraction (NRF) is the fraction of non-redundant mapped reads        in a dataset; it is the ratio between the number of positions in the genome        that uniquely mapped reads map to and the total number of uniquely mappable        reads. The NRF should be > 0.8. The PBC1 is the ratio of genomic locations        with EXACTLY one read pair over the genomic locations with AT LEAST one read        pair. PBC1 is the primary measure, and the PBC1 should be close to 1.        Provisionally 0-0.5 is severe bottlenecking, 0.5-0.8 is moderate bottlenecking,        0.8-0.9 is mild bottlenecking, and 0.9-1.0 is no bottlenecking. The PBC2 is        the ratio of genomic locations with EXACTLY one read pair over the genomic        locations with EXACTLY two read pairs. The PBC2 should be significantly        greater than 1. See more details at                the ENCODE portal standard for ChIP-Seq pipeline


NRF (non redundant fraction)
       PBC1 (PCR Bottleneck coefficient 1)
       PBC2 (PCR Bottleneck coefficient 2)
       PBC1 is the primary measure. Provisionally

  • 0-0.5 is severe bottlenecking

  • 0.5-0.8 is moderate bottlenecking

  • 0.8-0.9 is mild bottlenecking

  • 0.9-1.0 is no bottlenecking



说明:

  • Total Fragments:总片段数

  • Distinct Fragments:可以唯一匹配到基因组上的片段数

  • One Reads:只有一个reads匹配到特定位置的片段数

  • Two Read:有两个reads匹配的同一位置的片段数

  • NRF = Distinct/Total

  • PBC1 = OneRead/Distinct

  • PBC2 = OneRead/TwoRead

文库复杂度的指标由三个值决定,NRF、PBC1、PBC2,其中最重要的为PBC1的数值

ENCODE对文库复杂度的要求如下,

PBC1 PBC2 Bottlenecking level NRF Complexity Flag colors
< 0.7 <1 Severe < 0.7 Concerning Orange
0.7 <= PBC1 <= 0.9 1 <= PBC2 <= 3 Moderate 0.7 <= NRF <= 0.9 Acceptable Yellow
> 0.9 >3 None > 0.9 ldeal None

Replication quality metrics (重复性质量检测)

1618993584724011640.png


IDR (Irreproducible Discovery Rate) plots (不可重复发现率)
(可选,仅在有至少2组重复(rep1,rep2,...)时计算)

pooled-pr1_vs_pooled-pr2

IDR主要比较两个样本之间的重复性,先对peaks进行排序,然后进行重复性的分析,得到IDR得分。IDR<0.05,认为有重复性,黑色表示,IDR>=0.05认为没有重复性,红色表示。

  • 一般对两重复样本进行IDR检测(rep1 vs rep2),检测两样本之间的重复性。

  • 单样本的虚拟样本间也可进行IDR检测(rep1-pr1 vs rep1-pr2),验证IDR检测的准确性。

  • 样本混样成pool进行IDR检测(pool-pr1 VS pool-pr2)


Reproducibility QC and peak detection statistics(重复性QC及peak统计分析)


overlap
Nt 69675
N1 57215
N2 50331
Np 65776
N optimal 69675
N conservative 69675
Optimal Set rep1_vs_rep2
Conservative Set rep1_vs_rep2
Rescue Ratio 1.059276939917295
Self Consistency Ratio 1.1367745524626969
Reproducibility Test pass


Reproducibility QC

  • N1: Replicate 1 self-consistent peaks (comparing two pseudoreplicates generated by subsampling Rep1 reads)

  • N2: Replicate 2 self-consistent peaks (comparing two pseudoreplicates generated by subsampling Rep2 reads)

  • Ni: Replicate i self-consistent peaks (comparing two pseudoreplicates generated by subsampling RepX reads)

  • Nt: True Replicate consistent peaks (comparing true replicates Rep1 vs Rep2)

  • Np: Pooled-pseudoreplicate consistent peaks (comparing two pseudoreplicates generated by subsampling pooled reads from Rep1 and Rep2)

  • Self-consistency Ratio: max(N1,N2) / min (N1,N2)

  • Rescue Ratio: max(Np,Nt) / min (Np,Nt)

  • Reproducibility Test: If Self-consistency Ratio >2 AND Rescue Ratio > 2, then 'Fail' else 'Pass'



说明:

  • N1: replicate1自我虚拟peak的一致性peak

  • N2: replicate2自我虚拟peak的一致性peak

  • Ni: replicatei自我虚拟peak的一致性peak

  • Nt: 真实一致性的peak

  • Np: 整体的数据(pool)自我虚拟peak的一致性peak

  • N optimal: 虚拟peak的一致性peak

  • N conservation: 真实peak的一致性peak

  • Self-consistency Ratio:   max(N1,N2) / min (N1,N2)

  • Rescue Ratio:    max(Np,Nt) / min (Np,Nt)

  • Reproducibility Test: 如果Self-consistency Ratio >2 AND Rescue Ratio > 2, 则失败(Failed),否则通过(pass)

ENCODE对以上指标的检测标准如下:

Self-consistency Ratio Rescue Ratio Resulting Data Status Flag colors
Less than 2 Less than 2 Ideal None
Less than 2 Greater than 2 Acceptable Yellow
Greater than 2 Less than 2 Acceptable Yellow
Greater than 2 Greater than 2 Concerning Orange

  • IDR 一致的peak 最好大于70,000 ,不少于50,000 为可接受



Number of raw peaks (原始peaks数)


rep1 rep2
Number of peaks 222897 181249


           Top 500000 raw peaks from macs2 with p-val threshold 0.01

说明:

  • 原始peak数最好不少于150,000,不少于100,000为可接受


Peak calling statistics (peak calling统计)


Peak region size (peak长度范围)



rep1 rep2 overlap_opt
Min size 145.0 145.0 145.0
25 percentile 167.0 166.0 344.0
50 percentile (median) 244.0 234.0 573.0
75 percentile 398.0 371.0 1046.0
Max size 29358.0 20650.0 58300.0
Mean 407.57078830132303 380.0660693300377 973.742691065662

1618993676757044676.png1618993651735033505.png



rep1
                                                  rep2




1618993860188064518.png1618993867007076110.png
     idr_opt                                                              overlap_opt




说明:

  • 图形横坐标为region size,纵坐标为peak数。

  • Rep1与rep2显示的是原始peaks(去除duplicate及线粒体基因组)

  • Idr_opt显示的是经过IDR优化后的peaks

  • Overlap_opt显示经过overlap优化后的peaks



Enrichment / Signal-to-noise ratio


Strand cross-correlation measures (trimmed/filtered SE BAM) (链互相关检测)


rep1 rep2
Number of Subsampled Reads 12851530 14654164
Estimated Fragment Length 145 145
Cross-correlation at Estimated Fragment Length 0.163501733940247 0.174463103738491
Phantom Peak 145 135
Cross-correlation at Phantom Peak 0.1635017 0.1744216
Argmin of Cross-correlation 1500 1500
Minimum of Cross-correlation 0.1551336 0.1689095
NSC (Normalized Strand Cross-correlation coeff.) 1.053942 1.032879
RSC (Relative Strand Cross-correlation coeff.) 1.0 1.00753


           

Performed on subsampled (15000000) reads mapped from FASTQs that are trimmed to 50.            Such FASTQ trimming and subsampling reads are for cross-corrleation analysis only.            Untrimmed FASTQs are used for all the other analyses.

NOTE1: For SE datasets, reads from replicates are randomly subsampled to 15000000.
           NOTE2: For PE datasets, the first end (R1) of each read-pair is selected and trimmed to 50 the reads are then randomly subsampled to 15000000.

  • Normalized strand cross-correlation coefficient (NSC) = col9 in outFile

  • Relative strand cross-correlation coefficient (RSC) = col10 in outFile

  • Estimated fragment length = col3 in outFile, take the top value


1618993967934067858.png1618993967937001276.png


rep1
                                               rep2


NSC与RSC的算法如下:

1618994147250013428.png

从flitered BAM文件中虚拟一个含有25,000,000个reads的副本,并对该副本进行链互相关分析。链互相关性分析主要显示+,-链reads的相似性。由于正负reads的peak中心有偏移,因此,结果中一般会出现两个peak,一个是标准peak,一个是虚拟peak( Phantom Peak)。如下图所示

1618994198906090378.jpg


Jensen-Shannon distance (filtered/deduped BAM)(JS散度检测)



rep1 rep2
AUC 0.1747780085641306 0.19630546999584553
Synthetic AUC 0.49369100397133525 0.4938306458383708
X-intercept 0.2814028450423717 0.2282392651040396
Synthetic X-intercept 2.833074277847546e-215 3.311809264890219e-225
Elbow Point 0.6829741370691345 0.6637998952205367
Synthetic Elbow Point 0.5077616252755175 0.5090817373473214
JS Distance 0.15457967388718868 0.1319724797088127
Synthetic JS Distance 0.3844893157186109 0.36697074507783967
% Genome Enriched 26.773152462117427 27.906330359249587
Diff. Enrichment 35.52863604550958 32.38593833632243
CHANCE Divergence 0.30759877464436847 0.27907882507917986

下载 (4).png



说明:


  • JS散度是检测两样本之间的离散程度,也就是检测两样本之间的相似性。



Peak enrichment


Fraction of reads in peaks (FRiP) (peaks占总reads数的比值)

FRiP for macs2 raw peaks


rep1 rep2 rep1-pr1 rep2-pr1 rep1-pr2 rep2-pr2 pooled pooled-pr1 pooled-pr2
Fraction of Reads in Peaks 0.29828399716024473 0.21805804981352905 0.2650521140279105 0.21015824461528956 0.2683713782255015 0.2142321883508442 0.2643710154631088 0.24142476616747957 0.24457677598182598


FRiP for overlap peaks


rep1_vs_rep2 rep1-pr1_vs_rep1-pr2 rep2-pr1_vs_rep2-pr2 pooled-pr1_vs_pooled-pr2
Fraction of Reads in Peaks 0.20251568486022414 0.19483873321025105 0.13992583755516372 0.20076902285826598


FRiP for IDR peaks


pooled-pr1_vs_pooled-pr2
Fraction of Reads in Peaks 0.10828106712956038


For macs2 raw peaks:


  • repX: Peak from true replicate X

  • repX-prY: Peak from Yth pseudoreplicates from replicate X

  • pooled: Peak from pooled true replicates (pool of rep1, rep2, ...)

  • pooled-pr1: Peak from 1st pooled pseudo replicate (pool of rep1-pr1, rep2-pr1, ...)

  • pooled-pr2: Peak from 2nd pooled pseudo replicate (pool of rep1-pr2, rep2-pr2, ...)



           For overlap/IDR peaks:


  • repX_vs_repY: Comparing two peaks from true replicates X and Y

  • repX-pr1_vs_repX-pr2: Comparing two peaks from both pseudoreplicates from replicate X

  • pooled-pr1_vs_pooled-pr2: Comparing two peaks from 1st and 2nd pooled pseudo replicates


说明:

  • FRiP指的是fraction of all mapped reads that fall into peak regions. 代表peak区域内reads的比例,peak区域内的reads是抗体富集的序列,其他区域的序列是背景噪声。 只有mapping到基因组上的reads才会进行后续分析,所以直接用peak区域reads数目除以所有mapping基因组的数目,就得到了FRiP Score。

  • Encode团队发现FRip Score和peak的个数存在正相关关系。 对于不同的转录因子chip数据,peak的个数不同,总体的趋势来看,peak的个数越多,FRiP Score的值越大。在Encode的chip数据集中,有80%左右的FRiP Score值都超过了1%,所以将1%看做是一个衡量chip实验的软标准。 之所以称之为软标准,是因为FRiP score低于1%并不能直接说明chip实验是失败的,高于1%也不能直接说明chip实验就是成功的。在ZNF274和RNA III型聚合酶的chip实验中,peak的个数很少,FRiP score的值也小于1%;在CTCF等转录因子实验中,FRiP score的值又远大于1%。

  • 所以说FRiP score值是和特定的转录因子或者组蛋白修饰相关,在研究特定转录因子时,参考别人已经发表的数据中的FRiP Score作为衡量标准是更好的,在没有参考的情况下,可以用1%的阈值来作为一个软标准,为chip实验的质量提供一个参考。当peak个数的大于1000时,1%这个标准的效果还是比较好的,有相当大的参考意义。



最后编辑:
作者:萌小白
一个热爱网络的青年!

发布评论

表情