Last updated: 2026-09-18

Checks: 7 0

Knit directory: coderepo-local/

This reproducible R Markdown analysis was created with workflowr (version 1.7.2). The Checks tab describes the reproducibility checks that were applied when the results were created. The Past versions tab lists the development history.


Great! Since the R Markdown file has been committed to the Git repository, you know the exact version of the code that produced these results.

Great job! The global environment was empty. Objects defined in the global environment can affect the analysis in your R Markdown file in unknown ways. For reproduciblity it’s best to always run the code in an empty environment.

The command set.seed(20251109) was run prior to running the code in the R Markdown file. Setting a seed ensures that any results that rely on randomness, e.g. subsampling or permutations, are reproducible.

Great job! Recording the operating system, R version, and package versions is critical for reproducibility.

Nice! There were no cached chunks for this analysis, so you can be confident that you successfully produced the results during this run.

Great job! Using relative paths to the files within your workflowr project makes it easier to run your code on other machines.

Great! You are using Git for version control. Tracking code development and connecting the code version to the results is critical for reproducibility.

The results in this page were generated with repository version 806648b. See the Past versions tab to see a history of the changes made to the R Markdown and HTML files.

Note that you need to be careful to ensure that all relevant files for the analysis have been committed to Git prior to generating the results (you can use wflow_publish or wflow_git_commit). workflowr only checks the R Markdown file, but you know if there are other scripts or data files that it depends on. Below is the status of the Git repository when the results were generated:


Ignored files:
    Ignored:    .DS_Store
    Ignored:    .Rhistory
    Ignored:    .Rproj.user/
    Ignored:    Rplots.pdf
    Ignored:    analysis/.DS_Store
    Ignored:    analysis/.Rhistory
    Ignored:    code/.DS_Store
    Ignored:    code/.Rhistory
    Ignored:    code/revision_simulations/.DS_Store
    Ignored:    data/appendixB/
    Ignored:    data/dynamic_eQTL_real/
    Ignored:    data/revision_simulations/
    Ignored:    data/toy_example/
    Ignored:    output/dynamic_eQTL_real/
    Ignored:    output/pdf/
    Ignored:    output/playwright/
    Ignored:    output/revision_simulations/
    Ignored:    scripts/

Untracked files:
    Untracked:  analysis/revision_internal_r3_two_stage_functional_testing.rmd
    Untracked:  code/revision_simulations/internal/per_unit_enhancer_enrichment/
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/compare_corshrink_versions.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/diagnose_discordant_calls.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/diagnose_smooth_mismatch.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/extract_perunit_lfdr.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_call_venns.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_class_variograms.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_corshrink_result.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_corshrink_versions.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_cs_vs_diagonal.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_day0_day1_distribution.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_mechanism_summary.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_perunit_variogram.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_strober_concordance.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/plot_three_models.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/prepare_reference_sets.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/prototype_corshrink.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/recover_design_factor.R
    Untracked:  code/revision_simulations/internal/per_unit_expression_correlation/test_corshrink_reimplementation.R

Note that any generated files, e.g. HTML, png, CSS, etc., are not included in this status report because it is ok for generated content to have uncommitted changes.


These are the previous versions of the repository in which changes were made to the R Markdown (analysis/revision_enhancer_enrichment.rmd) and HTML (docs/revision_enhancer_enrichment.html) files. If you’ve configured a remote Git repository (see ?wflow_git_remote), click on the hyperlinks in the table below to view the files as they were in that past version.

File Version Author Date Message
Rmd 806648b Ziang Zhang 2026-09-18 Organize website into simulations and real data analysis
html e77a71e Ziang Zhang 2026-08-26 Build site.
Rmd cf611a8 Ziang Zhang 2026-08-26 R6: adopt the EpiCompare 6/7/12 enhancer definition and shorten the page
html cf611a8 Ziang Zhang 2026-08-26 R6: adopt the EpiCompare 6/7/12 enhancer definition and shorten the page
Rmd f0ce96e Ziang Zhang 2026-08-26 Broaden R6 enhancer enrichment to the 13-epigenome Roadmap panel
html f0ce96e Ziang Zhang 2026-08-26 Broaden R6 enhancer enrichment to the 13-epigenome Roadmap panel
html 83ed337 Ziang Zhang 2026-08-25 Build site.
Rmd 052df2a Ziang Zhang 2026-08-25 Simplify R6 enhancer-enrichment page to three Roadmap annotations
Rmd 09f63bc Ziang Zhang 2026-08-24 Sync revision analyses and rendered pages
html 09f63bc Ziang Zhang 2026-08-24 Sync revision analyses and rendered pages
Rmd c87957a Ziang Zhang 2026-08-10 Add revision analyses: R1-R6 reviewer-facing pages and internal studies
html c87957a Ziang Zhang 2026-08-10 Add revision analyses: R1-R6 reviewer-facing pages and internal studies

Question

Do dynamic eQTLs discovered by FASH show orthogonal evidence of regulatory function? We tested whether one lead variant per discovered gene preferentially overlaps enhancer annotations from biologically relevant Roadmap epigenomes, using the Roadmap 15-state ChromHMM enhancer definition of states 6, 7 and 12 described by He and Wang (2017).

Section 1 compares the FASH and Strober discovery sets. Section 2 examines the FASH lead variants that neither Strober analysis identified.

The analysis is a descriptive, exploratory check, in six steps:

  1. take the published FASH and Strober discovery sets;
  2. keep one lead variant per discovered gene;
  3. define Roadmap enhancers as ChromHMM states 6, 7 and 12;
  4. record whether each variant overlaps each epigenome’s enhancer annotation;
  5. compare the overlap proportion with the remaining tested variants;
  6. estimate uncertainty with a leave-one-autosome-out jackknife.

Roadmap enhancer annotations

We used the Roadmap Epigenomics 15-state ChromHMM annotations (Roadmap Epigenomics Consortium et al. 2015) and defined enhancers as states 6_EnhG, 7_Enh and 12_EnhBiv (He and Wang 2017). Each of the 745,867 tested variants was assigned an overlap indicator for each of the thirteen epigenomes below.

Group Roadmap ID Roadmap tissue / cell type
iPSC E018 iPS-15b Cells
iPSC E019 iPS-18 Cells
iPSC E020 iPS-20b Cells
iPSC E021 iPS DF 6.9 Cells
iPSC E022 iPS DF 19.11 Cells
Germ layer E011 hESC Derived CD184+ Endoderm Cultured Cells
Germ layer E012 hESC Derived CD56+ Ectoderm Cultured Cells
Germ layer E013 hESC Derived CD56+ Mesoderm Cultured Cells
Cardiac E083 Fetal Heart
Cardiac E095 Left Ventricle
Cardiac E104 Right Atrium
Cardiac E105 Right Ventricle
Vascular E065 Aorta

Section 1: FASH versus Strober

plot_method_comparison()
Figure 1. Enhancer enrichment for the FASH, Strober linear, and Strober quadratic/nonlinear lead-per-gene discovery sets across thirteen Roadmap epigenomes. Points are fold enrichment, bars are pointwise leave-one-autosome-out jackknife 95% intervals, and the dashed line marks no enrichment. One cell falls below the ten-variant overlap floor and is absent: E065 (Strober linear).

Figure 1. Enhancer enrichment for the FASH, Strober linear, and Strober quadratic/nonlinear lead-per-gene discovery sets across thirteen Roadmap epigenomes. Points are fold enrichment, bars are pointwise leave-one-autosome-out jackknife 95% intervals, and the dashed line marks no enrichment. One cell falls below the ten-variant overlap floor and is absent: E065 (Strober linear).

Version Author Date
cf611a8 Ziang Zhang 2026-08-26
f0ce96e Ziang Zhang 2026-08-26
83ed337 Ziang Zhang 2026-08-25
09f63bc Ziang Zhang 2026-08-24
c87957a Ziang Zhang 2026-08-10

FASH’s 1,169 lead variants show modest enrichment across several of the annotations: 7 of the 13 Roadmap annotations had pointwise jackknife intervals entirely above 1 (E021, E022, E011, E012, E013, E095, E105), spanning 1.25-1.51-fold. Both Strober lead sets point in broadly similar directions, with wider intervals that likely reflect in part their smaller discovery sets (548 and 690 lead variants). The pattern is spread across pluripotent, germ-layer and cardiac annotations, so it supports general regulatory enrichment rather than stage or tissue specificity. The three sets differ in size, membership and gene composition, and no formal statistical comparison between them is made here.

Section 2: FASH-specific discoveries

An rsID is counted as FASH-only if neither Strober analysis identified it, regardless of gene pairing. Lead selection happens first and the exclusion is applied afterwards, leaving 1,029 of FASH’s 1,169 lead variants. This is rsID-level exclusivity, not LD-independent locus-level novelty.

plot_fash_only()
Figure 2. Enhancer enrichment for FASH lead variants at rsIDs that neither Strober analysis identified (blue), against all FASH lead variants (grey). Same annotations, estimator and jackknife as Figure 1.

Figure 2. Enhancer enrichment for FASH lead variants at rsIDs that neither Strober analysis identified (blue), against all FASH lead variants (grey). Same annotations, estimator and jackknife as Figure 1.

Version Author Date
cf611a8 Ziang Zhang 2026-08-26
f0ce96e Ziang Zhang 2026-08-26
83ed337 Ziang Zhang 2026-08-25
09f63bc Ziang Zhang 2026-08-24
c87957a Ziang Zhang 2026-08-10

The enrichment estimates were similar after excluding rsIDs identified by either Strober analysis: 7 of the 13 annotations had pointwise intervals entirely above 1, spanning 1.24-1.61-fold against 1.25-1.51-fold for the unfiltered lead set. This gives orthogonal support for the regulatory relevance of the additional FASH discoveries as a set, rather than validating individual variants.

Methods

Discovery sets and lead variants. FASH uses cumulative lfdr at FDR 0.05 after the BF correction; both Strober analyses use their reported eFDR 0.05, with non_linear_dynamic_eqtls_5_pc.txt labelled quadratic/nonlinear. For each discovered gene we selected its strongest discovered variant — lowest lfdr (FASH) or smallest p-value (Strober) — and then evaluated the resulting unique lead variants, so a duplicated rsID counts once. A variant is FASH-only if neither Strober analysis reported that rsID.

Enhancer annotations. Roadmap Epigenomics 15-state ChromHMM segmentations for the thirteen epigenomes above, with enhancers defined as states 6_EnhG, 7_Enh and 12_EnhBiv (Roadmap Epigenomics Consortium et al. 2015; He and Wang 2017). Results were qualitatively similar using the broader enhancer-related definition (EnhG, Enh, EnhBiv and BivFlnk) implemented in the companion code for Strober et al. (2019) (fold enrichments correlated at 0.98 across the 51 cells estimable under both).

Fold enrichment. The proportion of selected variants overlapping the annotation divided by the same proportion among the remaining tested variants, which excludes the selected set from its own comparator. No matched controls are used. A pair with fewer than 10 overlapping selected variants is reported as not estimable.

Uncertainty. Uncertainty was assessed using a leave-one-autosome-out jackknife to account approximately for local dependence among variants. The intervals are pointwise, and the related Roadmap annotations should not be interpreted as independent tests; no multiplicity correction is applied.

Reproducibility

code/revision_simulations/internal/fash_strober_enhancer_comparison/run_r6_roadmap_panel.R builds the annotation indicators and every estimate this page displays, reusing the epigenome panel and segmentation reader from roadmap_enhancer_exploration/ and the estimator from enrichment_api.R:

source(
  "code/revision_simulations/internal/fash_strober_enhancer_comparison/enrichment_api.R"
)
source(
  "code/revision_simulations/internal/roadmap_enhancer_exploration/roadmap_enhancer_exploration_helpers.R"
)

background <- load_background()                       # tested variants
sets <- load_variant_sets()[c(                        # lead per gene
  "current_lead", "linear_lead", "quadratic_lead", "current_only_lead"
)]

annotations <- build_enhancer_annotation_matrix(       # Roadmap indicators
  background[, c("variant_id", "chromosome", "position")],
  definitions = list(EpiCompare = c("6_EnhG", "7_Enh", "12_EnhBiv"))
)

compute_enrichment(                                   # fold enrichment and
  sets, background, annotations, controls = "background"  # chromosome jackknife
)

Rebuilding the inputs and then this page’s cache:

Rscript --vanilla \
  code/revision_simulations/internal/variant_annotation_enrichment/download_variant_annotations.R
Rscript --vanilla \
  code/revision_simulations/internal/variant_annotation_enrichment/run_variant_annotation_enrichment.R
Rscript --vanilla \
  code/revision_simulations/internal/fash_strober_enhancer_comparison/run_fash_strober_enhancer_comparison.R
Rscript --vanilla \
  code/revision_simulations/internal/roadmap_enhancer_exploration/run_roadmap_enhancer_exploration.R
Rscript --vanilla \
  code/revision_simulations/internal/fash_strober_enhancer_comparison/run_r6_roadmap_panel.R

The run script also checks that the state-6/7/12 indicators contain the state-6/7 indicators and are contained in the state-6/7/11/12 indicators, on every epigenome. Intermediate data stays under output/, which is not tracked in git. Rebuilding this page:

Rscript --vanilla -e \
  'workflowr::wflow_build("analysis/revision_enhancer_enrichment.rmd")'

References

He, Y. and Wang, T. (2017). EpiCompare: an online tool to define and explore genomic regions with tissue or cell type-specific epigenomic features. Bioinformatics 33(20), 3268–3275. https://doi.org/10.1093/bioinformatics/btx371

Roadmap Epigenomics Consortium, Kundaje, A., Meuleman, W., Ernst, J., Bilenky, M., Yen, A., et al. (2015). Integrative analysis of 111 reference human epigenomes. Nature 518, 317–330. https://doi.org/10.1038/nature14248

Strober, B., Elorbany, R., Rhodes, K., Krishnan, N., Tayeb, K., Battle, A., and Gilad, Y. (2019). Dynamic genetic regulation of gene expression during cellular differentiation. Science 364, 1287–1290. https://doi.org/10.1126/science.aaw0040


sessionInfo()
R version 4.5.1 (2025-06-13)
Platform: aarch64-apple-darwin20
Running under: macOS Sequoia 15.6.1

Matrix products: default
BLAS:   /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib 
LAPACK: /Library/Frameworks/R.framework/Versions/4.5-arm64/Resources/lib/libRlapack.dylib;  LAPACK version 3.12.1

locale:
[1] C.UTF-8/C.UTF-8/C.UTF-8/C/C.UTF-8/C.UTF-8

time zone: America/Chicago
tzcode source: internal

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] workflowr_1.7.2

loaded via a namespace (and not attached):
 [1] gtable_0.3.6       jsonlite_2.0.0     dplyr_1.1.4        compiler_4.5.1    
 [5] promises_1.5.0     tidyselect_1.2.1   Rcpp_1.1.1-1.1     stringr_1.6.0     
 [9] git2r_0.36.2       dichromat_2.0-0.1  callr_3.7.6        later_1.4.4       
[13] jquerylib_0.1.4    scales_1.4.0       yaml_2.3.12        fastmap_1.2.0     
[17] ggplot2_4.0.3      R6_2.6.1           labeling_0.4.3     generics_0.1.4    
[21] knitr_1.50         tibble_3.3.0       rprojroot_2.1.1    RColorBrewer_1.1-3
[25] bslib_0.9.0        pillar_1.11.1      rlang_1.2.0        cachem_1.1.0      
[29] stringi_1.8.9      httpuv_1.6.16      xfun_0.55          S7_0.2.2          
[33] getPass_0.2-4      fs_1.6.6           sass_0.4.10        otel_0.2.0        
[37] cli_3.6.6          withr_3.0.3        magrittr_2.0.5     ps_1.9.1          
[41] grid_4.5.1         digest_0.6.39      processx_3.8.6     rstudioapi_0.17.1 
[45] lifecycle_1.0.5    vctrs_0.7.3        evaluate_1.0.5     glue_1.8.1        
[49] farver_2.1.2       whisker_0.4.1      rmarkdown_2.30     httr_1.4.7        
[53] tools_4.5.1        pkgconfig_2.0.3    htmltools_0.5.9