Boosting e-BH via conditional calibration

1999 

Contributed Abstract 

Paper 

Junu Lee (1), Zhimei Ren (2)

(1) University of Pennsylvania, N/A, (2) N/A, N/A

Zhimei Ren  
N/A

Junu Lee  
University of Pennsylvania

Junu Lee  
University of Pennsylvania

The e-BH procedure is an e-value-based multiple testing procedure that provably controls the false discovery rate (FDR) under any dependence structure between the e-values. Despite this appealing theoretical FDR control guarantee, the e-BH procedure often suffers from low power in practice. In this paper, we propose a general framework that boosts the power of e-BH without sacrificing its FDR control under arbitrary dependence. This is achieved by the technique of conditional calibration, where we take as input the e-values and calibrate them to be a set of "boosted e-values" that are guaranteed to be no less (and are often more) powerful than the original ones. Our general framework is explicitly instantiated in three classes of problems: (1) testing under parametric models, (2) conditional independence testing under the model-X setting, and (3) model-free conformal selection. Numerical experiments show that our proposal significantly improves the power of e-BH while continuing to control the FDR. We also demonstrate the effectiveness of our method through an application to an observational study dataset for identifying individuals whose counterfactuals satisfy certain properties.

e-values|multiple testing|variable selection|conformal inference|novelty detection|model-X knockoffs

IMS

Statistical Methodology