Sunday, Aug 2: 4:00 PM - 5:50 PM
1538
Topic-Contributed Paper Session
Thomas M. Menino Convention & Exhibition Center
Room: CC-105
Applied
No
Main Sponsor
Business and Economic Statistics Section
Presentations
Network interference occurs when a unit's outcome depends not only on its own treatment but also on the treatments received by connected units in the network. Experimental designs and analysis methods that ignore such interference can yield biased estimators of causal effects. In this paper, we develop a new experimental design for estimating the global treatment effect and spillover effect under a model-based framework and ego-cluster randomization. Under this design, the network is partitioned into a collection of ego-clusters, each consisting of a focal unit (the ego) and its network neighbors (the alters), with randomization conducted at the cluster level. We propose model-based estimators for the global treatment effect and spillover effect and establish their consistency and asymptotic normality, with asymptotic variances determined by the ego-cluster structure. Building on these theoretical results, we introduce an ego-clustering algorithm that sequentially selects egos and assigns alters to minimize asymptotic variances. Simulation studies and two empirical applications demonstrate that the proposed procedure yields accurate inference and efficiency improvements over existing network experimental designs.
Keywords
ego-cluster randomization
experimental design
network interference
spillover effect
treatment effect
Expected shortfall is defined as the truncated mean of a random variable that falls below a specified quantile level and is widely recognized as an important risk measure. Motivated by the empirical observation of clustering patterns in financial risks, we consider a joint autoregressive model for both conditional quantile and expected shortfall. Existing estimation methods for such models typically rely on minimizing a nonlinear and nonconvex joint loss function, which is challenging to solve. We employ a weighted two-step regression approach to estimate the proposed model and focus on estimating and inferring the expected shortfall model parameters. By constructing weighting functions that match the conditional variance of the regression residuals, our proposed expected shortfall estimator has greater efficiency compared to those obtained by existing methods, both theoretically and numerically, for a general class of location-scale family time series. We further develop a Portmanteau test for model diagnostics with theoretical guarantees. Our empirical results on stock market data indicate that the proposed models effectively capture the clustering patterns and leverage effects on the conditional expected shortfall.
Keywords
Time Series
Financial Risk Management
Neyman Orthogonality
Quantile Regression
Speaker
Peiyao Cai, University of Michigan, Ann Arbor
Co-Author
Peiyao Cai, University of Michigan, Ann Arbor
Noisy matrix completion is a fundamental problem in statistical learning and has attracted a substantial amount of interest over the last two decades. In a variety of applications, the missingness pattern is highly informative, yet it has received relatively less attention. Most existing methods either overlook this source of information or oversimplify its generating process, with few attempting to model the association between the data matrix and its informative missingness. In this study, we propose a general modeling framework that jointly models the data matrix and its missingness pattern using a pair of low-rank models coupled by a flexible shared linear structure. This joint low-rank approach incorporates the informative missingness to improve matrix completion and can flexibly capture various associations between the two modes of data. We develop an efficient joint estimation procedure for this framework based on projected gradient descent, and establish local convergence guarantees that unveil its computational and statistical properties. We further demonstrate, through extensive simulation studies and real data analysis, that our proposed approach outperforms competing methods, achieving substantial improvements in prediction accuracy on missing entries.
Keywords
low-rank model
latent factor model
non-convex optimization
projected gradient descent
We study estimation and statistical inference for reward models used in aligning large language models (LLMs). A key component of LLM alignment is reinforcement learning from human feedback (RLHF), where humans compare pairs of model-generated answers and their preferences are used to train a reward model. However, human feedback is inherently heterogeneous, creating significant challenges for reliable reward learning. To address this, we adopt a heterogeneous preference framework that jointly models the latent reward of answers and human rationality. This leads to a challenging biconvex optimization problem, which we solve via an alternating gradient descent algorithm. We establish theoretical guarantees for the resulting estimator, including its convergence and asymptotic distribution. These results enable the construction of confidence intervals for reward estimates. Leveraging these uncertainty quantification results, we conduct valid statistical comparisons between rewards and incorporate uncertainty into the best-of-N (BoN) policy framework. Extensive simulations demonstrate the effectiveness of our method, and applications to real LLM data highlight the practical value of accounting for uncertainty in reward modeling for LLM alignment.
Keywords
Heterogeneous human feedback
LLMs
Nonconvex optimization
RLHF
Statistical inference