All Models Are Wrong, but a Set of them is Useful
Abstract Number:
3644
Submission Type:
Contributed Abstract
Contributed Abstract Type:
Paper
Participants:
Yagmur Yavuzozdemir (1), roberto molinari (2), Gaetan Bakalli (3), Stéphane Guerrier (4), Cesare Miglioli (4), Samuel Orso (1), Nabil Mili (4)
Institutions:
(1) N/A, N/A, (2) Auburn University, N/A, (3) Emlyon Business School, N/A, (4) University of Geneva, N/A
Co-Author(s):
First Author:
Presenting Author:
Abstract Text:
Prediction performance in practical settings often relies on a single, complex model, which may sacrifice interpretability. The concept of the Rashomon set challenges this paradigm by advocating for a set of equally-performing models rather than a singular one. We introduce the Sparse Wrapper Algorithm (SWAG), a novel multi-model selection method that employs a greedy algorithm combining screening and wrapper approaches. SWAG produces a set of low-dimensional models with high predictive power, offering practitioners the flexibility to choose models aligned with their needs or domain expertise without compromising accuracy. SWAG works in a forward step manner; the user selects a learning mechanism and the SWAG begins by evaluating low-dimensional models. It then systematically builds larger models based on the best-performing ones from previous steps. It results with a set of models called "SWAG models." SWAG's modeling flexibility empowers decision-makers in diverse fields such as genomics, engineering, and neurology. Its adaptability allows it to construct a network revealing the intensity and direction of attribute interactions, providing a more insightful perspective.
Keywords:
Prediction accuracy|multi-model selection|SWAG|Interpretability|Feature importance|
Sponsors:
International Statistical Institute
Tracks:
Miscellaneous
Can this be considered for alternate subtype?
Yes
Are you interested in volunteering to serve as a session chair?
No
I have read and understand that JSM participants must abide by the Participant Guidelines.
Yes
I understand that JSM participants must register and pay the appropriate registration fee by June 1, 2024. The registration fee is non-refundable.
I understand
You have unsaved changes.