Improving the Aggregation and Evaluation of NBA Mock Drafts

Abstract Number:

2213 

Submission Type:

Contributed Abstract 

Contributed Abstract Type:

Paper 

Participants:

Jared Fisher (1), Colin Montague (2)

Institutions:

(1) Brigham Young University, N/A, (2) Sacramento Kings, N/A

Co-Author:

Colin Montague  
Sacramento Kings

First Author:

Jared Fisher  
Brigham Young University

Presenting Author:

Jared Fisher  
Brigham Young University

Abstract Text:

Many enthusiasts and experts publish forecasts of the order players are drafted into professional sports leagues, known as mock drafts. Using a novel dataset of mock drafts for the National Basketball Association (NBA), we analyze authors' mock draft accuracy over time and ask how we can reasonably use information from multiple authors. To measure how accurate mock drafts are, we assume that both mock drafts and the actual draft are ranked lists, and we propose that rank-biased distance (RBD) of Webber et al. (2010) is the appropriate error metric for mock draft accuracy. This is because RBD allows mock drafts to have a different length than the actual draft, accounts for players not appearing in both lists, and weights errors early in the draft more than errors later on. We validate that mock drafts, as expected, improve in accuracy over the course of a season, and that accuracy of the mock drafts produced right before their drafts is fairly stable across seasons. To be able to combine information from multiple mock drafts into a single consensus mock draft, we also propose a ranked-list combination method based on the ideas of ranked-choice voting.

Keywords:

Expert elicitation|Rank-biased overlap|Borda count|Ranked-choice voting|Instant-runoff voting|Rank aggregation

Sponsors:

Section on Statistics in Sports

Tracks:

Miscellaneous

Can this be considered for alternate subtype?

Yes

Are you interested in volunteering to serve as a session chair?

Yes

I have read and understand that JSM participants must abide by the Participant Guidelines.

Yes

I understand that JSM participants must register and pay the appropriate registration fee by June 1, 2024. The registration fee is non-refundable.

I understand