Integrating LLMs with Existing Text Analysis and Summarization Research Approaches

Abstract Number:

3215 

Submission Type:

Contributed Abstract 

Contributed Abstract Type:

Paper 

Participants:

Emily Hadley (1), Laura Marcial (1), Anthony Berghammer (1), Wes Quattrone (1), Georgiy Bobashev (2)

Institutions:

(1) RTI International, N/A, (2) Research Triangle Institute, N/A

Co-Author(s):

Laura Marcial  
RTI International
Anthony Berghammer  
RTI International
Wes Quattrone  
RTI International
Georgiy Bobashev  
Research Triangle Institute

First Author:

Emily Hadley  
RTI International

Presenting Author:

Emily Hadley  
RTI International

Abstract Text:

Existing text analysis and summarization techniques like key term frequency analysis and unsupervised topic modeling are helpful for analyzing large quantities text but often are insufficient for contextual interpretations. We explore the groundbreaking integration of Large Language Models (LLMs) like GPT with these conventional techniques, highlighting this synergy through two real-world projects from distinct subject areas. This session offers a deep dive into the technicalities of using the GPT API in practice, comparing traditional text analysis methods with LLMs, various technological and methodological challenges, and work done to validate findings. We also discuss feedback and limitations of this approach in two real world settings with subject matter experts from non-technical backgrounds. We suggest further research opportunities for statisticians and sociologists and emphasize how LLMs can enhance analysis of large text datasets.

Keywords:

Text analysis|Large language models| | | |

Sponsors:

Section on Text Analysis

Tracks:

Miscellaneous

Can this be considered for alternate subtype?

No

Are you interested in volunteering to serve as a session chair?

No

I have read and understand that JSM participants must abide by the Participant Guidelines.

Yes

I understand that JSM participants must register and pay the appropriate registration fee by June 1, 2024. The registration fee is non-refundable.

I understand