Integrating LLMs with Existing Text Analysis and Summarization Research Approaches
Abstract Number:
3215
Submission Type:
Contributed Abstract
Contributed Abstract Type:
Paper
Participants:
Emily Hadley (1), Laura Marcial (1), Anthony Berghammer (1), Wes Quattrone (1), Georgiy Bobashev (2)
Institutions:
(1) RTI International, N/A, (2) Research Triangle Institute, N/A
Co-Author(s):
First Author:
Presenting Author:
Abstract Text:
Existing text analysis and summarization techniques like key term frequency analysis and unsupervised topic modeling are helpful for analyzing large quantities text but often are insufficient for contextual interpretations. We explore the groundbreaking integration of Large Language Models (LLMs) like GPT with these conventional techniques, highlighting this synergy through two real-world projects from distinct subject areas. This session offers a deep dive into the technicalities of using the GPT API in practice, comparing traditional text analysis methods with LLMs, various technological and methodological challenges, and work done to validate findings. We also discuss feedback and limitations of this approach in two real world settings with subject matter experts from non-technical backgrounds. We suggest further research opportunities for statisticians and sociologists and emphasize how LLMs can enhance analysis of large text datasets.
Keywords:
Text analysis|Large language models| | | |
Sponsors:
Section on Text Analysis
Tracks:
Miscellaneous
Can this be considered for alternate subtype?
No
Are you interested in volunteering to serve as a session chair?
No
I have read and understand that JSM participants must abide by the Participant Guidelines.
Yes
I understand that JSM participants must register and pay the appropriate registration fee by June 1, 2024. The registration fee is non-refundable.
I understand
You have unsaved changes.