Summit
2024 APS Global Psychological Science Summit · 2024
Coding Automation in Narrative-Identity Research: Human Versus AI Coding of Self-Defining Memory Constructs
- Chloe Collins
Whitman College - Pavel Blagov
Whitman College - Kathryn Oost
Whitman College - Maggie O'Connor
Whitman College
Abstract
We compared pretrained large language model vs. human-generated quantitative coding for 8 narrative-identity variables in 1000 self-defining memories (100 participants). Cross-method reliability was fair-to-substantial (percent agreement; nested concordance coefficients). RV coefficients suggested comparable validity against external variables. Cost-efficiency favored A.I. Both coding methods yielded errors, whose differences are discussed.
Memory