In the Eye of the Beholder: Does Confirmation Bias Influence Ratings of Writing Samples Perceived As AI or Student Generated?

Poster Session VI

Saturday May 24, 2025 (10:30 - 11:30 ET)
Keyword: Decision Making

Abstract: Participant ratings of paragraphs labeled as AI-generated or undergraduate student-written differed based on author labeling. Participants also classified a paragraph as AI-generated or student-written. Justifications mentioned were creativity and commitment if student-written, and word choice and grammar if AI-generated. Bias appeared in both faculty and student judgements of writing samples.