In the Eye of the Beholder: Does Confirmation Bias Influence Ratings of Writing Samples Perceived As AI or Student Generated?

Participant ratings of paragraphs labeled as AI-generated or undergraduate student-written differed based on author labeling. Participants also classified a paragraph as AI-generated or student-written. Justifications mentioned were creativity and commitment if student-written, and word choice and grammar if AI-generated. Bias appeared in both faculty and student judgements of writing samples.