APS
29th APS Annual Convention · 2017
The Effect of Behavioral Observability and Overall Impressions on Rater Agreement
- Anthony Paquin
Western Kentucky University - Patrick Sizemore
Automatic Data Processing - Sylvia Roch
University at Albany, State University of New York - John Bruni
Applied Research Analysis Group
Abstract
This study analyzed the effects of behavioral observability of items used to rate employee performance and overall impressions on rater agreement. Results indicated that rater agreement was negatively correlated with both item observability and difficulty. Ratings aligned more with overall impression for less observable but not more difficult items.
Judgment and Decision Making
