Pushing the Limits for Judgmental Consistency: Comparing Random Weighting Schemes with Expert Judgments

Expert judgment may be outperformed by algorithmic methods of judgment due to inconsistency in combining information. To test this, expert judgment in individual employment assessments are compared to random-but-consistent, and completely random weighting. On average, the validity of expert judgment approximates completely random, and outperformed by random-but-consistent weights.