Reliability Estimates of Categorical Scale Items: Are Classical Testing Methods 'too Wrong' to be Useful?

When estimating categorical scale item reliability, IRT methods may be more appropriate than CTT methods. However, little is known regarding the utility of CTT versus IRT reliability estimates of the same data. Results of this research indicate CTT methods may be more biased, with a tendency to underestimate population reliability.