We present findings from an analysis of the Calculus Concept Inventory. Analysis of data from over 1500 students across four institutions indicates that there are deficiencies in the instrument. The analysis showed the data is consistent with a unidimensional model and does not have strong enough reliability for its intended use. This finding…

By far, the most frequently used method of validating (the interpretation and use of) automated essay scores has been to compare them with scores awarded by human raters. Although this practice is questionable, human-machine agreement is still often regarded as the "gold standard." Our objective was to refine this model and apply it to…