This study explores correlations between human ratings of essay quality and component scores based on similar natural language processing indices and weighted through a principal component analysis. The results demonstrate that such component scores show small to large effects with human ratings and thus may be suitable to providing both summative and formative feedback in an automatic writing evaluation systems such as those found in Writing-Pal. [This paper was published in: "Proceedings of the Twenty-Seventh International Florida Artificial Intelligence Research Society Conference" (p.381-386). Association for the Advancement of Artificial Intelligence, 2014.]