ERIC Number: ED614463
Record Type: Non-Journal
Publication Date: 2012
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-
EISSN: N/A
Available Date: N/A
Improving Construct Validity Yields Better Models of Systematic Inquiry, Even with Less Information
Sao Pedro, Michael A.; Baker, Ryan S. J. d.; Gobert, Janice D.
Grantee Submission, Paper presented at the International Conference on User Modeling, Adaptation and Personalization (UMAP) (20th, Montreal, Canada, 2012)
Data-mined models often achieve good predictive power, but sometimes at the cost of interpretability. We investigate here if selecting features to increase a model's construct validity and interpretability also can improve the model's ability to predict the desired constructs. We do this by taking existing models and reducing the feature set to increase construct validity. We then compare the existing and new models on their predictive capabilities within a held-out test set in two ways. First, we analyze the models' overall predictive performance. Second, we determine how much student interaction data is necessary to make accurate predictions. We find that these reduced models with higher construct validity not only achieve better agreement overall, but also achieve better prediction with less data. This work is conducted in the context of developing models to assess students' inquiry skill at designing controlled experiments and testing stated hypotheses within a science inquiry microworld.
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Location: Massachusetts
IES Funded: Yes
Grant or Contract Numbers: R305A090170; DRL0733286; DRL1008649; DGE0742503
Author Affiliations: N/A