Tests of statistical significance often play a decisive role in establishing the empirical warrant of evidence-based research in education. The results from pattern-based assessment items, as introduced in this paper, are categorical and multimodal and do not immediately support the use of measures of central tendency as typically related to…

This paper presents a non-parametric imputation technique, named random forest, from the machine learning field. The random forest procedure has two main tuning parameters: the number of trees grown in the prediction and the number of predictors used. Fifty experimental conditions were created in the imputation procedure, with different…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

Prior research indicates that the frequency with which students participate in classroom discussion is positively related to learning. This study examines students' perceptions of the relationship between their class discussion participation and learning and between preparation and both comfort with participating and actual discussion…

The aim of this study is to make a new classification regarding the fact that the current classifications may change constantly because of values? gaining a different dimension and importance every single day. In this research descriptive research, which was used frequently in qualitative research methods, was preferred. This research was…

Living in an era of test-based accountability systems, how do we hold accountability tests accountable? Many accountability decisions made today are based on the assumption that test scores successfully reflect the effect of instruction. However, only instructionally sensitive assessments, not the instructionally insensitive ones, reflect the…

The ability to purposefully access, reflect, and use evidence from educational research (Educational Research Literacy) is expected of future professionals in educational practice. Based on the presented conceptual framework, a test instrument was developed to assess the different competency aspects: Information Literacy, Statistical Literacy, and…

A common question in test evaluation is whether an a priori assignment of items to subtests is supported by empirical data. If the analysis results indicate the assignment of items to subtests under study is not supported by data, the assignment is often adjusted. In this study the authors compare two methods on the quality of their suggestions to…

Compared selected methods of assessing the structure of tests with dichotomous items using real data from a 62-item test of reading ability and computer-generated data for multiple unidimensional and multidimensional cases. All methods performed reasonably well over a relatively wide range of conditions. (SLD)

This study explored the impact of individual versus two-person group testing on graduate students' achievement and motivation to learn while enrolled in a 16-lesson educational research methods course. Students in two sections of the course were exposed to the same content and instructional methods, with one exception: students in one section took…

Using simulated and real data, this study compares the performance of three methodologies for assessing unidimensionality: (1) DIMTEST; (2) the approach of Holland and Rosenbaum; and (3) nonlinear factor analysis. All three models correctly confirm unidimensionality, but they differ in their ability to detect the lack of unidimensionality.…

The usefulness of a two-step version of the Mantel Haenszel procedure for distinguishing between differential item functioning (DIF) and item impact was studied by comparing the single-step and two-step procedures using a simulated data set. Results show changes in the identification rate for the two-step methods. (SLD)

A study was conducted to compare the psychometric qualities of two forms of an identical survey: one administered in a paper-and-pencil format and the other administered in Web format. The survey addressed the topic of college course anxiety and used to survey a sample of 236 undergraduate students. The psychometric qualities investigated included…

Rasch between and total weighted and unweighted fit statistics were compared using varying test lengths and sample sizes. Two test lengths (20 and 50 items) and three sample sizes (150, 500, and 1,000 were crossed. Each of the six combinations were replicated 100 times. In addition, power comparisons were made. Results indicated that there were no…

The comparison of item response theory models for the Test of English as a Foreign Language (TOEFL) was extended to an equating context as simulation trials were used to "equate the test to itself." Equating sample data were generated from administration of identical item sets. Equatings that used procedures based on each model (simple…