This article addresses two unsolved measurement issues in dynamic problem solving (DPS) research: (a) unsystematic construction of DPS tests making a comparison of results obtained in different studies difficult and (b) use of time-intensive single tasks leading to severe reliability problems. To solve these issues, the MicroDYN approach is…

There is overwhelming evidence of genetic influence on cognition. The effect is seen in general cognitive ability, as well as in specific cognitive domains. A conventional assessment approach using face-to-face paper and pencil testing is difficult for large-scale studies. Computerized neurocognitive testing is a suitable alternative. A total of…

[Slides] presented at the annual conference of the National Council on Measurement in Education, 2011, New Orleans.

The goal of the current study was to introduce a new stopping rule for computerized adaptive testing (CAT). The predicted standard error reduction (PSER) stopping rule uses the predictive posterior variance to determine the reduction in standard error that would result from the administration of additional items. The performance of the PSER was…

e-Learning plays an undoubtedly important role in today's education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student's knowledge regarding the concepts related to learning objectives. In this paper, a new method for assessing the free text answers of…

The Association for the Advancement of Computing in Education (AACE) is an international, non-profit educational organization. The Association's purpose is to advance the knowledge, theory, and quality of teaching and learning at all levels with information technology. The "EdMedia + Innovate Learning" conference took place in New York,…

Inspection of thousands of student responses to computer-marked assessment questions has brought insight into the errors made by adult distance learners of science. Most of the questions analysed were in summative use and required students to construct their own response. Both of these things increased confidence in the reliability of the…

The synthesis of digital circuits is a basic skill in all the bachelor programmes around the ICT area of knowledge, such as Computer Science, Telecommunication Engineering or Electrical Engineering. An important hindrance in the learning process of this skill is that the existing educational tools for the design of circuits do not allow the…

This study investigates the use of pragmatic markers (PMs) by learners of English at varying proficiency levels. The study analyzes data from a university-level oral proficiency exam that categorized Chinese and Korean English-as-a-second-language (ESL) speakers into four proficiency levels and compares data with those of native speakers taking…

The present research examined the extent to which pre-college characteristics, high school experiences, college expectations, and initial enrollment characteristics were related to graduation from college. Data from admission applications, the "ACT Compass" survey, and initial enrollment measures for Fall 2004 and Fall 2005 first-time…

Item response theory (IRT) becomes an increasingly important tool when analyzing "big data" gathered from online educational venues. However, the mechanism was originally developed in traditional exam settings, and several of its assumptions are infringed upon when deployed in the online realm. For a large-enrollment physics course for…

A major concern with computer-based (CB) tests of second-language (L2) writing is that performance on such tests may be influenced by test-taker keyboarding skills. Poor keyboarding skills may force test-takers to focus their attention and cognitive resources on motor activities (i.e., keyboarding) and, consequently, other processes and aspects of…

In this study we compare test takers' performance on the Speaking section of the TOEFL iBT™and their performances during their real-life academic studies. Thirty international graduate students from mixed language backgrounds in two different disciplines (Sciences and Social Sciences) responded to two independent and four integrated speaking tasks…

With 97 learners in an advanced Spanish course, the study examines the effects of textual enhancement adjuncts, prior subject knowledge, first language (L1) reading ability, and second language (L2) Spanish proficiency on L2 comprehension of scientific passages. Readings included two texts with two types of embedded questions: a pause or written…

Teacher cognition is seen as an important factor for the quality of instruction and, accordingly, student learning of a subject. However, in-depth research on these relations can only be done if a sound theoretical model for subject-specific teacher cognition (knowledge and competence/practical skills) and corresponding measures are available.…