The objective was to verify the construct validity and test-retest reliability of the Test of Advanced Movement Skills (TAMS) with an innovative dual-outcome scoring system. Three statistical approaches--confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), and item response theory analysis (IRT)--were applied to the…

The goal of this research which was carried out in reputable dedicated call centres within the Turkish telecommunication sector aims is to evaluate competence-based curriculums designed by means of internal funding through Stufflebeam's context, input, process, product (CIPP) model. In the research, a general scanning pattern in the scope of…

This report summarizes an empirical study that addresses two related topics within the context of writing assessment--illusory halo and how much unique information is provided by multiple analytic scores. Specifically, we address the issue of whether unique information is provided by analytic scores assigned to student writing, beyond what is…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Placement and screening tests serve important functions, not only with regard to placing learners at appropriate levels of language courses but also with a view to maximizing the effectiveness of administering test batteries. We examined two widely reported formats suitable for these purposes, the discrete decontextualized Yes/No vocabulary test…

This study investigates the ways in which medical students' achievement goal orientations (AGO) affect their perceptions of learning and actual learning from an online problem-based learning environment, Calibrated Peer Review™. First, the tenability of a four-factor model (Elliot & McGregor, 2001) of AGO was tested with data collected from…

The paper develops a two-stage robust procedure for structural equation modeling (SEM) and an R package "rsem" to facilitate the use of the procedure by applied researchers. In the first stage, M-estimates of the saturated mean vector and covariance matrix of all variables are obtained. Those corresponding to the substantive variables…

This study investigated the longitudinal relation between children's theory of mind and their metacognitive knowledge with a special focus on the impact of language on this relation. Measures of theory-of-mind understanding and metamemory knowledge were assessed in 133 3-year-old children at 4 measurement points separated by half-year intervals.…

Lengthy scales or testlets pose certain challenges for structural equation modeling (SEM) if all the items are included as indicators of a latent construct. Three general approaches to modeling lengthy scales in SEM (parceling, latent scoring, and shortening) have been reviewed and evaluated. A hypothetical population model is simulated containing…

In this study I examine the construct of aptitude in learning Chinese as a second language (L2) to an advanced level. I test 2 hypotheses: first, that L2 aptitude comprises 4 components--working memory, rote memory, grammatical sensitivity, and phonemic coding ability--and second, that L2 aptitude affects learning both directly and indirectly…

Motivated by cognitive theories of graph comprehension, this study systematically manipulated characteristics of a line graph description task in a speaking test in ways to mitigate the influence of graph familiarity, a potential source of construct-irrelevant variance. It extends Xi (2005), which found that the differences in holistic scores on…

One major challenge in using group projects to assess student learning is accounting for the differences of contribution among group members so that the mark assigned to each individual actually reflects their performance. This research addresses the validity of grading group projects by evaluating different methods that derive individualized…

The assessment of writing ability is notoriously difficult. Different facets of the assessment seem to influence its outcome. Besides the writer's writing proficiency, the topic of the assignment, the features or traits scored (e.g., content or language use) and even the way in which these traits are scored (e.g., holistically or analytically)…

This article updates information about the Torrance Tests of Creative Thinking (TTCT) by reporting on predictive validity data from the most recent data collection point in Torrance's longitudinal studies. First, we outline the background of the tests and changes in scoring over the years. Then, we detail the results of the analyses of the 40-year…

For the thirtieth year, the Research and Theory Division of the Association for Educational Communications and Technology (AECT) is sponsoring the publication of these Proceedings. Papers published in this volume were presented at the National AECT Convention in Anaheim, California. The Proceedings of AECT's Convention are published in two…