The purpose of this study is to describe and evaluate a multilingual automated essay scoring (AES) system for grading essays in three languages. Two different sentence embedding models were evaluated within the AES system, multilingual BERT (mBERT) and language-agnostic BERT sentence embedding (LaBSE). German, Italian, and Czech essays were…

Background: Meta-analyses of educational interventions have consistently documented the importance of methodological factors related to the choice of outcome measures. In particular, when interventions are evaluated using measures developed by researchers involved with the intervention or its evaluation, the effect sizes tend to be larger than…

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed…

The original SOCO Scale was reduced to 10 items by Thomas, Soutar, and Ryan (2001). The author conducted a pretest and a posttest in his Personal Selling class during the Fall 2009 semester. Significant differences by gender, student sales experience and family member in the sales field were identified. The author once again pretested the…

Administered seven instruments measuring college students' (N=253) perceptions and expectations of counseling. Used factor analysis to identify six interpretable factors, three for perceptions and three for expectations with no overlap between perceptions and expectations. Recommends further research into effects of gender, age, race, culture,…

This study measured test-retest reliabilities and interrelationships of four common measures of lateral dominance: dowel balancing, peg placement, grip strength, and conjugate lateral eye movement. Moderate reliabilities for all measures except grip strength were obtained. Subjects' sex may be an important reliability variable. Correlations among…

Correlations among measures of college outcomes were examined using 118 college students. Instruments studied were the College Outcome Measures Program; the Educational Testing Service Academic Profile; the Defining Issues Test; and the author-developed Sophomore Assessment Project Questionnaire. Commonly used measures tap similar outcome…

The development, preliminary assessment, and uses of two paper-and-pencil measures of dyadic perspective-taking are described. A literature review revealed 23 perspective-taking type items each for the Self Dyadic Perspective-Taking Scale and the Other Dyadic Perspective-Taking Scale. Results for 277 college students indicate that the tests are…

Validity of 3 scales of the Minnesota Multiphasic Personality Inventory (MMPI), the F, back F, and variable response inconsistency, for detecting self-reported partially random responding was supported by 3 studies involving 195 college students and 68 community participants but not by a study with 32 police job applicants. (SLD)

Investigated the extent to which the Personality Attributes Questionnaire and the Bem Sex Role Inventory assigned the same individuals to identical sex-role categories. Less than 55 percent of the subjects were assigned to identical categories. Suggests care must be taken when comparing results of studies that employ different instruments. (Author)

Examined 13 career subscales contained in 4 measures of career indecision to determine how different measures relate to one another and how many dimensions may exist across these different instruments using 122 college student subjects. Factor analysis yielded a 3-factor solution accounting for 55.9 percent of the variance. (Author/ABL)

Two experiments with approximately 377 newly enlisted Air Force personnel and 182 college students investigated the validity of a reading span test combining a knowledge verification task with a word memorization task. Results support the hypothesis that word recall reflects the amount of working memory functional in reading. (SLD)

Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment…