The object of research is a statistics exam that contains problem tasks. One examiner performed two exam evaluation methods to repeatedly evaluate the exam. The goal was to compare the methods for objectivity. One of the two exam evaluation methods we call a serial evaluation method. The serial evaluation method assumes evaluation of all exam…

Today, talking about educational planning generates a certain vital importance for the achievement of the goals and objectives previously established, as well as the definition of the steps and means necessary to carry out this process. However, we cannot talk about planning without addressing the assessment process as an essential element to…

Simulated testing has become more prevalent in higher education, especially as competency-based institutions begin to incorporate micro-credentials and skills certificates into their curriculum. Competency-based assessment falls outside traditional norm-based testing practices used in K-12 education, and is largely focused on criterion referenced…

How can we test whether state-of-the-art generative models, such as Blender and GPT-3, are good AI teachers, capable of replying to a student in an educational dialogue? Designing an AI teacher test is challenging: although evaluation methods are much-needed, there is no off-the-shelf solution to measuring pedagogical ability. This paper reports…

A caring school community can enhance whole-school wellbeing including the wellbeing of school staff, which directly impacts on student academic, social and emotional wellbeing. This study firstly examines the validity and reliability of a proposed wholeschool staff wellbeing evaluation tool which uses a set of whole-school wellbeing indicators to…

In May 2016 an Invitational Symposium on the Reading for Understanding (RfU) Initiative was held in Alexandria, Virginia. Co-hosted by ETS and the Council of Chief State School Officers, the symposium brought together 160 state and local education leaders to examine the results of the RfU initiative. The goal of the U.S. Department of…

Measurement of children's behaviors in an educational and research context is a problematic and complex area. It is also evident that adapting scales to measure children's behaviors in an educational and research context is a complex process due to several reasons. First, cultural elements constitute a considerable problem. Second, it is difficult…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

We describe a system that automatically assembles test questions from a set of examples. Our system can create test questions appropriate for each user's level at low cost. In particular, when a user review their lesson, our system provides new test questions which are assembled based on their previous test results and past mistakes, rather than a…

The development and initial psychometric investigation of the Hocus Focus Analytics (HFA) scale, an instrument to measure student growth and outcomes using an arts-integrated teaching approach, is reported. A 15-item measure consisting of five subscales (cognitive, motor, communication, social skills and creativity) was developed to measure…

There is an identified and growing need for a levelled diagnostic basic facts assessment tool that provides teachers with formative information about students' mastery of a broad range of basic fact sets. The Individual Basic Facts Assessment tool has been iteratively and cumulatively developed, trialled, and refined with input from teachers and…

In the context of education and training, competency measurement (CM) is a central challenge in competency management. For complex CMs, a compromise must be addressed between the time available and the number of dimensions to be measured or the quality of the measurements. Increasing the efficiency of existing tests for CMs therefore poses a key…

Teacher cognition is seen as an important factor for the quality of instruction and, accordingly, student learning of a subject. However, in-depth research on these relations can only be done if a sound theoretical model for subject-specific teacher cognition (knowledge and competence/practical skills) and corresponding measures are available.…

Tasks are the most visible element in an educational assessment. Their purpose, however, is to provide evidence about targets of inference that cannot be directly seen at all: what examinees know and can do, more broadly conceived than can be observed in the context of any particular set of tasks. This paper concerns issues in an assessment design…

Modern test construction strategies in the areas of personality and psychopathology differ in the use of disguise within test stimulus material. Previous research on the validity of using disguised test item content has favored the rational strategy of test construction which views disguise as a liability under normal test-taking circumstances.…