Publication Date
In 2025 | 0 |
Since 2024 | 0 |
Since 2021 (last 5 years) | 10 |
Since 2016 (last 10 years) | 16 |
Since 2006 (last 20 years) | 42 |
Descriptor
Decision Making | 47 |
Evaluation Methods | 47 |
Task Analysis | 47 |
Comparative Analysis | 15 |
Foreign Countries | 9 |
Models | 9 |
Cognitive Processes | 8 |
Classification | 6 |
Correlation | 6 |
Second Language Learning | 6 |
Teaching Methods | 6 |
More ▼ |
Source
Author
Busemeyer, Jerome R. | 2 |
Chambers, Lucy | 2 |
Chavez, Michael | 2 |
Lee, Ji-Yeon | 2 |
Peterson, Bruce | 2 |
Reigeluth, Charles M. | 2 |
Abbasi, Mehdi | 1 |
Ahn, Woo-Young | 1 |
Arciuli, Joanne | 1 |
Averbeck, Bruno B. | 1 |
Azevedo, Roger | 1 |
More ▼ |
Publication Type
Education Level
Audience
Administrators | 1 |
Policymakers | 1 |
Researchers | 1 |
Location
United Kingdom (England) | 3 |
Europe | 2 |
Afghanistan | 1 |
California | 1 |
Colorado | 1 |
District of Columbia | 1 |
Germany | 1 |
Illinois | 1 |
Illinois (Chicago) | 1 |
Indonesia | 1 |
Iran | 1 |
More ▼ |
Laws, Policies, & Programs
Assessments and Surveys
Test of English for… | 1 |
What Works Clearinghouse Rating
Marchant, Nicolás; Quillien, Tadeg; Chaigneau, Sergio E. – Cognitive Science, 2023
The causal view of categories assumes that categories are represented by features and their causal relations. To study the effect of causal knowledge on categorization, researchers have used Bayesian causal models. Within that framework, categorization may be viewed as dependent on a likelihood computation (i.e., the likelihood of an exemplar with…
Descriptors: Classification, Bayesian Statistics, Causal Models, Evaluation Methods
Rissman, Lilia; van Putten, Saskia; Majid, Asifa – Cognitive Science, 2022
At conceptual and linguistic levels of cognition, events are said to be represented in terms of abstract categories, for example, the sentence "Jackie cut the bagel with a knife" encodes the categories Agent (i.e., "Jackie") and Patient (i.e., "the bagel"). In this paper, we ask whether entities such as "the…
Descriptors: Schemata (Cognition), Indo European Languages, English, German
Leech, Tony; Chambers, Lucy – Research Matters, 2022
Two of the central issues in comparative judgement (CJ), which are perhaps underexplored compared to questions of the method's reliability and technical quality, are "what processes do judges use to make their decisions" and "what features do they focus on when making their decisions?" This article discusses both, in the…
Descriptors: Comparative Analysis, Decision Making, Evaluators, Reliability
Saito, Kazuya; Macmillan, Konstantinos; Kachlicka, Magdalena; Kunihara, Takuya; Minematsu, Nobuaki – Studies in Second Language Acquisition, 2023
Whereas many scholars have emphasized the relative importance of "comprehensibility" as an ecologically valid goal for L2 speech training, testing, and development, eliciting listeners' judgments is time-consuming. Following calls for research on more efficient L2 speech rating methods in applied linguistics, and growing attention toward…
Descriptors: Second Language Learning, Second Language Instruction, Interrater Reliability, Speech Communication
Vidal Rodeiro, Carmen; Chambers, Lucy – Research Matters, 2022
Many high-stakes qualifications include non-exam assessments that are marked by teachers. Awarding bodies then apply a moderation process to bring the marking of these assessments to an agreed standard. Comparative Judgement (CJ) is a technique where two (or more) pieces of work are compared at a time, allowing an overall rank order of work to be…
Descriptors: Evaluation Methods, Portfolios (Background Materials), Decision Making, Task Analysis
Rieger, Tobias; Heilmann, Lydia; Manzey, Dietrich – Cognitive Research: Principles and Implications, 2021
Visual inspection of luggage using X-ray technology at airports is a time-sensitive task that is often supported by automated systems to increase performance and reduce workload. The present study evaluated how time pressure and automation support influence visual search behavior and performance in a simulated luggage screening task. Moreover, we…
Descriptors: Time Management, Travel, Air Transportation, Task Analysis
Marshall, Neil; Shaw, Kirsten; Hunter, Jodie; Jones, Ian – New Zealand Journal of Educational Studies, 2020
There is growing interest in using comparative judgement to assess student work as an alternative to traditional marking. Comparative judgement requires no rubrics and is instead grounded in experts making pairwise judgements about the relative 'quality' of students' work according to a high level criterion. The resulting decision data are fitted…
Descriptors: Comparative Analysis, Decision Making, Student Evaluation, Evaluation Methods
The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues
Tack, Anaïs; Piech, Chris – International Educational Data Mining Society, 2022
How can we test whether state-of-the-art generative models, such as Blender and GPT-3, are good AI teachers, capable of replying to a student in an educational dialogue? Designing an AI teacher test is challenging: although evaluation methods are much-needed, there is no off-the-shelf solution to measuring pedagogical ability. This paper reports…
Descriptors: Artificial Intelligence, Dialogs (Language), Bayesian Statistics, Decision Making
de Zubicaray, Greig I.; Arciuli, Joanne; Kearney, Elaine; Guenther, Frank; McMahon, Katie L. – Journal of Experimental Psychology: Learning, Memory, and Cognition, 2023
Grounded or embodied cognition research has employed body-object interaction (BOI; e.g., Pexman et al., 2019) ratings to investigate sensorimotor effects during language processing. We investigated relationships between BOI ratings and nonarbitrary statistical mappings between words' phonological forms and their syntactic category in English;…
Descriptors: Language Processing, Psychomotor Skills, English, Predictor Variables
The Inadequate Use of Confirmatory Factor Analysis in Second Language Acquisition Validation Studies
Vafaee, Payman; Kachinske, Ilina – Studies in Applied Linguistics & TESOL, 2019
The current study aims to demonstrate how the lack of a conceptual framework and the inadequate use of confirmatory factor analysis (CFA) in second language (L2) acquisition validation studies can lead to misconceptions about the nature of data collected via different measurement instruments. To this end, we reanalyzed data from three…
Descriptors: Factor Analysis, Misconceptions, Second Language Learning, Validity
Pang, Francine; Skehan, Peter – Modern Language Journal, 2021
This study uses a complexity-accuracy-lexis-fluency (CALF) framework to explore performance on 2 speaking tasks: a narrative picture-based task and an interactive decision-making task. A preliminary aim is to compare performance on the 2 tasks, using a wide range of CALF measures to explore where scores are similar and where they are different.…
Descriptors: Task Analysis, Speech Communication, Second Language Learning, Accuracy
Dony Marzuki – PASAA: Journal of Language Teaching and Learning in Thailand, 2023
This study investigated the effects of two types of classroom instructions on EFL learners' oral proficiency by implementing teachers' judgment. Two intact classes of EFL university students studied a compulsory subject of their department under two different types of classroom instruction. The first group of students was trained with explicit…
Descriptors: Language Proficiency, English (Second Language), Second Language Learning, Second Language Instruction
Eisenberg, Sarita L.; Guo, Ling-Yu – Language, Speech, and Hearing Services in Schools, 2018
Purpose: This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of…
Descriptors: Grammar, Construct Validity, Correlation, Preschool Children
Hein, Karin; Kauschke, Christina – Journal of Speech, Language, and Hearing Research, 2020
Purpose: From a psycholinguistic perspective, the quality of the stored word form in the phonological input lexicon, as well as its effective retrieval from the phonological output lexicon, is of great importance in lexical processing. This study aimed at gaining a deeper understanding of (a)typical word form processing in primary school children.…
Descriptors: Psycholinguistics, Language Processing, Linguistic Input, Elementary School Students
Kamali, Mojtaba; Abbasi, Mehdi; Sadighi, Firooz – International Journal of Education and Literacy Studies, 2018
This study investigated the effect of dynamic Assessment (DA) on the acquisition of L2 grammar by EFL learners. The focus was on teaching Conditional Type II, or Unreal Conditional, which is a difficult structure for language learners to acquire. To this end, two intact classes of intermediate EFL learners, each consisting of 23 male students were…
Descriptors: Foreign Countries, English (Second Language), Second Language Learning, Second Language Instruction