The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

The idea that multiple measures should be used when evaluating teachers is widely accepted. Multiple measures are important not only because education has multiple goals, but because each measure is an imperfect indicator of any given goal. For a variety of reasons, states and districts use multiple measures in one particular way: to make…

The scoring instrument described in this article is based on a deconstruction of the seven sections of an American Psychological Association (APA)-style empirical research report into a set of learning outcomes divided into content-, expression-, and format-related categories. A double-weighting scheme used to score the report yields a final grade…

Early childhood educators play a critical role in preparing students for success later in their school experience. The instructional techniques, emotional supports, and assessment approaches for early childhood settings are different from classroom settings in later grades. How can states and districts develop evaluation systems that are tuned to…

Purpose: The paper's aim is to propose a core journal decision method, called the local impact factor (LIF), which can evaluate the requirements of the local user community by combining both the access rate and the weighted impact factor, and by tracking citation information on the local users' articles. Design/methodology/approach: Many…

The Student Outcomes Survey is an annual national survey of vocational education and training (VET) students. Since 1995, participants have been asked to rate their satisfaction with different aspects of their training, grouped under three main themes: teaching, assessment, and generic skills and learning experiences. While the composition of the…

A generic approach in automated essay scoring produces scores that have the same meaning across all prompts, existing or new, of a writing assessment. This is accomplished by using a single set of linguistic indicators (or features), a consistent way of combining and weighting these features into essay scores, and a focus on features that are not…

The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

The debate around which factors drive medical students' learning is ongoing and controversial. What is the influence of an assessment's weighting on the motivation of students to study the particular subject? One medical school in London is in a unique position to investigate this question. At our institution, the weighting of Anatomy within the…

Despite favorable psychometric properties, the Generalized Anxiety Disorder Questionnaire for the "Diagnostic and Statistical Manual of Mental Disorders" (4th ed.) (GAD-Q-IV) does not have a known factor structure, which calls into question use of its original weighted scoring system (usually referred to as the dimensional score).…

What are the advantages and disadvantages of weighted grading? The primary purpose of weighted grading has been to encourage high school students to take more rigorous courses. This effort is then acknowledged by more weight being given to the grade for a specified class. There are numerous systems of weighted grading cited in the literature from…

A faculty evaluation system that classified performance factors within a hierarchy and weights each, producing a final composite set for each faculty member, is explained and illustrated. The process is recommended for more objective and consistent decision-making about faculty tenure. (MSE)

Use of student self-evaluation in grading is recommended, and several ways in which self-evaluation may be incorporated into the grading process are described, including grades justified and moderated by faculty and/or peers, criteria generated by peers, weighting, combining self-evaluation with demonstration of competence, and learning and grade…

Three principal uses of composite variables in the Title I Evaluation and Reporting System (TIERS) are examined in light of four basic methodological issues: (1) the criterion used in constructing the composite; (2) the likely reliability of both component and criterion variables; (3) the form of the relationship between components and criterion;…