This article details an investigation into onscreen marking (OSM) in Hong Kong--where paper-based marking (PBM) is being phased out, to be completely superseded by OSM. It is a specific follow-up to a larger study (Coniam, 2009a) involving 30 raters who had previously rated English language essay scripts on screen in the 2007 Hong Kong Certificate…

This paper describes a study intended to demonstrate how an emerging skill, problem solving with technology, might be measured in the National Assessment of Educational Progress (NAEP). Two computer-delivered assessment scenarios were designed, one on solving science-related problems through electronic information search and the other on solving…

This study examined whether 19-month-old-infants' social understanding was related to their interaction behavior during dyadic cooperation with a peer. Toddlers' ability to predict others' action intentions was examined using a computerized experimental task. The children watched a series of stimulus movies in which an actor expressed her liking…

This study examined the results of an institutional survey conducted by the Annual Giving Office at a large public university in the Midwest. Overall, 2,273 young alumni participated in an online survey that assessed personal and institutional factors related to an alumna's willingness to make donations to the university. The results of the study…

Commercial, nonthermal processing of food, such as high hydrostatic-pressure processing (HPP), has increased. The safety and quality of foods produced by HPP has not been well communicated to the public. An online, nationwide consumer survey was implemented to assess awareness of alternative food processing technologies, consumer food safety…

This study examined the use of automatic speech recognition (ASR) scored elicited oral response (EOR) tests to assess the speaking ability of English language learners. It also examined the relationship between ASR-scored EOR and other language proficiency measures and the ability of the ASR to rate speakers without bias to gender or native…

Although providing feedback is commonly practiced in education, there is no general agreement regarding what type of feedback is most helpful and why it is helpful. This study examined the relationship between various types of feedback, potential internal mediators, and the likelihood of implementing feedback. Five main predictions were developed…

Educational researchers have "rarely" addressed the problem of how to provide feedback on constructed responses. All participants (N = 76) read a story and completed short-answer questions based on the text, with some receiving feedback consisting of the exact material on which the questions were based. During feedback, two groups receiving…

This study investigates the validity of a newly developed computerized cognitive assessment system (CCAS) that is equipped with rich multimedia to generate simulated testing situations and considers both test item difficulty and the test taker's ability. It is also hypothesized that better predictive validity of the CCAS in self-care of persons…

The rapid development of computer and network technologies has attracted researchers to investigate strategies for and the effects of applying information technologies in learning activities; simultaneously, learning environments have been developed to record the learning portfolios of students seeking web information for problem-solving. Although…

The principal aims of this study, a conceptual replication of an earlier investigation of the TOEFL[R] computer-based test, or TOEFL CBT, in Buenos Aires, Cairo, and Frankfurt, were to assess test takers' reported acceptance of the TOEFL Internet-based test, or TOEFL iBT[TM], and its associations with possible determinants of this acceptance and…

This paper describes a study comparing paper-based marking (PBM) and onscreen marking (OSM) in Hong Kong utilising English language essay scripts drawn from the live 2007 Hong Kong Certificate of Education Examination (HKCEE) Year 11 English Language Writing Paper. In the study, 30 raters from the 2007 HKCEE Writing Paper marked on paper 100…

Business schools are often criticized for the inadequate writing skills of their graduates. Improving writing skills involves first understanding the current skill level of students. This research attempts to provide insights into the effectiveness of the current method of assessing writing skills in a school of business at a large regional…

This dissertation provides an automated scoring method of speech fluency for second language learners of English (L2 learners) based that uses speech recognition technology. Non-standard pronunciation, frequent disfluencies, faulty grammar, and inappropriate lexical choices are crucial characteristics of L2 learners' speech. Due to the ease of…

The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a…