In recent years, educators and students are increasingly employing online collaboration applications such as Google Docs[TM] and PBWorks[TM] for group projects and assignments. Yet, the effectiveness of these emerging technologies has not been rigorously examined. Anchoring upon and informed by the existing literature, two design characteristics--sociability and visibility, and two human characteristics--gender and age, are focused on, which are salient in online collaboration applications. A field experiment was conducted to examine the direct and moderating effects of design and human characteristics on learning outcomes. The research found that sociability improved process satisfaction and positive social environment while visibility enhanced academic performance and solution satisfaction of learners. Males had higher solution satisfaction while older learners had higher academic performance. Moderating effects were also found. Both theoretical and practical implications are drawn. In particular, a rubric for online collaboration application selection for academic performance is conceived. This study provides empirical support for online collaboration application effectiveness in education which will augur well for future adoption, use and evolution. (Contains 3 tables and 4 figures.)