Chinmay Kulkarni
Michael S. Bernstein
Scott R. Klemmer
ABSTRACT
Massive online classes are global and diverse. How can we harness this diversity to improve engagement and learning? Currently, though enrollments are high, students' interactions with each other are minimal: most are alone together. This isolation is particularly disappointing given that a global community is a major draw of online classes. This paper illustrates the potential of leveraging geographic diversity in massive online classes. We connect students from around the world through small-group video discussions. Our peer discussion system, Talkabout, has connected over 5,000 students in fourteen online classes. Three studies with 2,670 students from two classes found that globally diverse discussions boost student performance and engagement: the more geographically diverse the discussion group, the better the students performed on later quizzes. Through this work, we challenge the view that online classes are useful only when in-person classes are unavailable. Instead, we demonstrate how diverse online classrooms can create benefits that are largely unavailable in a traditional classroom.
Supplemental Material
Available for Download
zip
cscwf0237-file4.zip (167.8 KB)
Auxiliary material contains appendices: Transcript of a student discussion, and the assessment materials used in studies.
- Anderson, A. et al. Engaging with massive online courses. (2014), 687--698. Google Scholar
Digital Library
- Aronson, E. and Bridgeman, D. Jigsaw groups and the desegregated classroom: In pursuit of common goals. In Readings About The Social Animal. Worth Publishers, 2004, 532.Google Scholar
- Bos, N. et al. Effects of four computer-mediated communications channels on trust development. Proc CHI: ACM conference on Human factors in computing systems, ACM Press (2002). Google ScholarDigital Library
- Braskamp, L.A. et al. Assessing Progress in Global Learning and Development of Students with Education Abroad Experiences. Frontiers: The Interdisciplinary Journal of Study Abroad 18, (2008), 101--118.Google ScholarCross Ref
- Breslow, L.B. et al. Studying learning in the worldwide classroom: Research into edXfis first MOOC. Research & Practice in Assessment 8, (2013), 13--25.Google Scholar
- Brookfield, S.D. and Preskill, S. Discussion as a Way of Teaching: Tools and Techniques for Democratic Classrooms. John Wiley & Sons, 2012.Google Scholar
- Clementi, F. and Mauro Gallegati. Econophysics of Wealth Distributions. In Chatterjee, A. et al., eds., Econophysics of Wealth Distributions. Springer Milan, Milano, 2005.Google Scholar
- Coetzee, D. et al. Chatrooms in MOOCs: all talk and no action. Proc. of the ACM conference on Learning @ scale, ACM Press (2014), 127--136. Google ScholarDigital Library
- Coser, R.L. The Complexity of Roles as a Seedbed of Individual Autonomy. In The Idea of Social Structure: Essays in Honor of Robert Merton. New York, New York, USA, 1975.Google Scholar
- Crouch, C.H. and Mazur, E. Peer Instruction: Ten years of experience and results. American Journal of Physics 69, 9 (2001), 970.Google ScholarCross Ref
- Daft, R.L. and Lengel, R.H. Organizational Information Requirements, Media Richness and Structural Design. Management Science 32, 5 (1986), 554--571. Google ScholarDigital Library
- Desai, M. Human development: Concepts and measurement. European Economic Review 35, 2--3 (1991), 350--357.Google Scholar
- DeSanctis, G. et al. Learning in Online Forums. European Management Journal 21, 5 (2003), 565--577.Google Scholar
- Dillenbourg, P. Over-scripting CSCL: The risks of blending collaborative learning with instructional design. Three worlds of CSCL. Can we support CSCL, (2002), 61--91.Google Scholar
- Freedman, J. MOOCs Are Usefully Middlebrow. The Chronicle of Higher Education. http://chronicle.com/article/MOOCs-Are-Usefully-Middlebrow/143183/.Google Scholar
- Goesling, B. Changing Income Inequalities within and between Nations: New Evidence. American Sociological Review 66, 5 (2001), 745--761.Google Scholar
- Green, E.G.T. Variation of Individualism and Collectivism within and between 20 Countries: A Typological Analysis. Journal of Cross-Cultural Psychology 36, 3 (2005), 321--339.Google ScholarCross Ref
- Group, W.B. World Development Indicators 2012. World Bank Publications, 2012.Google Scholar
- Gurin, P. et al. Diversity and higher education: Theory and impact on educational outcomes. .Google Scholar
- Guzzetti, B.J. and Others, A. Promoting Conceptual Change in Science: A Comparative Meta-Analysis of Instructional Interventions from Reading Education and Science Education. Reading Research Quarterly 28, 2 (1992), 116--59.Google Scholar
- Hambrick, D.C. et al. When Groups Consist of Multiple Nationalities: Towards a New Understanding of the Implications. Organization Studies 19, 2 (1998), 181--205.Google ScholarCross Ref
- Heine, S.J. Cultural Psychology. WW Norton, 2008.Google Scholar
- Hewstone, M. Intergroup contact: Panacea for prejudice- Psychologist, 2003, 352--355. http://www.psy.ox.ac.uk/publications/28661.Google Scholar
- Ho, A.D. et al. HarvardX and MITx: The First Year of Open Online Courses, Fall 2012-Summer 2013. SSRN Electronic Journal, (2014).Google Scholar
- Hollan, J. and Stornetta, S. Beyond being there. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92, ACM Press (1992), 119--125. Google ScholarDigital Library
- Hurtado, S. et al. The Climate for Diversity: Key Issues for Institutional Self-Study. New Directions for Institutional Research 1998, 98 (1998), 53--63.Google ScholarCross Ref
- Hurtado, S. et al. Enacting Diverse Learning Environments: Improving the Climate for Racial/Ethnic Diversity in Higher Education. ASHE-ERIC Higher Education Report, Vol. 26, No. 8. (1998).Google Scholar
- Jacobs, A.J. Grading the MOOC University. The New York Times, 2013.Google Scholar
- Joinson, A.N. Knowing Me, Knowing You: Reciprocal Self-Disclosure in Internet-Based Surveys. CyberPsychology & Behavior 4, 5 (2001).Google Scholar
- Konstan, J.A. et al. Teaching recommender systems at large scale. Proc of the ACM conference on Learning @ scale conference, ACM Press (2014). Google ScholarDigital Library
- Kucsera, J. and Orfield, G. New York State's Extreme School Segregation: Inequality, Inaction and a Damaged Future. 2014.Google Scholar
- Kulkarni, C. et al. Peer and self assessment in massive online classes. ACM Transactions on Computer-Human Interaction (TOCHI) 20, 6 (2013), 33. Google ScholarDigital Library
- Lin, X. and Schwartz, D.L. Reflection at the Crossroads of Cultures. Mind, Culture, and Activity 10, 1 (2003).Google Scholar
- Losh, E. The War on Learning: Gaining Ground in the Digital University. MIT Press, 2014.Google ScholarCross Ref
- Mark, G. et al. Meeting at the Desktop: An Empirical Study of Virtually Collocated Teams. ECSCW, Kluwer Academic Publishers (1999). Google ScholarDigital Library
- Markus, H. and Kitayama, S. Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review 98, 2 (1991), 224--253.Google ScholarCross Ref
- Marmot, M. Social determinants of health inequalities. Lancet 365, 9464 (2005), 1099--104.Google ScholarCross Ref
- Mazur, E. Farewell, lecture Science (New York, N.Y.) 323, 5910 (2009), 50--1.Google Scholar
- Nemeth, C.J. Differential contributions of majority and minority influence. Psychological Review 93, 1986.Google Scholar
- Nguyen, M. et al. Comparing online and offline self-disclosure: a systematic review. Cyberpsychology, behavior and social networking 15, 2 (2012).Google Scholar
- Nora, A. and Cabrera, A.F. The Role of Perceptions in Prejudice and Discrimination and the Adjustment of Minority Students to College. Journal of Higher Education 67, 2 (1995), 119--48.Google Scholar
- O'Donnell, A.M. and Dansereau, D.F. Scripted cooperation in student dyads: A method for analyzing and enhancing academic learning and performance. In Interaction in cooperative groups: The theoretical anatomy of group learning. Cambridge University Press, Cambridge, UK, 1995, 120--141.Google Scholar
- Ogbu, J.U. Understanding Cultural Diversity and Learning. Educational Researcher 21, 8 (1992), 5--14.Google ScholarCross Ref
- Olds, K. Mapping Coursera's Global Footprint. Inside Higher Ed, 2013. http://www.insidehighered.com/blogs/globalhighered/mapping-courseras-global-footprint.Google Scholar
- Papadopoulos, K. et al. Community TAs scale high-touch learning, provide student-staff brokering, and build esprit de corps. Proceedings of the first ACM conference on Learning @ scale conference - L@S '14, ACM Press (2014), 163--164. Google ScholarDigital Library
- Parker, W.C. Classroom Discussion: Models for Leading Seminars and Deliberations. Social Education 65, 2 (2000), 111--15.Google Scholar
- Pettigrew, T.F. Intergroup contact theory. Annual review of psychology 49, (1998), 65--85.Google Scholar
- Purdie, N. and Hattie, J. Cultural Differences in the Use of Strategies for Self-Regulated Learning. American Educational Research Journal 33, 4 (1996), 845--871.Google ScholarCross Ref
- Rocco, E. Trust breaks down in electronic contexts but can be repaired by some initial face-to-face contact. Proc of CHI: ACM Conf on Human Factors in Computing Systems, ACM Press (1998). Google ScholarDigital Library
- Saltarelli, A.J. Effects of belongingness and synchronicity on face-to-face and computer-mediated online cooperative pedagogy. (2012).Google Scholar
- Shenkar, S. and Oded, R. Clustering Countries on Attitudinal Dimensions: A Review and Synthesis. The Academy of Management Review 10, 3 (1985), 435--454.Google Scholar
- Short, J.E. et al. The Social Psychology of Telecommunications. Wiley, London, 1976.Google Scholar
- Star, S.L. and Griesemer, J.R. Institutional Ecology, 'Translations' and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907--39. Social Studies of Science 19, 3 (1989), 387--420.Google ScholarCross Ref
- Symons, C.S. and Johnson, B.T. The self-reference effect in memory: A meta-analysis. Psychological Bulletin 121, 3 (1997), 371--394.Google ScholarCross Ref
- Tomkin, J.H. and Charlevoix, D. Do professors matter? Proc. of the ACM conference on Learning @ scale, ACM Press (2014), 71--78. Google ScholarDigital Library
- Tudge, J. The everyday lives of young children. Cambridge University Press, Cambridge, UK, 2008.Google ScholarCross Ref
- Varnum, Michael EW Grossmann, I. et al. The origin of cultural differences in cognition the social orientation hypothesis. Current directions in psychological science 19, 1 (2010).Google Scholar
- Woolley, A.W. et al. Evidence for a collective intelligence factor in the performance of human groups. Science (New York, N.Y.) 330, 6004 (2010), 686--8.Google ScholarCross Ref
- World Values Survey (Wave 6). World Values Survey Association, 2014.Google Scholar
Index Terms
- Talkabout: Making Distance Matter with Small Groups in Massive Classes
Recommendations
Cognitive, metacognitive and motivational perspectives on preflection in self-regulated online learning
The results complement research on self-regulated learning in online learning environments.Findings indicate the benefits of directed preflective prompts for novice learners.Personalisation and adaptation of prompting in online learning is crucial for ...
Understanding the Effect of In-Video Prompting on Learners and Instructors
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsOnline instructional videos are ubiquitous, but it is difficult for instructors to gauge learners' experience and their level of comprehension or confusion regarding the lecture video. Moreover, learners watching the videos may become disengaged or fail ...
Supporting Peer Instruction with Evidence-Based Online Instructional Templates
L@S '16: Proceedings of the Third (2016) ACM Conference on Learning @ ScaleThis work examines whether templates designed from principles of multimedia learning design, and learning sciences research, can support peer instruction in creating more effective educational content on the web. Initial results show that the structure ...
Comments