Skip to main content

2016 | OriginalPaper | Buchkapitel

Designing Scalable and Sustainable Peer Interactions Online

verfasst von : Chinmay Kulkarni, Yasmine Kotturi, Michael S. Bernstein, Scott Klemmer

Erschienen in: Design Thinking Research

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

When students work with peers, they learn more actively, build richer knowledge structures, and connect material to their lives. However, not every peer learning experience online sees successful adoption. This chapter first introduces PeerStudio, an assessment platform that leverages the large number of students’ peers in online classes to enable rapid feedback on in-progress work. Students submit their draft, give rubric-based feedback on two peers’ drafts, and then receive peer feedback. Students can integrate the feedback and repeat this process as often as they desire. PeerStudio demonstrates how rapid feedback on in-progress work improves course outcomes. We then articulate and address three adoption and implementation challenges for peer learning platforms such as PeerStudio. First, peer interactions struggle to bootstrap critical mass. However, class incentives can signal importance and spur initial usage. Second, online classes have limited peer visibility and awareness, so students often feel alone even when surrounded by peers. We find that highlighting interdependence and strengthening norms can mitigate this issue. Third, teachers can readily access “big” aggregate data but not “thick” contextual data that helps build intuitions, so software should guide teachers’ scaffolding of peer interactions. We illustrate these challenges through studying 8500 students’ usage of PeerStudio and another peer learning platform: Talkabout. Efficacy is measured through sign-up and participation rates and the structure and duration of student interactions. This research demonstrates how large classes can leverage their scale to encourage mastery through rapid feedback and revision, and suggests secret ingredients to make such peer interactions sustainable at scale.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Anderson S, Rodin J (1989) Is bad news always bad?: cue and feedback effects on intrinsic motivation. J Appl Soc Psychol 19(6):449–467CrossRef Anderson S, Rodin J (1989) Is bad news always bad?: cue and feedback effects on intrinsic motivation. J Appl Soc Psychol 19(6):449–467CrossRef
Zurück zum Zitat Andrade HG (2001) The effects of instructional rubrics on learning to write. Current Issues Educ 4:4 Andrade HG (2001) The effects of instructional rubrics on learning to write. Current Issues Educ 4:4
Zurück zum Zitat Andrade HG (2005) Teaching with rubrics: the good, the bad, and the ugly. Coll Teach 53(1):27–31CrossRef Andrade HG (2005) Teaching with rubrics: the good, the bad, and the ugly. Coll Teach 53(1):27–31CrossRef
Zurück zum Zitat André P, Bernstein M, Luther K (2012) Who gives a tweet? In: Proceedings of the ACM 2012 conference on computer supported cooperative work—CSCW’12, ACM Press, p 471 André P, Bernstein M, Luther K (2012) Who gives a tweet? In: Proceedings of the ACM 2012 conference on computer supported cooperative work—CSCW’12, ACM Press, p 471
Zurück zum Zitat Bakshy E, Karrer B, Adamic LA (2009) Social influence and the diffusion of user-created content. In: Proceedings of the 10th ACM conference on electronic commerce, pp 325–334 Bakshy E, Karrer B, Adamic LA (2009) Social influence and the diffusion of user-created content. In: Proceedings of the 10th ACM conference on electronic commerce, pp 325–334
Zurück zum Zitat Balcazar FE, Hopkins BL, Suarez Y (1986) A critical, objective review of performance feedback. J Organ Behav Manag 7:2 Balcazar FE, Hopkins BL, Suarez Y (1986) A critical, objective review of performance feedback. J Organ Behav Manag 7:2
Zurück zum Zitat Bransford J, Brown A, Cocking R (2000) How people learn. The National Academies Press, Washington, DC Bransford J, Brown A, Cocking R (2000) How people learn. The National Academies Press, Washington, DC
Zurück zum Zitat Bransford J, Schwartz DL (1999) Rethinking transfer: a simple proposal with multiple implications. Rev Res Educ 24:61–100 Bransford J, Schwartz DL (1999) Rethinking transfer: a simple proposal with multiple implications. Rev Res Educ 24:61–100
Zurück zum Zitat Breslow L, Pritchard D, DeBoer J, Stump G, Ho A, Seaton D (2013) Studying learning in the worldwide classroom: Research into edX’s first MOOC Breslow L, Pritchard D, DeBoer J, Stump G, Ho A, Seaton D (2013) Studying learning in the worldwide classroom: Research into edX’s first MOOC
Zurück zum Zitat Brooks M, Basu S, Jacobs C, Vanderwende L (2014) Divide and correct: using clusters to grade short answers at scale. Learning at Scale Brooks M, Basu S, Jacobs C, Vanderwende L (2014) Divide and correct: using clusters to grade short answers at scale. Learning at Scale
Zurück zum Zitat Buxton B (2007) Sketching user experiences: getting the design right and the right design. Morgan Kaufmann, San Francisco Buxton B (2007) Sketching user experiences: getting the design right and the right design. Morgan Kaufmann, San Francisco
Zurück zum Zitat Cambre J, Kulkarni C, Bernstein MS, Klemmer SR (2014) Talkabout: small-group discussions in massive global classes. Learning@Scale Cambre J, Kulkarni C, Bernstein MS, Klemmer SR (2014) Talkabout: small-group discussions in massive global classes. Learning@Scale
Zurück zum Zitat Carlson PA, Berry FC (2003) Calibrated peer review and assessing learning outcomes. In: Frontiers in education conference Carlson PA, Berry FC (2003) Calibrated peer review and assessing learning outcomes. In: Frontiers in education conference
Zurück zum Zitat Chen M (2001) Design of a virtual auditorium. In: MULTIMEDIA’01 Proceedings of the ninth ACM international conference on multimedia, pp 19–28 Chen M (2001) Design of a virtual auditorium. In: MULTIMEDIA’01 Proceedings of the ninth ACM international conference on multimedia, pp 19–28
Zurück zum Zitat Cheng J, Adamic L, Dow P, Kleinberg J, Leskovec J (2014) Can cascades be predicted? In: Proceedings of the 23rd international conference on world wide web, pp 925–936 Cheng J, Adamic L, Dow P, Kleinberg J, Leskovec J (2014) Can cascades be predicted? In: Proceedings of the 23rd international conference on world wide web, pp 925–936
Zurück zum Zitat Cialdini R, Goldstein N (2004) Social influence: compliance and conformity. Annu Rev Psychol 55:591–621CrossRef Cialdini R, Goldstein N (2004) Social influence: compliance and conformity. Annu Rev Psychol 55:591–621CrossRef
Zurück zum Zitat Coetzee D, Fox A, Hearst MA, Hartmann B (2014) Chatrooms in MOOCs: all talk and no action. In: Proceeding of the ACM conference on learning @ scale, ACM Press, pp 127–136 Coetzee D, Fox A, Hearst MA, Hartmann B (2014) Chatrooms in MOOCs: all talk and no action. In: Proceeding of the ACM conference on learning @ scale, ACM Press, pp 127–136
Zurück zum Zitat Coetzee D, Lim S, Fox A, Hartmann B, Hearst MA (2015) Structuring interactions for large-scale synchronous peer learning. In: CSCW: ACM Conference on computer supported collaborative work Coetzee D, Lim S, Fox A, Hartmann B, Hearst MA (2015) Structuring interactions for large-scale synchronous peer learning. In: CSCW: ACM Conference on computer supported collaborative work
Zurück zum Zitat Crouch CH, Mazur E (2001) Peer instruction: ten years of experience and results. Am J Phys 69(9):970CrossRef Crouch CH, Mazur E (2001) Peer instruction: ten years of experience and results. Am J Phys 69(9):970CrossRef
Zurück zum Zitat Dawes RM (1979) The robust beauty of improper linear models in decision making. Am Psychol 34(7):571CrossRef Dawes RM (1979) The robust beauty of improper linear models in decision making. Am Psychol 34(7):571CrossRef
Zurück zum Zitat Dourish P, Bell G (2007) The infrastructure of experience and the experience of infrastructure: meaning and structure in everyday encounters with space. Environ Plan B Plan Des 34(3):414CrossRef Dourish P, Bell G (2007) The infrastructure of experience and the experience of infrastructure: meaning and structure in everyday encounters with space. Environ Plan B Plan Des 34(3):414CrossRef
Zurück zum Zitat Dourish P, Bellotti V (1992) Awareness and coordination in shared workspaces. In: Proceeding CSCW’92 Proceedings of the 1992 ACM conference on computer-supported cooperative work, pp 107–114 Dourish P, Bellotti V (1992) Awareness and coordination in shared workspaces. In: Proceeding CSCW’92 Proceedings of the 1992 ACM conference on computer-supported cooperative work, pp 107–114
Zurück zum Zitat Dow SP, Heddleston K, Klemmer SR (2009) The efficacy of prototyping under time constraints. In: Proceeding of the ACM conference on creativity and cognition, ACM Press, p 165 Dow SP, Heddleston K, Klemmer SR (2009) The efficacy of prototyping under time constraints. In: Proceeding of the ACM conference on creativity and cognition, ACM Press, p 165
Zurück zum Zitat Dow S, Fortuna J, Schwartz D, Altringer B, Klemmer S (2011) Prototyping dynamics: sharing multiple designs improves exploration, group rapport, and results. In: Proceedings of the 2011 annual conference on human factors in computing systems, pp 2807–2816 Dow S, Fortuna J, Schwartz D, Altringer B, Klemmer S (2011) Prototyping dynamics: sharing multiple designs improves exploration, group rapport, and results. In: Proceedings of the 2011 annual conference on human factors in computing systems, pp 2807–2816
Zurück zum Zitat Erickson T, Kellogg W (2000) Social translucence: an approach to designing systems that support social processes. In: ACM Transactions on Computer-Human Interaction (TOCHI)—Special issue on human-computer interaction in the new millennium, Part 1 7(1), pp 59–83 Erickson T, Kellogg W (2000) Social translucence: an approach to designing systems that support social processes. In: ACM Transactions on Computer-Human Interaction (TOCHI)—Special issue on human-computer interaction in the new millennium, Part 1 7(1), pp 59–83
Zurück zum Zitat Ericsson KA, Krampe RT, Tesch-Römer C (1993) The role of deliberate practice in the acquisition of expert performance. Psychol Rev 100:3CrossRef Ericsson KA, Krampe RT, Tesch-Römer C (1993) The role of deliberate practice in the acquisition of expert performance. Psychol Rev 100:3CrossRef
Zurück zum Zitat Falchikov N, Goldfinch J (2000) Student peer assessment in higher education: a meta-analysis comparing peer and teacher marks. Rev Educ Res 70(3):287–322CrossRef Falchikov N, Goldfinch J (2000) Student peer assessment in higher education: a meta-analysis comparing peer and teacher marks. Rev Educ Res 70(3):287–322CrossRef
Zurück zum Zitat Fast E, Lee C, Aiken A, Bernstein MS, Koller D, Smith E (2013) Crowd-scale interactive formal reasoning and analytics. In: Proceedings of the 26th annual ACM symposium on user interface software and technology Fast E, Lee C, Aiken A, Bernstein MS, Koller D, Smith E (2013) Crowd-scale interactive formal reasoning and analytics. In: Proceedings of the 26th annual ACM symposium on user interface software and technology
Zurück zum Zitat Gray WD, Boehm-Davis DA (2000) Milliseconds matter: an introduction to microstrategies and to their use in describing and predicting interactive behavior. J Exp Psychol 6(4):322–335 Gray WD, Boehm-Davis DA (2000) Milliseconds matter: an introduction to microstrategies and to their use in describing and predicting interactive behavior. J Exp Psychol 6(4):322–335
Zurück zum Zitat Greenberg S (2009) Embedding a design studio course in a conventional computer science program. In: Creativity and HCI: From Experience to Design in Education. Springer, pp 23–41 Greenberg S (2009) Embedding a design studio course in a conventional computer science program. In: Creativity and HCI: From Experience to Design in Education. Springer, pp 23–41
Zurück zum Zitat Grudin J (1994) Groupware and social dynamics: eight challenges for developers. Commun ACM 37(1):92–105CrossRef Grudin J (1994) Groupware and social dynamics: eight challenges for developers. Commun ACM 37(1):92–105CrossRef
Zurück zum Zitat Guskey TR (2007) Closing achievement gaps: revisiting Benjamin S. Bloom’s “Learning for Mastery”. J Adv Acad 19(1):8–31 Guskey TR (2007) Closing achievement gaps: revisiting Benjamin S. Bloom’s “Learning for Mastery”. J Adv Acad 19(1):8–31
Zurück zum Zitat Hattie J, Timperley H (2007) The power of feedback. Rev Educ Res 77(1):81–112CrossRef Hattie J, Timperley H (2007) The power of feedback. Rev Educ Res 77(1):81–112CrossRef
Zurück zum Zitat Heffernan N, Heffernan C, Dietz K, Soffer D, Pellegrino JW, Goldman SR, Dailey M (2012) Improving mathematical learning outcomes through automatic reassessment and relearning. AERA Heffernan N, Heffernan C, Dietz K, Soffer D, Pellegrino JW, Goldman SR, Dailey M (2012) Improving mathematical learning outcomes through automatic reassessment and relearning. AERA
Zurück zum Zitat Kim S-M, Pantel P, Chklovski T, Pennacchiotti M (2006) Automatically assessing review helpfulness. In: Proceedings of the 2006 conference on empirical methods in natural language processing, association for computational linguistics, pp 423–430 Kim S-M, Pantel P, Chklovski T, Pennacchiotti M (2006) Automatically assessing review helpfulness. In: Proceedings of the 2006 conference on empirical methods in natural language processing, association for computational linguistics, pp 423–430
Zurück zum Zitat Kittur A, Chi EH, Suh B (2008) Crowdsourcing user studies with mechanical turk. In: Proceeding of CHI, ACM Press, p 453 Kittur A, Chi EH, Suh B (2008) Crowdsourcing user studies with mechanical turk. In: Proceeding of CHI, ACM Press, p 453
Zurück zum Zitat Kizilcec RF, Schneider E (2015) Motivation as a lens to understand online learners: towards data-driven design with the OLEI scale Kizilcec RF, Schneider E (2015) Motivation as a lens to understand online learners: towards data-driven design with the OLEI scale
Zurück zum Zitat Klemmer SR (2015) Katayanagi Lecture at CMU: the power of examples Klemmer SR (2015) Katayanagi Lecture at CMU: the power of examples
Zurück zum Zitat Klemmer SR, Hartmann B, Takayama L (2006) How bodies matter: five themes for interaction design. In: Proceedings of the 6th conference on designing interactive systems, pp 140–149 Klemmer SR, Hartmann B, Takayama L (2006) How bodies matter: five themes for interaction design. In: Proceedings of the 6th conference on designing interactive systems, pp 140–149
Zurück zum Zitat Kluger AN, DeNisi A (1996) The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull 119(2):254–284CrossRef Kluger AN, DeNisi A (1996) The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull 119(2):254–284CrossRef
Zurück zum Zitat Konstan JA, Walker JD, Brooks DC, Brown K, Ekstrand MD (2014) Teaching recommender systems at large scale. In: Proceeding of the ACM conference on learning @ scale conference, ACM Press Konstan JA, Walker JD, Brooks DC, Brown K, Ekstrand MD (2014) Teaching recommender systems at large scale. In: Proceeding of the ACM conference on learning @ scale conference, ACM Press
Zurück zum Zitat Kraut RE, Resnick P, Kiesler S, Burke M, Chen Y, Kittur N, Konstan J, Ren Y, Riedl J (2012) Building successful online communities: evidence-based social design (Google eBook), MIT Press Kraut RE, Resnick P, Kiesler S, Burke M, Chen Y, Kittur N, Konstan J, Ren Y, Riedl J (2012) Building successful online communities: evidence-based social design (Google eBook), MIT Press
Zurück zum Zitat Kulik JA, Kulik C-LC (1987) Timing of feedback and verbal learning. Rev Educ Res 58(1):79–97CrossRef Kulik JA, Kulik C-LC (1987) Timing of feedback and verbal learning. Rev Educ Res 58(1):79–97CrossRef
Zurück zum Zitat Kulkarni C, Wei KP, Le H, Chia D, Papadopoulos K, Cheng J, Koller D, Klemmer SR (2013) Peer and self assessment in massive online classes. ACM Trans Comput-Hum Interact (TOCHI) 20(6):33CrossRef Kulkarni C, Wei KP, Le H, Chia D, Papadopoulos K, Cheng J, Koller D, Klemmer SR (2013) Peer and self assessment in massive online classes. ACM Trans Comput-Hum Interact (TOCHI) 20(6):33CrossRef
Zurück zum Zitat Kulkarni C, Socher R, Bernstein MS, Klemmer SR (2014) Scaling short-answer grading by combining peer assessment with algorithmic scoring. In: ACM conference on learning @ scale, ACM Kulkarni C, Socher R, Bernstein MS, Klemmer SR (2014) Scaling short-answer grading by combining peer assessment with algorithmic scoring. In: ACM conference on learning @ scale, ACM
Zurück zum Zitat Kulkarni C, Cambre J, Kotturi Y, Bernstein M, Klemmer S (2015) Talkabout: making distance matter with small groups in massive classes. In: CSCW: ACM conference on computer supported collaborative work Kulkarni C, Cambre J, Kotturi Y, Bernstein M, Klemmer S (2015) Talkabout: making distance matter with small groups in massive classes. In: CSCW: ACM conference on computer supported collaborative work
Zurück zum Zitat Latham GP, Locke EA (1991) Self-regulation through goal setting. Organ Behav Hum Decis Process 50(2):212–247CrossRef Latham GP, Locke EA (1991) Self-regulation through goal setting. Organ Behav Hum Decis Process 50(2):212–247CrossRef
Zurück zum Zitat Ling K, Beenen G (2005) Using social psychology to motivate contributions to online communities. J Comput-Mediat Commun 10(4):00CrossRef Ling K, Beenen G (2005) Using social psychology to motivate contributions to online communities. J Comput-Mediat Commun 10(4):00CrossRef
Zurück zum Zitat Marsh RL, Landau JD, Hicks JL (1996) How examples may (and may not) constrain creativity. Mem Cogn 24(5):669–680CrossRef Marsh RL, Landau JD, Hicks JL (1996) How examples may (and may not) constrain creativity. Mem Cogn 24(5):669–680CrossRef
Zurück zum Zitat O’Donnell AM, Dansereau DF (1995) Scripted cooperation in student dyads: a method for analyzing and enhancing academic learning and performance. In: Interaction in cooperative groups: the theoretical anatomy of group learning. Cambridge University Press, Cambridge, UK, pp 120–141 O’Donnell AM, Dansereau DF (1995) Scripted cooperation in student dyads: a method for analyzing and enhancing academic learning and performance. In: Interaction in cooperative groups: the theoretical anatomy of group learning. Cambridge University Press, Cambridge, UK, pp 120–141
Zurück zum Zitat Plattner H, Meinel C, Leifer L (eds) (2015) Design thinking research: making design thinking foundational. Springer, Heidelber Plattner H, Meinel C, Leifer L (eds) (2015) Design thinking research: making design thinking foundational. Springer, Heidelber
Zurück zum Zitat Porter L, Lee CB, Simon B (2013) Halving fail rates using peer instruction: a study of four computer science courses. In: Proceeding SIGCSE’13 Proceeding of the 44th ACM tech nical symposium on computer science education, pp 177–182 Porter L, Lee CB, Simon B (2013) Halving fail rates using peer instruction: a study of four computer science courses. In: Proceeding SIGCSE’13 Proceeding of the 44th ACM tech nical symposium on computer science education, pp 177–182
Zurück zum Zitat Rosenberg J, Lorenzo M, Mazur E (2007) Peer instruction: making science engaging. In: Handbook of college science teaching. NSTA Press, Arlington, VA, pp 77–85 Rosenberg J, Lorenzo M, Mazur E (2007) Peer instruction: making science engaging. In: Handbook of college science teaching. NSTA Press, Arlington, VA, pp 77–85
Zurück zum Zitat Smith M, Wood W, Adams W, Wieman C, Knight J, Guild N, Su T (2009) Why peer discussion improves student performance on in-class concept questions. Science 323(5910):122–124CrossRef Smith M, Wood W, Adams W, Wieman C, Knight J, Guild N, Su T (2009) Why peer discussion improves student performance on in-class concept questions. Science 323(5910):122–124CrossRef
Zurück zum Zitat Sommers N (1982) Responding to student writing. Coll Compos Commun 33(2):148–156CrossRef Sommers N (1982) Responding to student writing. Coll Compos Commun 33(2):148–156CrossRef
Zurück zum Zitat Stephens-Martinez K, Hearst MA, Fox A (2014) Monitoring MOOCs: which information sources do instructors value? In: Proceedings of the first ACM conference on learning @ scale conference, pp 79–88 Stephens-Martinez K, Hearst MA, Fox A (2014) Monitoring MOOCs: which information sources do instructors value? In: Proceedings of the first ACM conference on learning @ scale conference, pp 79–88
Zurück zum Zitat Tinapple D, Olson L, Sadauskas J (2013) CritViz: web-based software supporting peer critique in large creative classrooms. Bull IEEE Techn Comm Learn Technol 15(1):29 Tinapple D, Olson L, Sadauskas J (2013) CritViz: web-based software supporting peer critique in large creative classrooms. Bull IEEE Techn Comm Learn Technol 15(1):29
Zurück zum Zitat Turkle S (2011) Alone together: why we expect more from technology and less from each other. Basic Books, New York Turkle S (2011) Alone together: why we expect more from technology and less from each other. Basic Books, New York
Metadaten
Titel
Designing Scalable and Sustainable Peer Interactions Online
verfasst von
Chinmay Kulkarni
Yasmine Kotturi
Michael S. Bernstein
Scott Klemmer
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-40382-3_14