skip to main content
10.1145/2598510.2600889acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

Computer supported novice group critique

Published:21 June 2014Publication History

ABSTRACT

Groups of novice critiquers can sometimes provide feedback of the same quality as a single expert. Unfortunately, we do not know how to create systems for novice group critique in design education. We tested whether 4 principles: write-first scripts, critique prompts, interactive critiquing & formative framing, allow us to create systems that combine the advantages of face-to-face and computer-mediated critique. We collected observations and 48 interviews with 12 undergraduate design students who used a computer supported group critique system over 5 critique sessions, analyzed using grounded theory. We found that: (a) the write-first script helped overcome initial learning costs; (b) the interactive critique features created a dual-channel critique that increased the number of critiquers, duration of critique and interactivity; and (c) the system produced a greater volume of useful critique and promoted reciprocity among critiquers. The study provides improved principles for developing computer supported novice group critique systems in design.

References

  1. Van Zundert, M., Sluijsmans, D., Van Merriënboer, J.: Effective peer assessment processes: Research findings and future directions. Learning and Instruction. 20(4), 270--279 (2010)Google ScholarGoogle ScholarCross RefCross Ref
  2. Cho, K., Chung, T.R., King, W.R., Schunn, C.: Peerbased computer-supported knowledge refinement: An empirical investigation. Communications of the ACM. 51(3), 83--88 (2008) Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Dannels, D.P., Martin, K.N.: Critiquing critiques a genre analysis of feedback across novice to expert design studios. Journal of Business and Technical Communication. 22(2), 135--159 (2008)Google ScholarGoogle ScholarCross RefCross Ref
  4. Tohidi, M., Buxton, W., Baecker, R., Sellen, A.: Getting the right design and the design right. In: Proceedings of the SIGCHI conference on Human Factors in computing systems, pp. 1243--1252. (2006) Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Amabile, T.M.: Creativity and innovation in organizations. Harvard Business School. 5(9), 396--239 (1996)Google ScholarGoogle Scholar
  6. Buxton, B.: Sketching user experiences: Getting the design right and the right design. Morgan Kaufmann, San Francisco (2007) Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Moggridge, B., Smith, G.C.: Designing interactions. MIT Press, Cambridge, MA (2007) Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Kelley, T., Littman, J.: The Art of Innovation: Lessons in Creativity from IDEO, America's Leading Design Firm. Crown Business, New York (2001)Google ScholarGoogle Scholar
  9. Lande, M., Leifer, L.: Difficulties student engineers face designing the future. International Journal of Engineering Education. 26(2), 271--277 (2010)Google ScholarGoogle Scholar
  10. Topping, K.: Peer assessment between students in colleges and universities. Review of Educational Research. 68(3), 249--276 (1998)Google ScholarGoogle ScholarCross RefCross Ref
  11. van Gennip, N.A., Segers, M.S., Tillema, H.H.: Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features. Educational Research Review. 4(1), 41--54 (2009)Google ScholarGoogle ScholarCross RefCross Ref
  12. Panadero, E., Romero, M., Strijbos, J.-W.: The impact of a rubric and friendship on peer assessment: Effects on construct validity, performance, and perceptions of fairness and comfort. Studies in Educational Evaluation. 39(4), 195--203 (2013)Google ScholarGoogle ScholarCross RefCross Ref
  13. Strijbos, J.W., Narciss, S., Dünnebier, K.: Peer feedback content and sender's competence level in academic writing revision tasks: Are they critical for feedback perceptions and efficiency? Learning and instruction. 20(4), 291--303 (2010)Google ScholarGoogle Scholar
  14. Kollar, I., Fischer, F.: Peer assessment as collaborative learning: A cognitive perspective. Learning and Instruction. 20(4), 344--348 (2010)Google ScholarGoogle ScholarCross RefCross Ref
  15. Diehl, M., Stroebe, W.: Productivity loss in brainstorming groups: Toward the solution of a riddle. Journal of personality and social psychology. 53(3), 497--509 (1987)Google ScholarGoogle Scholar
  16. Clark, H.H., Brennan, S.E.: Grounding in communication. Perspectives on socially shared cognition. 13(1991), 127--149 (1991)Google ScholarGoogle Scholar
  17. Gallupe, R.B., Bastianutti, L.M., Cooper, W.H.: Unblocking brainstorms. Journal of Applied Psychology. 76(1), 137--142 (1991)Google ScholarGoogle ScholarCross RefCross Ref
  18. Ramirez, A., Wang, Z.: When online meets offline: An expectancy violations theory perspective on modality switching. Journal of Communication. 58(1), 20--39 (2008)Google ScholarGoogle ScholarCross RefCross Ref
  19. Kraut, R.E., Resnick, P.: Building Successful Online Communities: Evidence-based social design. MIT Press (2012) Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Lampe, C., Johnston, E.: Follow the (Slash) dot: effects of feedback on new members in an online community. In: Proceedings of the 2005 international ACM SIGGROUP conference on Supporting group work, pp. 11--20. (2005) Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Behance. {Web page}. http://www.behance.net/.Google ScholarGoogle Scholar
  22. Zurb: Forrst. {Web page}. http://forrst.com/posts.Google ScholarGoogle Scholar
  23. Dribbble. {Web page}. http://dribbble.com/.Google ScholarGoogle Scholar
  24. Swrm. {Web page}. Retrieved from http://swrm.io/.Google ScholarGoogle Scholar
  25. Collins, A.: Toward a Design Science of Education. In: Scanlon, E., O'Shea, T. (eds.) New Directions in Educational Technology, pp. 15--22. Springer Berlin Heidelberg (1992)Google ScholarGoogle ScholarCross RefCross Ref
  26. Zimmerman, J., Forlizzi, J., Evenson, S.: Research through design as a method for interaction design research in HCI. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 493--502. (2007) Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Easterday, M.W., Rees Lewis, D., Gerber, E.: Formative feedback in Digital Lofts: Learning environments for real world innovation. In: Goldin, I., Martin, T., Baker, R., Aleven, V., Barnes, T. (eds.) Formative feedback in interactive learning environments, A workshop at AIED 2013 Memphis, TN (2013)Google ScholarGoogle Scholar
  28. Corbin, J., Strauss, A.: Basics of qualitative research: techniques and procedures for developing grounded theory. Sage, Thousand Oaks, CA (2007)Google ScholarGoogle Scholar

Index Terms

  1. Computer supported novice group critique

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      DIS '14: Proceedings of the 2014 conference on Designing interactive systems
      June 2014
      1102 pages
      ISBN:9781450329026
      DOI:10.1145/2598510

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 June 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      DIS '14 Paper Acceptance Rate107of402submissions,27%Overall Acceptance Rate1,158of4,684submissions,25%

      Upcoming Conference

      DIS '24
      Designing Interactive Systems Conference
      July 1 - 5, 2024
      IT University of Copenhagen , Denmark

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader