Skip to main content

2015 | OriginalPaper | Buchkapitel

Paper or Pixel? Comparing Paper- and Tool-Based Participatory Design Approaches

verfasst von : Matthias Heintz, Effie Lai-Chong Law, Samaneh Soleimani

Erschienen in: Human-Computer Interaction – INTERACT 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Traditionally, in participatory design (PD) workshops, pens and paper are often used by participants to provide their design ideas. However, using a software tool to gather their feedback can have certain advantages. While some attempts to develop such tools have been undertaken, the basic question whether the tool-based approach is better or worse than its paper-based counterpart in terms of the quality of feedback gathered is rarely explored. We aim to address this research question by conducting three PD workshops with the paper-based and tool-based approach. In addition to the findings about the comparability of the two approaches, one of our main contributions to the future research on this question is the development of the coding scheme CAt+. It enables systematic comparisons of PD data collected with different methods and aims to support designers and developers to exploit PD results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Greenbaum, J., Kyng, M.: Design at Work: Cooperative Design of Computer Systems. Erlbaum, Hillsdale (1991) Greenbaum, J., Kyng, M.: Design at Work: Cooperative Design of Computer Systems. Erlbaum, Hillsdale (1991)
2.
Zurück zum Zitat Muller, M.J.: Participatory design: the third space in HCI (revised). In: Jacko, J., Sears, A. (eds.) Handbook of HCI, 2nd edn. Erlbaum, Hillsdale (2007) Muller, M.J.: Participatory design: the third space in HCI (revised). In: Jacko, J., Sears, A. (eds.) Handbook of HCI, 2nd edn. Erlbaum, Hillsdale (2007)
3.
Zurück zum Zitat Schuler, D., Namioka, A. (eds.): Participatory design: principles and practices. CRC Press (1993) Schuler, D., Namioka, A. (eds.): Participatory design: principles and practices. CRC Press (1993)
4.
Zurück zum Zitat Sanders, E.B.N., Brandt, E., Binder, T.: A framework for organizing the tools and techniques of participatory design. In: Proceedings of the 11th Biennial Participatory Design Conference, pp. 195–198 (2010) Sanders, E.B.N., Brandt, E., Binder, T.: A framework for organizing the tools and techniques of participatory design. In: Proceedings of the 11th Biennial Participatory Design Conference, pp. 195–198 (2010)
5.
Zurück zum Zitat Walsh, G., Foss, E., Yip, J., Druin, A.: FACIT PD: a framework for analysis and creation of intergenerational techniques for participatory design. In: Proceedings of CHI 2013, pp. 2893–2902. ACM (2013) Walsh, G., Foss, E., Yip, J., Druin, A.: FACIT PD: a framework for analysis and creation of intergenerational techniques for participatory design. In: Proceedings of CHI 2013, pp. 2893–2902. ACM (2013)
6.
Zurück zum Zitat Weibel, N., Signer, B., Norrie, M.C., Hofstetter, H., Jetter, H.C., Reiterer, H.: PaperSketch: a paper-digital collaborative remote sketching tool. In: Proceedings of the 16th International Conference on Intelligent User Interfaces, pp. 155–164. ACM (2011) Weibel, N., Signer, B., Norrie, M.C., Hofstetter, H., Jetter, H.C., Reiterer, H.: PaperSketch: a paper-digital collaborative remote sketching tool. In: Proceedings of the 16th International Conference on Intelligent User Interfaces, pp. 155–164. ACM (2011)
7.
Zurück zum Zitat Lin, J., Newman, M.W., Hong, J.I., Landay, J.A.: DENIM: finding a tighter fit between tools and practice for Web site design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 510–517. ACM (2000) Lin, J., Newman, M.W., Hong, J.I., Landay, J.A.: DENIM: finding a tighter fit between tools and practice for Web site design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 510–517. ACM (2000)
8.
Zurück zum Zitat Rogers, Y., Sharp, H., Preece, J.: Interaction Design: Beyond Human-Computer Interaction. Wiley, Hoboken (2011) Rogers, Y., Sharp, H., Preece, J.: Interaction Design: Beyond Human-Computer Interaction. Wiley, Hoboken (2011)
9.
Zurück zum Zitat Sundar, S.S., Oh, J., Bellur, S., Jia, H., Kim, H.S.: Interactivity as self-expression: a field experiment with customization and blogging. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 395–404. ACM (2012) Sundar, S.S., Oh, J., Bellur, S., Jia, H., Kim, H.S.: Interactivity as self-expression: a field experiment with customization and blogging. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 395–404. ACM (2012)
10.
Zurück zum Zitat Teo, H.H., Oh, L.B., Liu, C., Wei, K.K.: An empirical study of the effects of interactivity on web user attitude. Int. J. Hum. Comput. Stud. 58(3), 281–305 (2003)CrossRef Teo, H.H., Oh, L.B., Liu, C., Wei, K.K.: An empirical study of the effects of interactivity on web user attitude. Int. J. Hum. Comput. Stud. 58(3), 281–305 (2003)CrossRef
11.
Zurück zum Zitat Zhao, L., Lu, Y.: Enhancing perceived interactivity through network externalities: an empirical study on micro-blogging service satisfaction and continuance intention. Decis. Support Syst. 53(4), 825–834 (2012)CrossRef Zhao, L., Lu, Y.: Enhancing perceived interactivity through network externalities: an empirical study on micro-blogging service satisfaction and continuance intention. Decis. Support Syst. 53(4), 825–834 (2012)CrossRef
12.
Zurück zum Zitat Govaerts, S., et al.: Towards an online lab portal for inquiry-based STEM learning at school. In: Wang, J.-F., Lau, R. (eds.) ICWL 2013. LNCS, vol. 8167, pp. 244–253. Springer, Heidelberg (2013)CrossRef Govaerts, S., et al.: Towards an online lab portal for inquiry-based STEM learning at school. In: Wang, J.-F., Lau, R. (eds.) ICWL 2013. LNCS, vol. 8167, pp. 244–253. Springer, Heidelberg (2013)CrossRef
13.
Zurück zum Zitat Read, J.C., Gregory, P., MacFarlane, S.J., McManus, B., Gray, P., Patel, R.: An investigation of participatory design with children – informant, balanced and facilitated design. In: Interaction Design and Children, pp. 53–64 (2002) Read, J.C., Gregory, P., MacFarlane, S.J., McManus, B., Gray, P., Patel, R.: An investigation of participatory design with children – informant, balanced and facilitated design. In: Interaction Design and Children, pp. 53–64 (2002)
14.
Zurück zum Zitat Hundhausen, C., Trent, S., Balkar, A., Nuur, M.: The design and experimental evaluation of a tool to support the construction and wizard-of-oz testing of low fidelity prototypes. In: IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC 2008, pp. 86–90 (2008) Hundhausen, C., Trent, S., Balkar, A., Nuur, M.: The design and experimental evaluation of a tool to support the construction and wizard-of-oz testing of low fidelity prototypes. In: IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC 2008, pp. 86–90 (2008)
15.
Zurück zum Zitat Segura, V.C.V.B., Barbosa, S.D.J., Simões, F.P.: UISKEI: a sketch-based prototyping tool for defining and evaluating user interface behavior. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 18–25. ACM (2012) Segura, V.C.V.B., Barbosa, S.D.J., Simões, F.P.: UISKEI: a sketch-based prototyping tool for defining and evaluating user interface behavior. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 18–25. ACM (2012)
16.
Zurück zum Zitat MacDonald, F., Miller, J.: A comparison of tool-based and paper-based software inspection. Empirical Softw. Eng. (Kluwer Academic Publishers) 3, 233–253 (1998)CrossRef MacDonald, F., Miller, J.: A comparison of tool-based and paper-based software inspection. Empirical Softw. Eng. (Kluwer Academic Publishers) 3, 233–253 (1998)CrossRef
17.
Zurück zum Zitat Bailey, B.P., Konstan, J.A.: Are informal tools better?: comparing DEMAIS, pencil and paper, and authorware for early multimedia design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 313–320. ACM (2003) Bailey, B.P., Konstan, J.A.: Are informal tools better?: comparing DEMAIS, pencil and paper, and authorware for early multimedia design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 313–320. ACM (2003)
18.
Zurück zum Zitat Law, E.L.-C., van Schaik, P., Roto, V.: Attitudes towards user experience (UX) measurement. Int. J. Hum. Comput. Stud. 72(6), 526–541 (2014)CrossRef Law, E.L.-C., van Schaik, P., Roto, V.: Attitudes towards user experience (UX) measurement. Int. J. Hum. Comput. Stud. 72(6), 526–541 (2014)CrossRef
19.
Zurück zum Zitat Stumpf, S., Rajaram, V., Li, L., Burnett, M., Dietterich, T., Sullivan, E., Drummond, R., Herlocker, J.: Toward harnessing user feedback for machine learning. In: Proceedings of the 12th International Conference on Intelligent User Interfaces (IUI 2007), pp. 82–91. ACM, New York, NY, USA (2007) Stumpf, S., Rajaram, V., Li, L., Burnett, M., Dietterich, T., Sullivan, E., Drummond, R., Herlocker, J.: Toward harnessing user feedback for machine learning. In: Proceedings of the 12th International Conference on Intelligent User Interfaces (IUI 2007), pp. 82–91. ACM, New York, NY, USA (2007)
20.
Zurück zum Zitat Kindred, J., Mohammed, S.N.: “He will crush you like an academic ninja!”: exploring teacher ratings on Ratemyprofessors.com. J. Comput. Mediated Commun. 10, 00 (2005)CrossRef Kindred, J., Mohammed, S.N.: “He will crush you like an academic ninja!”: exploring teacher ratings on Ratemyprofessors.com. J. Comput. Mediated Commun. 10, 00 (2005)CrossRef
21.
Zurück zum Zitat Madden, A., Ruthven, I., McMenemy, D.: A classification scheme for content analyses of YouTube video comments. J. Documentation 69, 693–714 (2013)CrossRef Madden, A., Ruthven, I., McMenemy, D.: A classification scheme for content analyses of YouTube video comments. J. Documentation 69, 693–714 (2013)CrossRef
22.
Zurück zum Zitat Könings, K.D., Brand-Gruwel, S., van Merriënboer, J.J.: An approach to participatory instructional design in secondary education: an exploratory study. Educ. Res. 52, 45–59 (2010)CrossRef Könings, K.D., Brand-Gruwel, S., van Merriënboer, J.J.: An approach to participatory instructional design in secondary education: an exploratory study. Educ. Res. 52, 45–59 (2010)CrossRef
23.
Zurück zum Zitat Naghsh, A.M., Andy, D.: GABBEH: a tool to support collaboration in electronic paper prototyping. In: CSCW 2004 the ACM Conference on Computer Supported Cooperative Work, Chicago, USA (2004) Naghsh, A.M., Andy, D.: GABBEH: a tool to support collaboration in electronic paper prototyping. In: CSCW 2004 the ACM Conference on Computer Supported Cooperative Work, Chicago, USA (2004)
24.
Zurück zum Zitat Walsh, G., Druin, A., Guha, M.L., Bonsignore, E., Foss, E., Yip, J.C., et al.: DisCo: a co-design online tool for asynchronous distributed child and adult design partners. In: Proceedings of International Conference on Interaction Design and Children (IDC 2011), pp. 11–19. ACM (2012) Walsh, G., Druin, A., Guha, M.L., Bonsignore, E., Foss, E., Yip, J.C., et al.: DisCo: a co-design online tool for asynchronous distributed child and adult design partners. In: Proceedings of International Conference on Interaction Design and Children (IDC 2011), pp. 11–19. ACM (2012)
25.
Zurück zum Zitat Newman, M.W., Lin, J., Hong, J.I., Landay, J.A.: DENIM: an informal web site design tool inspired by observations of practice. Hum. Comput. Interact. 18(3), 259–324 (2003)CrossRef Newman, M.W., Lin, J., Hong, J.I., Landay, J.A.: DENIM: an informal web site design tool inspired by observations of practice. Hum. Comput. Interact. 18(3), 259–324 (2003)CrossRef
26.
Zurück zum Zitat Walsh, G., Druin, A., Guha, M.L., Foss, E., Golub, E., Hatley, L., …, Franckel, S.: Layered elaboration: a new technique for co-design with children. In: Proceedings CHI 2010, pp. 1237–1240. ACM (2010) Walsh, G., Druin, A., Guha, M.L., Foss, E., Golub, E., Hatley, L., …, Franckel, S.: Layered elaboration: a new technique for co-design with children. In: Proceedings CHI 2010, pp. 1237–1240. ACM (2010)
27.
Zurück zum Zitat Heintz, M., Law, E.L.-C., Govaerts, S., Holzer, A., Gillet, D.: Pdot: participatory design online tool. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, pp. 2581–2586. ACM (2014) Heintz, M., Law, E.L.-C., Govaerts, S., Holzer, A., Gillet, D.: Pdot: participatory design online tool. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, pp. 2581–2586. ACM (2014)
28.
Zurück zum Zitat Druin, A.: Cooperative inquiry: developing new technologies for children with children. In: Proceedings of CHI 1999, pp. 592–599. ACM Press (1999) Druin, A.: Cooperative inquiry: developing new technologies for children with children. In: Proceedings of CHI 1999, pp. 592–599. ACM Press (1999)
29.
Zurück zum Zitat Hallgren, K.A.: Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials Quant. Methods Psychol. 8(1), 23–34 (2012) Hallgren, K.A.: Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials Quant. Methods Psychol. 8(1), 23–34 (2012)
30.
Zurück zum Zitat Krippendorff, K.: Content Analysis: An Introduction to Its Methodology, 2nd edn. SAGE, London (2004) Krippendorff, K.: Content Analysis: An Introduction to Its Methodology, 2nd edn. SAGE, London (2004)
31.
Zurück zum Zitat Vilbergsdottir, S.G., Hvannberg, E.T., Law, E.L.-C.: Assessing the reliability, validity and acceptance of a classification scheme of usability problems (CUP). J. Syst. Softw. 87, 18–37 (2014)CrossRef Vilbergsdottir, S.G., Hvannberg, E.T., Law, E.L.-C.: Assessing the reliability, validity and acceptance of a classification scheme of usability problems (CUP). J. Syst. Softw. 87, 18–37 (2014)CrossRef
32.
Zurück zum Zitat Hornbaek, K., Stage, J.: The interplay between usability evaluation and user interaction design. Int. J. Hum. Comput. Interact. 21, 117–123 (2006)CrossRef Hornbaek, K., Stage, J.: The interplay between usability evaluation and user interaction design. Int. J. Hum. Comput. Interact. 21, 117–123 (2006)CrossRef
33.
Zurück zum Zitat Fleiss, J.L., Cohen, J.: The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ. Psychol. Measur. 33, 613–619 (1973)CrossRef Fleiss, J.L., Cohen, J.: The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ. Psychol. Measur. 33, 613–619 (1973)CrossRef
34.
Zurück zum Zitat Altman, D.G.: Practical Statistics for Medical Research. Chapman and Hall, London (1991) Altman, D.G.: Practical Statistics for Medical Research. Chapman and Hall, London (1991)
35.
Zurück zum Zitat Fleiss, J.L., Levin, B., Paik, M.C.: Statistical Methods for Rates and Proportions, 3rd edn. Wiley, Hoboken (2003)CrossRefMATH Fleiss, J.L., Levin, B., Paik, M.C.: Statistical Methods for Rates and Proportions, 3rd edn. Wiley, Hoboken (2003)CrossRefMATH
36.
Zurück zum Zitat Maltby, J., Liza, D.: Early Success in Statistics. Pearson Education, New York (2002) Maltby, J., Liza, D.: Early Success in Statistics. Pearson Education, New York (2002)
37.
Zurück zum Zitat McDonald, J.H.: Handbook of Biological Statistics, 3rd edn. Sparky House Publishing, Baltimore (2014) McDonald, J.H.: Handbook of Biological Statistics, 3rd edn. Sparky House Publishing, Baltimore (2014)
Metadaten
Titel
Paper or Pixel? Comparing Paper- and Tool-Based Participatory Design Approaches
verfasst von
Matthias Heintz
Effie Lai-Chong Law
Samaneh Soleimani
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-22698-9_34