Skip to main content
Erschienen in: Universal Access in the Information Society 2/2015

01.06.2015 | Long paper

Guiding situated method transfer in design and evaluation

Exploring concepts, activities and process

verfasst von: Stefan Cronholm, Matthias Neubauer, Christian Stary

Erschienen in: Universal Access in the Information Society | Ausgabe 2/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The purpose is to suggest guidelines for supporting the transfer of design and evaluation methods from one organization/field/sector to another. There exist a variety of methods for designing and evaluating interactive socio-technical systems. Many of them have been developed for dedicated purposes, such as heuristic evaluation, referring to specific situations and artifacts. Due to the recent diversification of devices and the continuing diffusion of society with interactive systems, applying design and evaluation methods in an effective and efficient way has become crucial, in particular when operating under tight economic conditions and demanding user constraints. Learning from other projects, cases, disciplines or sectors seems to be one way to effectively apply methods in design and evaluation. In order to validate the suggested guidelines, the guidelines are theoretically informed and empirically supported by the use of a case study. The results consist of a set of seven guidelines for method transfer. The guidelines are described in terms of questions to ask, expected input and expected output and how they relate to the other guidelines. Transferring methods require an informed procedure, reflecting the rationale of methods, application-specific factors and experience of use. In this paper, some conceptual foundations are given when exploring transferability of methods and implemented in the field of IT cross-sector developments. The developed guidelines allow developers to identify situation-specific elements and design an effective learning experience for a case at hand. The introduced content structure and interactive features show an effective way of developer support.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat ISO 9241-11.: Ergonomic requirements for office work with visual display terminals (VDTs). In: Part 11: guidance on usability, 1st edn., 1998-03-15. International Organization for Standardization, Geneva (1998) ISO 9241-11.: Ergonomic requirements for office work with visual display terminals (VDTs). In: Part 11: guidance on usability, 1st edn., 1998-03-15. International Organization for Standardization, Geneva (1998)
2.
Zurück zum Zitat Mirel, B.: Interaction design for complex problem solving. Developing useful and usable software. Morgan Kaufmann, San Francisco (2004) Mirel, B.: Interaction design for complex problem solving. Developing useful and usable software. Morgan Kaufmann, San Francisco (2004)
4.
Zurück zum Zitat Benyon, D., Turner, Ph, Turner, S.: Designing interactive systems. Addison Wesley, New York (2005) Benyon, D., Turner, Ph, Turner, S.: Designing interactive systems. Addison Wesley, New York (2005)
5.
Zurück zum Zitat Bevan, N.: Cost benefits framework and case studies. In: Bias, R.G., Mayhew, D.J. (eds.) Cost-justifying usability: an update for the internet age. Morgan Kaufmann, San Francisco (2005) Bevan, N.: Cost benefits framework and case studies. In: Bias, R.G., Mayhew, D.J. (eds.) Cost-justifying usability: an update for the internet age. Morgan Kaufmann, San Francisco (2005)
6.
Zurück zum Zitat Blythe, M., Wright, P., McCarthy, J.: Theory and method for experience centered design. CHI ‘06 extended abstracts on human factors in computing systems. ACM, New York (2006) Blythe, M., Wright, P., McCarthy, J.: Theory and method for experience centered design. CHI ‘06 extended abstracts on human factors in computing systems. ACM, New York (2006)
7.
Zurück zum Zitat Wright, P., Wallace, J., McCarthy, J.: Aesthetics and experience-centered design. ACM Trans. Comput. Hum. Interact (TOCHI). 15(4) (2008). New York Wright, P., Wallace, J., McCarthy, J.: Aesthetics and experience-centered design. ACM Trans. Comput. Hum. Interact (TOCHI). 15(4) (2008). New York
8.
Zurück zum Zitat Cockton, G.: Designing worth—connecting preferred means to desired ends. Interactions Chang. Energy. Use. Through. Des. 15(4) July + August (2008). New York Cockton, G.: Designing worth—connecting preferred means to desired ends. Interactions Chang. Energy. Use. Through. Des. 15(4) July + August (2008). New York
9.
Zurück zum Zitat Johansson, M., Linde, P.: Playful collaborative exploration: new research practice in participatory design. J. Res. Pract. 1(1) (2005) Johansson, M., Linde, P.: Playful collaborative exploration: new research practice in participatory design. J. Res. Pract. 1(1) (2005)
10.
Zurück zum Zitat Corbin, J., Strauss, A.: Basics of qualitative research: grounded theory procedures and techniques, 3rd edn. Sage, London (2008) Corbin, J., Strauss, A.: Basics of qualitative research: grounded theory procedures and techniques, 3rd edn. Sage, London (2008)
11.
Zurück zum Zitat Hvannberg, E., Rudinsky, J.: Crisis management training: techniques for eliciting and describing requirements and early designs across different incident types. In: Proceedings HCII 2011, Springer Lecture Notes in Computer Science, Volume 6768/2011, pp. 225–234 (2011). doi: 10.1007/978-3-642-21657-2_24225-234 Hvannberg, E., Rudinsky, J.: Crisis management training: techniques for eliciting and describing requirements and early designs across different incident types. In: Proceedings HCII 2011, Springer Lecture Notes in Computer Science, Volume 6768/2011, pp. 225–234 (2011). doi: 10.​1007/​978-3-642-21657-2_​24225-234
12.
Zurück zum Zitat Greenberg, S., Buxton, B.: Usability evaluation considered harmful (some of the time). In: Proceedings CHI 2008, ACM, pp. 111–120. (2008) Greenberg, S., Buxton, B.: Usability evaluation considered harmful (some of the time). In: Proceedings CHI 2008, ACM, pp. 111–120. (2008)
13.
Zurück zum Zitat Goldkuhl, G., Lind, M., Seigerroth, U.: Method integration as a learning process. In: Jayaratna, N., Fitzgerald, B., Wood-Harper, T., Larrasquet, J.-M. (eds.) Training and education of methodology practitioners and researchers. Springer, London (1997) Goldkuhl, G., Lind, M., Seigerroth, U.: Method integration as a learning process. In: Jayaratna, N., Fitzgerald, B., Wood-Harper, T., Larrasquet, J.-M. (eds.) Training and education of methodology practitioners and researchers. Springer, London (1997)
14.
Zurück zum Zitat Kumar, K., Welke, R.J.: Methodology engineering: a proposal for situation-specific methodology construction. In: Cotterman, W.W., Senn, C. (eds.) Challenges and strategies for research in systems development. Wiley, Chichester (1992) Kumar, K., Welke, R.J.: Methodology engineering: a proposal for situation-specific methodology construction. In: Cotterman, W.W., Senn, C. (eds.) Challenges and strategies for research in systems development. Wiley, Chichester (1992)
16.
Zurück zum Zitat Brown, J.: The world café: shaping our futures through conversations that matter. Berrett-Koehler Publishers Inc., San Francisco (2005) Brown, J.: The world café: shaping our futures through conversations that matter. Berrett-Koehler Publishers Inc., San Francisco (2005)
17.
Zurück zum Zitat Campos, J., Lopez-Sanchez, M., Rodriguez-Aguilar, J.A., Esteva, M.: Formalizing situatedness and adaption in electronic institutions. Proc. COIN 2008, LNAI 5428: 126–139. Springer, Berlin (2009) Campos, J., Lopez-Sanchez, M., Rodriguez-Aguilar, J.A., Esteva, M.: Formalizing situatedness and adaption in electronic institutions. Proc. COIN 2008, LNAI 5428: 126–139. Springer, Berlin (2009)
18.
Zurück zum Zitat Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability inspection methods. Wiley, New York (1994)CrossRef Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability inspection methods. Wiley, New York (1994)CrossRef
19.
Zurück zum Zitat Shneiderman, B., Plaisant, C.: Designing the user interface: strategies for effective human–computer interaction, 5th edn. Addison-Wesley Publishing Co., Reading, MA (2010) Shneiderman, B., Plaisant, C.: Designing the user interface: strategies for effective human–computer interaction, 5th edn. Addison-Wesley Publishing Co., Reading, MA (2010)
20.
Zurück zum Zitat Jayaratna, N.: Understanding and evaluating methodologies. McGraw-Hill Book Company, London (1994) Jayaratna, N.: Understanding and evaluating methodologies. McGraw-Hill Book Company, London (1994)
21.
Zurück zum Zitat Checkland, P.: Systems thinking, systems practice. Wiley, Chichester, UK (1981) Checkland, P.: Systems thinking, systems practice. Wiley, Chichester, UK (1981)
22.
Zurück zum Zitat Kaplan, R.S., Norton, D.P.: Using the balanced scorecard as a strategic management system. Harv. Bus. Rev. Jan–Feb, 74(1), 75–85 (1996) Kaplan, R.S., Norton, D.P.: Using the balanced scorecard as a strategic management system. Harv. Bus. Rev. Jan–Feb, 74(1), 75–85 (1996)
23.
Zurück zum Zitat Matheus, Ch. J., Kokar, M.M., Baclawski, K., Letkowski, J.J.: An application of semantic web technologies to situation awareness. In: Proceedings ISWC 2005, LNCS. 3729: 944–958. Springer, Berlin (2005) Matheus, Ch. J., Kokar, M.M., Baclawski, K., Letkowski, J.J.: An application of semantic web technologies to situation awareness. In: Proceedings ISWC 2005, LNCS. 3729: 944–958. Springer, Berlin (2005)
24.
Zurück zum Zitat Rolland, C., Prakash, N., Benjamen, A.: A multi-model view of process modelling. Requir. Eng. 4, 169–187 (1999)CrossRef Rolland, C., Prakash, N., Benjamen, A.: A multi-model view of process modelling. Requir. Eng. 4, 169–187 (1999)CrossRef
25.
Zurück zum Zitat Dobbyn, Ch., Stuart, S.: The self as embedded agent. Minds Mach. 13, 187–201 (2003)CrossRef Dobbyn, Ch., Stuart, S.: The self as embedded agent. Minds Mach. 13, 187–201 (2003)CrossRef
26.
Zurück zum Zitat Eberle, P., Schwarzinger, Ch., Stary, Ch.: User modeling and cognitive user support: towards structured development. Univ. Access. Inf. Soc. (2010). doi:10.1007/s10209-010-0210-z Eberle, P., Schwarzinger, Ch., Stary, Ch.: User modeling and cognitive user support: towards structured development. Univ. Access. Inf. Soc. (2010). doi:10.​1007/​s10209-010-0210-z
27.
Zurück zum Zitat Porter, M.: Competitive advantage: creating and sustaining superior performance. Free Press, New York (1985) Porter, M.: Competitive advantage: creating and sustaining superior performance. Free Press, New York (1985)
28.
Zurück zum Zitat Davenport, T.: Process innovation: reengineering work through information technology. Harvard Business School Press, Boston (1993) Davenport, T.: Process innovation: reengineering work through information technology. Harvard Business School Press, Boston (1993)
29.
Zurück zum Zitat Hammer, M., Champy, J.: Reengineering the corporation: a manifesto for business revolution. Harper Business, New York (1993) Hammer, M., Champy, J.: Reengineering the corporation: a manifesto for business revolution. Harper Business, New York (1993)
30.
Zurück zum Zitat Johansson, H.J., McHugh, P., Pendlebury, A.J., Wheeler, W.A.: Business process reengineering—break point strategies for market dominance. Wiley, Hoboken (1993) Johansson, H.J., McHugh, P., Pendlebury, A.J., Wheeler, W.A.: Business process reengineering—break point strategies for market dominance. Wiley, Hoboken (1993)
31.
Zurück zum Zitat Yourdon, E.: Modern structured analysis. Yourdon Press, Englewood Cliffs, NJ (1989) Yourdon, E.: Modern structured analysis. Yourdon Press, Englewood Cliffs, NJ (1989)
32.
Zurück zum Zitat Kruchten, P.: The rational unified process: an introduction. Addison Wesley Inc., Reading (1999) Kruchten, P.: The rational unified process: an introduction. Addison Wesley Inc., Reading (1999)
34.
Zurück zum Zitat Goldkuhl, G., Röstlinger, A.: Change analysis—innovation and evolution. Invited paper to the 14th international conference on information systems development. Karlstad University, Sweden, 2005 Goldkuhl, G., Röstlinger, A.: Change analysis—innovation and evolution. Invited paper to the 14th international conference on information systems development. Karlstad University, Sweden, 2005
35.
Zurück zum Zitat Dewey, J.: Logic: the theory of inquiry. Henry Holt, New York (1938) Dewey, J.: Logic: the theory of inquiry. Henry Holt, New York (1938)
36.
Zurück zum Zitat Schön, D.: The reflective practitioner—how professionals think in action. Basic Books, New York (1983) Schön, D.: The reflective practitioner—how professionals think in action. Basic Books, New York (1983)
37.
Zurück zum Zitat Tolvanen, J.-P., Lyytinen, K.: Flexible method adaptation in CASE environments—the metamodelling approach. In: Proceedings of 15th IRIS, Oslo University, 1992 Tolvanen, J.-P., Lyytinen, K.: Flexible method adaptation in CASE environments—the metamodelling approach. In: Proceedings of 15th IRIS, Oslo University, 1992
38.
Zurück zum Zitat Cronholm, S., Goldkuhl, G.: Meanings and motives of method customization in CASE environments—observations and categorizations from an empirical study. In: Proceedings of the 5th European Workshop on Next Generation of CASE Tools. Utrecht, The Netherlands, 1994 Cronholm, S., Goldkuhl, G.: Meanings and motives of method customization in CASE environments—observations and categorizations from an empirical study. In: Proceedings of the 5th European Workshop on Next Generation of CASE Tools. Utrecht, The Netherlands, 1994
39.
Zurück zum Zitat Dalkir, K.: Knowledge management in theory and practice, 2nd edn. MIT Press, Cambridge, MA (2011) Dalkir, K.: Knowledge management in theory and practice, 2nd edn. MIT Press, Cambridge, MA (2011)
41.
Zurück zum Zitat Srdjevic, B., Srdjevic, Z., Zoranovic, T., Suvocarev, K.: Multicriteria approach to conflict resolution—harmonizing water policies and water pricing: Serbian case example. In: Sinha P., Rana, S., (eds.) Proceedings of the 2nd World Aqua Congress, New Delhi, India, 195–204, (2008) Srdjevic, B., Srdjevic, Z., Zoranovic, T., Suvocarev, K.: Multicriteria approach to conflict resolution—harmonizing water policies and water pricing: Serbian case example. In: Sinha P., Rana, S., (eds.) Proceedings of the 2nd World Aqua Congress, New Delhi, India, 195–204, (2008)
42.
Zurück zum Zitat Srdjevic, Z., Kolarov, V., Srdjevic, B.: Finding the best location for pumping stations in the Galovica drainage area of Serbia: the AHP approach for sustainable development. Bus. Strateg. Environ. 16(7), 502–511 (Wiley) (2007) Srdjevic, Z., Kolarov, V., Srdjevic, B.: Finding the best location for pumping stations in the Galovica drainage area of Serbia: the AHP approach for sustainable development. Bus. Strateg. Environ. 16(7), 502–511 (Wiley) (2007)
44.
Zurück zum Zitat Fleischmann, A., Schmidt, W., Stary, Ch., Obermeier, St, Börger, E.: Subject-oriented business process management. Springer, Heidelberg (2012)CrossRef Fleischmann, A., Schmidt, W., Stary, Ch., Obermeier, St, Börger, E.: Subject-oriented business process management. Springer, Heidelberg (2012)CrossRef
45.
Zurück zum Zitat Cronholm, S., Goldkuhl, G.: Strategies for information systems evaluation—six generic types. Electron. J. Inf. Syst. Eval. 6(2), 65–74 (2003) Cronholm, S., Goldkuhl, G.: Strategies for information systems evaluation—six generic types. Electron. J. Inf. Syst. Eval. 6(2), 65–74 (2003)
46.
Zurück zum Zitat Walsham, G.: Interpreting information systems in organisations. Wiley, Hoboken (1993) Walsham, G.: Interpreting information systems in organisations. Wiley, Hoboken (1993)
47.
Zurück zum Zitat Patton, M.Q.: Qualitative evaluation and research methods, 2nd edn. Sage Publications, London (1990) Patton, M.Q.: Qualitative evaluation and research methods, 2nd edn. Sage Publications, London (1990)
48.
Zurück zum Zitat Remenyi, D., Sherwood-Smith, M.: Maximise information systems value by continuous participative evaluation. Logist. Inf. Manag. 12(1/2), 14–31 (1999)CrossRef Remenyi, D., Sherwood-Smith, M.: Maximise information systems value by continuous participative evaluation. Logist. Inf. Manag. 12(1/2), 14–31 (1999)CrossRef
49.
Zurück zum Zitat Hirschheim, R., Smithson, S.: A critical analysis of information systems evaluation. In: Davis, G.B. (ed.) IS assessment: issues and changes. North-Holland, Amsterdam (1988) Hirschheim, R., Smithson, S.: A critical analysis of information systems evaluation. In: Davis, G.B. (ed.) IS assessment: issues and changes. North-Holland, Amsterdam (1988)
50.
Zurück zum Zitat Moon, B.M., Hoffman, R.R., Novak, J.D., Cańas, A.J.: Applied concept mapping: capturing, analyzing and organizing knowledge. CRC Press, New York (2011) Moon, B.M., Hoffman, R.R., Novak, J.D., Cańas, A.J.: Applied concept mapping: capturing, analyzing and organizing knowledge. CRC Press, New York (2011)
51.
Zurück zum Zitat Woolrych, A., Hornbæk, K., Frøkjær, E., Cockton, G.: Ingredients and meals rather than recipes: a proposal for research that does not treat usability evaluation methods as indivisible wholes. Int. J. Hum. Comput Interact 27(10), 940–970 (2011)CrossRef Woolrych, A., Hornbæk, K., Frøkjær, E., Cockton, G.: Ingredients and meals rather than recipes: a proposal for research that does not treat usability evaluation methods as indivisible wholes. Int. J. Hum. Comput Interact 27(10), 940–970 (2011)CrossRef
52.
Zurück zum Zitat Blandford, A., Keith, S., Connell, I., Edwards, H.: Analytical usability evaluation for digital libraries: a case study. In Proc. ACM/IEEE joint conference on digital libraries. pp. 27–36 (2004) Blandford, A., Keith, S., Connell, I., Edwards, H.: Analytical usability evaluation for digital libraries: a case study. In Proc. ACM/IEEE joint conference on digital libraries. pp. 27–36 (2004)
53.
Zurück zum Zitat Blandford, A., Keith, S., Fields, B.: Claims analysis ‘in the wild’: a case study on digital library development. Int. J. Hum. Comput. Interact. 21.2, 197–218 Blandford, A., Keith, S., Fields, B.: Claims analysis ‘in the wild’: a case study on digital library development. Int. J. Hum. Comput. Interact. 21.2, 197–218
Metadaten
Titel
Guiding situated method transfer in design and evaluation
Exploring concepts, activities and process
verfasst von
Stefan Cronholm
Matthias Neubauer
Christian Stary
Publikationsdatum
01.06.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Universal Access in the Information Society / Ausgabe 2/2015
Print ISSN: 1615-5289
Elektronische ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-013-0336-x

Weitere Artikel der Ausgabe 2/2015

Universal Access in the Information Society 2/2015 Zur Ausgabe

Premium Partner