Skip to main content
Top

2019 | OriginalPaper | Chapter

Side-by-Side Human–Computer Design Using a Tangible User Interface

Authors : Matthew V. Law, Nikhil Dhawan, Hyunseung Bang, So-Yeon Yoon, Daniel Selva, Guy Hoffman

Published in: Design Computing and Cognition '18

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present a digital–physical system to support human–computer collaborative design. The system consists of a sensor-instrumented “sand table” functioning as a tangible space for exploring early-stage design decisions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
We initially intended to explore a third hypothesis addressing learning outcomes but were unable to do so due to an error in data collection.
 
2
In the case that user-generated designs dominated any configurations on the reference frontier, they were assigned the negation of this distance. Overall, we acknowledge that this choice of reference may limit the validity of our finding to a small time or a small number of function evaluations
 
Literature
1.
go back to reference Allen JF, Guinn CI, Horvtz E (1999) Mixed-initiative interaction. IEEE Intel Syst Appl 14(5):14–23CrossRef Allen JF, Guinn CI, Horvtz E (1999) Mixed-initiative interaction. IEEE Intel Syst Appl 14(5):14–23CrossRef
2.
go back to reference Arias E, Eden H, Fischer G, Gorman A, Scharff E (2000) Transcending the individual human mind–creating shared understanding through collaborative design. ACM Trans Computer-Human Int (TOCHI) 7(1):84–113CrossRef Arias E, Eden H, Fischer G, Gorman A, Scharff E (2000) Transcending the individual human mind–creating shared understanding through collaborative design. ACM Trans Computer-Human Int (TOCHI) 7(1):84–113CrossRef
3.
go back to reference Arrow KJ (2012) Social choice and individual values, vol 12. Yale University Press Arrow KJ (2012) Social choice and individual values, vol 12. Yale University Press
4.
go back to reference Babbar-Sebens M, Minsker BS (2012) Interactive genetic algorithm with mixed initiative interaction for multi-criteria ground water monitoring design. Appl Soft Comput J 12(1):182–195CrossRef Babbar-Sebens M, Minsker BS (2012) Interactive genetic algorithm with mixed initiative interaction for multi-criteria ground water monitoring design. Appl Soft Comput J 12(1):182–195CrossRef
5.
go back to reference Balling R (1999) Design by shopping: a new paradigm? In: Proceedings of the third world congress of structural and multidisciplinary optimization (WCSMO-3), vol 1, pp 295–297 Balling R (1999) Design by shopping: a new paradigm? In: Proceedings of the third world congress of structural and multidisciplinary optimization (WCSMO-3), vol 1, pp 295–297
6.
go back to reference Chen R, Wang X (2008) An empirical study on tangible augmented reality learning space for design skill transfer. Tsinghua Science and Technology 13 Supple (October):13–18 Chen R, Wang X (2008) An empirical study on tangible augmented reality learning space for design skill transfer. Tsinghua Science and Technology 13 Supple (October):13–18
7.
go back to reference Cho SB (2002) Towards creative evolutionary systems with interactive genetic algorithm. Appl Intel 16(2):129–138CrossRef Cho SB (2002) Towards creative evolutionary systems with interactive genetic algorithm. Appl Intel 16(2):129–138CrossRef
8.
go back to reference Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evol Comput 6(2):182–197CrossRef Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evol Comput 6(2):182–197CrossRef
9.
go back to reference Deb K, Karthik S et al (2007) Dynamic multi-objective optimization and decision-making using modified nsga-ii: a case study on hydro-thermal power scheduling. In: International conference on evolutionary multi-criterion optimization. Springer, pp 803–817 Deb K, Karthik S et al (2007) Dynamic multi-objective optimization and decision-making using modified nsga-ii: a case study on hydro-thermal power scheduling. In: International conference on evolutionary multi-criterion optimization. Springer, pp 803–817
10.
go back to reference Dhanalakshmi S, Kannan S, Mahadevan K, Baskar S (2011) Application of modified nsga-ii algorithm to combined economic and emission dispatch problem. Int J Electr Power Energy Syst 33(4):992–1002CrossRef Dhanalakshmi S, Kannan S, Mahadevan K, Baskar S (2011) Application of modified nsga-ii algorithm to combined economic and emission dispatch problem. Int J Electr Power Energy Syst 33(4):992–1002CrossRef
11.
go back to reference Do-Lenh S, Jermann P, Cuendet S, Zufferey G, Dillenbourg P (2010) Task performance versus learning outcomes: a study of a tangible user interface in the classroom. In: European conference on technology enhanced learning. Springer, pp 78–92 Do-Lenh S, Jermann P, Cuendet S, Zufferey G, Dillenbourg P (2010) Task performance versus learning outcomes: a study of a tangible user interface in the classroom. In: European conference on technology enhanced learning. Springer, pp 78–92
12.
go back to reference Durillo JJ, Nebro AJ (2011) jmetal: A java framework for multi-objective optimization. Adv Eng Softw 42(10):760–771CrossRef Durillo JJ, Nebro AJ (2011) jmetal: A java framework for multi-objective optimization. Adv Eng Softw 42(10):760–771CrossRef
13.
go back to reference Egan P, Cagan J (2016) Human and computational approaches for design problem-solving. In: Experimental design research. Springer, pp 187–205 Egan P, Cagan J (2016) Human and computational approaches for design problem-solving. In: Experimental design research. Springer, pp 187–205
14.
go back to reference Ferguson G, Allen JF et al (1998) Trips: an integrated intelligent problem-solving assistant. In: AAAI/IAAI, pp 567–572 Ferguson G, Allen JF et al (1998) Trips: an integrated intelligent problem-solving assistant. In: AAAI/IAAI, pp 567–572
15.
go back to reference Fischer G (2004) Social creativity: turning barriers into opportunities for collaborative design. In: Proceedings of the eighth conference on participatory design: Artful integration: interweaving media, materials and practices-Volume 1, ACM, pp 152–161 Fischer G (2004) Social creativity: turning barriers into opportunities for collaborative design. In: Proceedings of the eighth conference on participatory design: Artful integration: interweaving media, materials and practices-Volume 1, ACM, pp 152–161
16.
go back to reference Gero JS (1998) Conceptual designing as a sequence of situated acts. In: Artificial intelligence in structural engineering. Springer, pp 165–177 Gero JS (1998) Conceptual designing as a sequence of situated acts. In: Artificial intelligence in structural engineering. Springer, pp 165–177
17.
go back to reference Grosz BJ (1996) Collaborative systems (aaai-94 presidential address). AI Mag 17(2):67MathSciNet Grosz BJ (1996) Collaborative systems (aaai-94 presidential address). AI Mag 17(2):67MathSciNet
18.
go back to reference Hay L, Duffy AHB, McTeague C, Pidgeon LM, Vuletic T, Grealy M (2017) A systematic review of protocol studies on conceptual design cognition: design as search andexploration. Des Sci 3:e10. arXiv:1011.1669v3 Hay L, Duffy AHB, McTeague C, Pidgeon LM, Vuletic T, Grealy M (2017) A systematic review of protocol studies on conceptual design cognition: design as search andexploration. Des Sci 3:e10. arXiv:1011.1669v3
19.
go back to reference Hitomi N, Bang H, Selva D (2017) Extracting and applying knowledge with adaptive knowledge-driven optimization to architect an earth observing satellite system. AIAA Information Systems-AIAA Infotech@ Aerospace, p 0794 Hitomi N, Bang H, Selva D (2017) Extracting and applying knowledge with adaptive knowledge-driven optimization to architect an earth observing satellite system. AIAA Information Systems-AIAA Infotech@ Aerospace, p 0794
20.
go back to reference Ishibuchi H, Masuda H, Tanigaki Y, Nojima Y (2015) Modified distance calculation in generational distance and inverted generational distance. EMO 2:110–125 Ishibuchi H, Masuda H, Tanigaki Y, Nojima Y (2015) Modified distance calculation in generational distance and inverted generational distance. EMO 2:110–125
21.
go back to reference Ishii H, Ratti C, Piper B, Wang Y, Biderman A, Ben-Joseph E (2004) Bringing clay and sand into digital design—continuous tangible user interfaces. BT Technol J 22(4):287–299CrossRef Ishii H, Ratti C, Piper B, Wang Y, Biderman A, Ben-Joseph E (2004) Bringing clay and sand into digital design—continuous tangible user interfaces. BT Technol J 22(4):287–299CrossRef
22.
go back to reference Jeyadevi S, Baskar S, Babulal C, Iruthayarajan MW (2011) Solving multiobjective optimal reactive power dispatch using modified nsga-ii. Int J Electr Power Energy Syst 33(2):219–228CrossRef Jeyadevi S, Baskar S, Babulal C, Iruthayarajan MW (2011) Solving multiobjective optimal reactive power dispatch using modified nsga-ii. Int J Electr Power Energy Syst 33(2):219–228CrossRef
23.
go back to reference Jordà S, Geiger G, Alonso M, Kaltenbrunner M (2007) The reactable: exploring the synergy between live music performance and tabletop tangible interfaces. In: Proceedings of the 1st international conference on Tangible and embedded interaction, ACM, pp 139–146 Jordà S, Geiger G, Alonso M, Kaltenbrunner M (2007) The reactable: exploring the synergy between live music performance and tabletop tangible interfaces. In: Proceedings of the 1st international conference on Tangible and embedded interaction, ACM, pp 139–146
24.
go back to reference Kaltenbrunner M (2009) Reactivision and tuio: a tangible tabletop toolkit. In: Proceedings of the ACM international conference on interactive tabletops and surfaces, ACM, pp 9–16 Kaltenbrunner M (2009) Reactivision and tuio: a tangible tabletop toolkit. In: Proceedings of the ACM international conference on interactive tabletops and surfaces, ACM, pp 9–16
25.
go back to reference Kicinger R, Arciszewski T, De Jong K (2005) Evolutionary computation and structural design: A survey of the state-of-the-art. Comput Struct 83(23):1943–1978CrossRef Kicinger R, Arciszewski T, De Jong K (2005) Evolutionary computation and structural design: A survey of the state-of-the-art. Comput Struct 83(23):1943–1978CrossRef
26.
go back to reference Kim HS, Cho SB (2000) Application of interactive genetic algorithm to fashion design. Eng Appl Artif Intell 13(6):635–644CrossRef Kim HS, Cho SB (2000) Application of interactive genetic algorithm to fashion design. Eng Appl Artif Intell 13(6):635–644CrossRef
27.
go back to reference Kim M, Maher M (2005) Comparison of designers using a tangible user interface and graphical user interface and impact on spatial cognition. Proc Human Behav Des 5 Kim M, Maher M (2005) Comparison of designers using a tangible user interface and graphical user interface and impact on spatial cognition. Proc Human Behav Des 5
28.
go back to reference Kim MJ, Maher ML (2008) The impact of tangible user interfaces on spatial cognition during collaborative design. Des Stud 29(3):222–253CrossRef Kim MJ, Maher ML (2008) The impact of tangible user interfaces on spatial cognition during collaborative design. Des Stud 29(3):222–253CrossRef
29.
go back to reference Laugwitz B, Held T, Schrepp M (2008) Construction and evaluation of a user experience questionnaire. In: Symposium of the Austrian HCI and usability engineering group. Springer, pp 63–76 Laugwitz B, Held T, Schrepp M (2008) Construction and evaluation of a user experience questionnaire. In: Symposium of the Austrian HCI and usability engineering group. Springer, pp 63–76
30.
go back to reference Laumanns M, Thiele L, Deb K, Zitzler E (2002) Combining convergence and diversity in evolutionary multiobjective optimization. Evol Comput 10(3):263–282CrossRef Laumanns M, Thiele L, Deb K, Zitzler E (2002) Combining convergence and diversity in evolutionary multiobjective optimization. Evol Comput 10(3):263–282CrossRef
31.
32.
go back to reference Maher ML, Lee L (2017) Designing for gesture and tangible interaction. Synth Lect Human-Centered Interact 10(2):i–111 Maher ML, Lee L (2017) Designing for gesture and tangible interaction. Synth Lect Human-Centered Interact 10(2):i–111
34.
go back to reference Ozgur A, Johal W, Mondada F, Dillenbourg P (2017) Windfield: learning wind meteorology with handheld haptic robots. In: HRI’17: ACM/IEEE international conference on human-robot interaction proceedings, ACM, EPFL-CONF-224130, pp 156–165 Ozgur A, Johal W, Mondada F, Dillenbourg P (2017) Windfield: learning wind meteorology with handheld haptic robots. In: HRI’17: ACM/IEEE international conference on human-robot interaction proceedings, ACM, EPFL-CONF-224130, pp 156–165
35.
go back to reference Patten J, Ishii H (2000) A comparison of spatial organization strategies in graphical and tangible user interfaces. In: Proceedings of DARE 2000 on designing augmented reality environments, ACM, pp 41–50 Patten J, Ishii H (2000) A comparison of spatial organization strategies in graphical and tangible user interfaces. In: Proceedings of DARE 2000 on designing augmented reality environments, ACM, pp 41–50
36.
go back to reference Petersson K, Kyroudi A, Bourhis J, Ceberg C, Knöös T, Bochud F, Moeckli R (2017) A clinical distance measure for evaluating treatment plan quality difference with pareto fronts in radiotherapy. Phys Imaging Radiat Oncol 3:53–56CrossRef Petersson K, Kyroudi A, Bourhis J, Ceberg C, Knöös T, Bochud F, Moeckli R (2017) A clinical distance measure for evaluating treatment plan quality difference with pareto fronts in radiotherapy. Phys Imaging Radiat Oncol 3:53–56CrossRef
37.
go back to reference Ramchurn SD, Wu F, Jiang W, Fischer JE, Reece S, Roberts S, Rodden T, Greenhalgh C, Jennings NR (2016) Human-agent collaboration for disaster response. Auton Agent Multi-Agent Syst 30(1):82–111CrossRef Ramchurn SD, Wu F, Jiang W, Fischer JE, Reece S, Roberts S, Rodden T, Greenhalgh C, Jennings NR (2016) Human-agent collaboration for disaster response. Auton Agent Multi-Agent Syst 30(1):82–111CrossRef
38.
go back to reference Reed P, Minsker BS, Goldberg DE (2003) Simplifying multiobjective optimization: an automated design methodology for the nondominated sorted genetic algorithm-ii. Water Resour Res 39(7) Reed P, Minsker BS, Goldberg DE (2003) Simplifying multiobjective optimization: an automated design methodology for the nondominated sorted genetic algorithm-ii. Water Resour Res 39(7)
39.
go back to reference Selva D (2014a) Experiments in knowledge-intensive system architecting: interactive architecture optimization. In: Aerospace conference, 2014 IEEE, IEEE, pp 1–12 Selva D (2014a) Experiments in knowledge-intensive system architecting: interactive architecture optimization. In: Aerospace conference, 2014 IEEE, IEEE, pp 1–12
40.
go back to reference Selva D (2014b) Knowledge-intensive global optimization of earth observing system architectures: a climate-centric case study. In: Sensors, systems, and next-generation satellites XVIII, international society for optics and photonics, vol 9241, p 92411S Selva D (2014b) Knowledge-intensive global optimization of earth observing system architectures: a climate-centric case study. In: Sensors, systems, and next-generation satellites XVIII, international society for optics and photonics, vol 9241, p 92411S
41.
go back to reference Selva D, Cameron BG, Crawley EF (2014) Rule-based system architecting of earth observing systems: earth science decadal survey. J Spacecraft Rockets Selva D, Cameron BG, Crawley EF (2014) Rule-based system architecting of earth observing systems: earth science decadal survey. J Spacecraft Rockets
42.
go back to reference Shen W, Hao Q, Li W (2008) Computer supported collaborative design: retrospective and perspective. Comput Ind 59(9):855–862CrossRef Shen W, Hao Q, Li W (2008) Computer supported collaborative design: retrospective and perspective. Comput Ind 59(9):855–862CrossRef
43.
go back to reference Shirado H, Christakis NA (2017) Locally noisy autonomous agents improve global human coordination in network experiments. Nature 545(7654):370–374CrossRef Shirado H, Christakis NA (2017) Locally noisy autonomous agents improve global human coordination in network experiments. Nature 545(7654):370–374CrossRef
44.
go back to reference Simon HA (1996) The sciences of the artificial. MIT press Simon HA (1996) The sciences of the artificial. MIT press
45.
go back to reference Smithers T, Conkie A, Doheny J, Logan B, Millington K (1989) Design as intelligent behavior: an ai in design research program. In: Gero JS (ed) Artificial intelligence in design Smithers T, Conkie A, Doheny J, Logan B, Millington K (1989) Design as intelligent behavior: an ai in design research program. In: Gero JS (ed) Artificial intelligence in design
46.
go back to reference Smithwick D, Kirsh D, Sass L (2017) Designerly pick and place: coding physical model making to inform material-based robotic interaction. In: Design computing and cognition’16. Springer, pp 419–436 Smithwick D, Kirsh D, Sass L (2017) Designerly pick and place: coding physical model making to inform material-based robotic interaction. In: Design computing and cognition’16. Springer, pp 419–436
47.
go back to reference Starcic AI, Zajc M (2011) An interactive tangible user interface application for learning addition concepts_1217 131. 135. Br J Edu Technol 42(6):E131–E135CrossRef Starcic AI, Zajc M (2011) An interactive tangible user interface application for learning addition concepts_1217 131. 135. Br J Edu Technol 42(6):E131–E135CrossRef
48.
go back to reference Thornton C, Du Boulay B (2012) Artificial intelligence through search. Springer Science and Business Media Thornton C, Du Boulay B (2012) Artificial intelligence through search. Springer Science and Business Media
49.
go back to reference Ullmer B, Ishii H (1997) The metadesk: models and prototypes for tangible user interfaces. In: Proceedings of the 10th annual ACM symposium on user interface software and technology, ACM, pp 223–232 Ullmer B, Ishii H (1997) The metadesk: models and prototypes for tangible user interfaces. In: Proceedings of the 10th annual ACM symposium on user interface software and technology, ACM, pp 223–232
50.
go back to reference Van Veldhuizen DA, Lamont GB (1998) Evolutionary computation and convergence to a pareto front. In: Late breaking papers at the genetic programming 1998 conference, pp 221–228 Van Veldhuizen DA, Lamont GB (1998) Evolutionary computation and convergence to a pareto front. In: Late breaking papers at the genetic programming 1998 conference, pp 221–228
51.
go back to reference Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: the panas scales. J Pers Soc Psychol 54(6):1063CrossRef Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: the panas scales. J Pers Soc Psychol 54(6):1063CrossRef
52.
go back to reference Xie L, Antle AN, Motamedi N (2008) Are tangibles more fun? comparing children’s enjoyment and engagement using physical, graphical and tangible user interfaces. In: Proceedings of the 2nd international conference on tangible and embedded interaction, ACM, pp 191–198 Xie L, Antle AN, Motamedi N (2008) Are tangibles more fun? comparing children’s enjoyment and engagement using physical, graphical and tangible user interfaces. In: Proceedings of the 2nd international conference on tangible and embedded interaction, ACM, pp 191–198
53.
go back to reference Zitzler E, Brockhoff D, Thiele L (2007) The hypervolume indicator revisited: on the design of pareto-compliant indicators via weighted integration. In: Evolutionary multi-criterion optimization. Springer, pp 862–876 Zitzler E, Brockhoff D, Thiele L (2007) The hypervolume indicator revisited: on the design of pareto-compliant indicators via weighted integration. In: Evolutionary multi-criterion optimization. Springer, pp 862–876
Metadata
Title
Side-by-Side Human–Computer Design Using a Tangible User Interface
Authors
Matthew V. Law
Nikhil Dhawan
Hyunseung Bang
So-Yeon Yoon
Daniel Selva
Guy Hoffman
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-05363-5_9

Premium Partners