ABSTRACT
We present a design approach for rapid fabrication of high fidelity interactive shape-changing displays using bespoke semi-solid surfaces. This is achieved by segmenting virtual representations of the given data and mapping it to a dynamic physical polygonal surface. First, we establish the design and fabrication approach for generating semi-solid reconfigurable surfaces. Secondly, we demonstrate the generalizability of this approach by presenting design sessions using datasets provided by experts from a diverse range of domains. Thirdly, we evaluate user engagement with the prototype hardware systems that are built. We learned that all participants, all of whom had no previous interaction with shape-changing displays, were able to successfully design interactive hardware systems that physically represent data specific to their work. Finally, we reflect on the content generated to understand if our approach is effective at representing intended output based on a set of user defined functionality requirements.
Supplemental Material
- National Land Survey of Iceland. (1997). Retrieved September 5, 2016 from: http://www.lmi.is/en/.Google Scholar
- Franz Aurenhammer, Voronoi Diagrams - A Survey of a Fundamental Geometric Data Structure. ACM Comput. Surv., 1991. 23(3): p. 345--405. Google ScholarDigital Library
- Mika Barr. folding-A-part - Mika Barr. (2016). Retrieved August 25, 2016 from: http://www.mikabarr.com/folding-a-part.Google Scholar
- Marcelo Coelho and Jamie Zigelbaum, Shapechanging interfaces. Personal and Ubiquitous Computing, 2011. 15(2): p. 161--173. Google ScholarDigital Library
- Marcelo Coelho and Jamie Zigelbaum, Shapechanging interfaces. Personal Ubiquitous Comput., 2011. 15(2): p. 161--173. Google ScholarDigital Library
- Dhairya Dand and Robert Hemsley, Obake: interactions on a 2.5D elastic display, in Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology. 2013, ACM: St. Andrews, Scotland, United Kingdom. p. 109--110. Google ScholarDigital Library
- Mark Goulthorpe; Mark Burry; Grant Dunlop, Aegis Hyposurface: The Bordering of University and Practice. In Proc. of ACADIA, 2001, Association for Computer--Aided Design in Architecture, 2001: p. pp. 344--349.Google Scholar
- Aluna Everitt, Faisal Taher, and Jason Alexander, ShapeCanvas: An Exploration of Shape-Changing Content Generation by Members of the Public, in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2016, ACM: Santa Clara, California, USA. p. 2778--2782. Google ScholarDigital Library
- Petr Felkel and Stepan Obdrzalek. Straight skeleton implementation. in Proceedings of spring conference on computer graphics. 1998. Citeseer.Google Scholar
- Georg Fischer. Image Triangulation Experiment. (2013) Retrieved April 12, 2016 from: https://github.com/snorpey/triangulation.Google Scholar
- Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii, Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices, in Proceedings of the 25th annual ACM symposium on User interface software and technology. 2012, ACM: Cambridge, Massachusetts, USA. p. 519--528. Google ScholarDigital Library
- Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii, inFORM: dynamic physical affordances and constraints through shape and object actuation, in Proceedings of the 26th annual ACM symposium on User interface software and technology. 2013, ACM: St. Andrews, Scotland, United Kingdom. p. 417--426. Google ScholarDigital Library
- S. Ganapathy and T. G. Dennehy, A new general triangulation method for planar contours, in Proceedings of the 9th annual conference on Computer graphics and interactive techniques. 1982, ACM: Boston, Massachusetts, USA. p. 69--75. Google ScholarDigital Library
- John Hardy and Jason Alexander, Toolkit support for interactive projected displays, in Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia. 2012, ACM: Ulm, Germany. p. 1--10. Google ScholarDigital Library
- John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander, ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers, in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2015, ACM: Seoul, Republic of Korea. p. 19--28. Google ScholarDigital Library
- Chris Harrison and Scott E. Hudson, Providing dynamically changeable physical buttons on a visual display, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2009, ACM: Boston, MA, USA. p. 299--308. Google ScholarDigital Library
- Hiroshi Ishii, Daniel Leithinger, Sean Follmer, Amit Zoran, Philipp Schoessler, and Jared Counts, TRANSFORM: Embodiment of "Radical Atoms" at Milano Design Week, in Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. 2015, ACM: Seoul, Republic of Korea. p. 687--694. Google ScholarDigital Library
- Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura, Project FEELEX: adding haptic surface to graphics, in Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 2001, ACM. p. 469--476. Google ScholarDigital Library
- Sungjune Jang, Lawrence H. Kim, Kesler Tanner, Hiroshi Ishii, and Sean Follmer, Haptic Edge Display for Mobile Tactile Interaction, in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2016, ACM: Santa Clara, California, USA. p. 3706--3716. Google ScholarDigital Library
- Daniel Leithinger, Sean Follmer, Alex Olwal, Samuel Luescher, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii, Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2013, ACM: Paris, France. p. 1441--1450. Google ScholarDigital Library
- Daniel Leithinger and Hiroshi Ishii, Relief: a scalable actuated shape display, in Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. 2010, ACM: Cambridge, Massachusetts, USA. p. 221--222. Google ScholarDigital Library
- Mathias Müller, Anja Knöfel, Thomas Gründer, Ingmar Franke, and Rainer Groh, FlexiWall: Exploring Layered Data with Elastic Displays, in Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces. 2014, ACM: Dresden, Germany. p. 439--442. Google ScholarDigital Library
- Ivan Poupyrev, Tatsushi Nashida, Shigeaki Maruyama, Jun Rekimoto, and Yasufumi Yamaji, Lumen: interactive visual and shape display for calm computing, in ACM SIGGRAPH 2004 Emerging technologies. 2004, ACM: Los Angeles, California. p. 17. Google ScholarDigital Library
- Ivan Poupyrev, Tatsushi Nashida, and Makoto Okabe, Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays, in Proceedings of the 1st international conference on Tangible and embedded interaction. 2007, ACM: Baton Rouge, Louisiana. p. 205--212. Google ScholarDigital Library
- Jie Qi and Leah Buechley, Animating paper using shape memory alloys, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2012, ACM: Austin, Texas, USA. p. 749--752. Google ScholarDigital Library
- Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk, Shape-changing interfaces: a review of the design space and open research questions, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2012, ACM: Austin, Texas, USA. p. 735--744. Google ScholarDigital Library
- Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian, Morphees: toward high "shape resolution" in self-actuated flexible mobile devices, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2013, ACM: Paris, France. p. 593--602. Google ScholarDigital Library
- Jim Ruppert, A Delaunay refinement algorithm for quality 2-dimensional mesh generation. Journal of algorithms, 1995. 18(3): p. 548--585. Google ScholarDigital Library
- Deepak Ranjan Sahoo, Kasper Hornbæk, and Sriram Subramanian, TableHop: An Actuated Fabric Display Using Transparent Electrodes, in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2016, ACM: Santa Clara, California, USA. p. 3767--3780. Google ScholarDigital Library
- Andrew Stevenson, Christopher Perez, and Roel Vertegaal, An inflatable hemispherical multi-touch display, in Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction. 2011, ACM: Funchal, Portugal. p. 289292. Google ScholarDigital Library
- Elisa Strozyk. "Dyed - Wooden - Textiles" Wall Hangings/Plaids. (2016). Retrieved June 16, 2016 from: http://www.elisastrozyk.de/seite/dyedtextiles.html.Google Scholar
- Miriam Sturdee, John Hardy, Nick Dunn, and Jason Alexander, A Public Ideation of Shape-Changing Applications, in Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces. 2015, ACM: Madeira, Portugal. p. 219--228. Google ScholarDigital Library
- Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander, Exploring Interactions with Physically Dynamic Bar Charts, in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2015, ACM: Seoul, Republic of Korea. p. 3237--3246. Google ScholarDigital Library
- Giovanni Maria Troiano, Esben Warming Pedersen, and Kasper Hornbæk, User-defined gestures for elastic, deformable displays, in Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces. 2014, ACM: Como, Italy. p. 1--8. Google ScholarDigital Library
- Jessica Tsimeris, Colin Dedman, Michael Broughton, and Tom Gedeon, ForceForm: a dynamically deformable interactive surface, in Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. 2013, ACM: St. Andrews, Scotland, United Kingdom. p. 175--178. Google ScholarDigital Library
- Y. Watanabe, A. Cassinelli, T. Komuro, and M. Ishikawa. The deformable workspace: A membrane between real and virtual space. in Horizontal Interactive Human Computer Systems, 2008. TABLETOP 2008. 3rd IEEE International Workshop on. 2008.Google ScholarCross Ref
- Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii, PneUI: pneumatically actuated soft composite materials for shape changing interfaces, in Proceedings of the 26th annual ACM symposium on User interface software and technology. 2013, ACM: St. Andrews, Scotland, United Kingdom. p. 13--22. Google ScholarDigital Library
- Kyungwon Yun, JunBong Song, Keehong Youn, Sungmin Cho, and Hyunwoo Bang, ElaScreen: exploring multi-dimensional data using elastic screen, in CHI '13 Extended Abstracts on Human Factors in Computing Systems. 2013, ACM: Paris, France. p. 1311--1316. Google ScholarDigital Library
Index Terms
- PolySurface: A Design Approach for Rapid Prototyping of Shape-Changing Displays Using Semi-Solid Surfaces
Recommendations
Tangible Data, explorations in data physicalization
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied InteractionHumans have represented data in many forms for thousands of years, yet the main sensory channel we use to perceive these representations today still remains largely exclusive to sight. Recent developments, such as advances in digital fabrication, ...
Exploring Axisymmetric Shape-Change’s Purposes and Allure for Ambient Display: 16 Potential Use Cases and a Two-Month Preliminary Study on Daily Notifications
TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied InteractionIn the last decade, HCI research has proposed promising technologies for shape-changing interfaces. The usefulness and the user experience of shape-change are, however, still to be explored and understood. This paper extends the understanding of the ...
Exploring the Challenges of Making Data Physical
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsPhysical representations of data have existed for thousands of years. However, it is only now that advances in digital fabrication, actuated tangible interfaces, and shape-changing displays can support the emerging area of 'Data Physicalization' [6]: ...
Comments