Nur Al-huda Hamdan
Adrian Wagner
Simon Voelker
Jan Borchers
ABSTRACT
We introduce Springlets, expressive, non-vibrating mechanotactile interfaces on the skin. Embedded with shape memory alloy springs, we implement Springlets as thin and flexible stickers to be worn on various body locations, thanks to their silent operation even on the neck and head. We present a technically simple and rapid technique for fabricating a wide range of Springlet interfaces and computer-generated tactile patterns. We developed Springlets for six tactile primitives: pinching, directional stretching, pressing, pulling, dragging, and expanding. A study placing Springlets on the arm and near the head demonstrates Springlets' effectiveness and wearability in both stationary and mobile situations. We explore new interactive experiences in tactile social communication, physical guidance, health interfaces, navigation, and virtual reality gaming, enabled by Springlets' unique and scalable form factor.
Supplemental Material
Available for Download
zip
paper488pvc.zip (1 KB)
Preview video captions
zip
paper488vc.srt.zip (2.2 KB)
Video figure captions
- M. A. Baumann, K. E. MacLean, T. W. Hazelton, and A. McKay. 2010. Emulating Human Attention-Getting Practices with Wearable Haptics. In 2010 IEEE Haptics Symposium. 149--156. Google Scholar
Digital Library
- M Bergamasco, P Dario, and F Salsedo. 1990. Shape memory alloy microactuators. Sensors and Actuators A: Physical 21, 1--3 (1990), 253-- 257.Google ScholarCross Ref
- Marta G. Carcedo, Soon Hau Chua, Simon Perrault, Pawel Wozniak, Raj Joshi, Mohammad Obaid, Morten Fjeld, and Shengdong Zhao. 2016. HaptiColor: Interpolating Color Information As Haptic Feedback to Assist the Colorblind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3572--3583. Google ScholarDigital Library
- F. Chinello, C. Pacchierotti, J. Bimbo, N. G. Tsagarakis, and D. Prattichizzo. 2018. Design and Evaluation of a Wearable Skin Stretch Device for Haptic Guidance. IEEE Robotics and Automation Letters 3, 1 (Jan 2018), 524--531.Google ScholarCross Ref
- Patrick Delmas, Jizhe Hao, and Lise Rodat-Despoix. 2011. Molecular Mechanisms of Mechanotransduction in Mammalian Sensory Neurons. Nature Reviews Neuroscience 12 (09 Feb 2011), 139--153.Google Scholar
- Julia C. Duvall, Lucy E. Dunne, Nicholas Schleif, and Brad Holschuh. 2016. Active "Hugging" Vest for Deep Touch Pressure Therapy. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 458--463. Google ScholarDigital Library
- Dynalloy 2017. DYNALLOY Inc. Retrieved Jan 07, 2019 from http: //www.dynalloy.com/tech_data_springs.phpGoogle Scholar
- Randolph D Easton. 1992. Inherent Problems of Attempts to Apply Sonar and Vibrotactile Sensory Aid Technology to The Perceptual Needs of The Blind. Optometry and vision science: official publication of the American Academy of Optometry 69, 1 (1992), 3--14.Google Scholar
- Gabriele Frediani, Daniele Mazzei, Danilo Emilio De Rossi, and Federico Carpi. 2014. Wearable Wireless Tactile Display for Virtual Interactions with Soft Bodies. Frontiers in bioengineering and biotechnology 2 (2014), 31.Google Scholar
- Jun Gong, Da-Yuan Huang, Teddy Seyed, Te Lin, Tao Hou, Xin Liu, Molin Yang, Boyu Yang, Yuhan Zhang, and Xing-Dong Yang. 2018. Jetto: Using Lateral Force Feedback for Smartwatch Interactions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 426, 14 pages. Google ScholarDigital Library
- Aakar Gupta, Antony Albert Raj Irudayaraj, and Ravin Balakrishnan. 2017. HapticClench: Investigating Squeeze Sensations Using Memory Alloys. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 109--117. Google ScholarDigital Library
- Nur Al-huda Hamdan, Simon Voelker, and Jan Borchers. 2018. Sketch&Stitch: Interactive Embroidery for E-textiles. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 82, 13 pages. Google ScholarDigital Library
- Teng Han, Fraser Anderson, Pourang Irani, and Tovi Grossman. 2018. HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 913--925. Google ScholarDigital Library
- Liang He, Cheng Xu, Ding Xu, and Ryan Brill. 2015. PneuHaptic: Delivering Haptic Cues with a Pneumatic Armband. In Proceedings of the 2015 ACM International Symposium on Wearable Computers (ISWC '15). ACM, New York, NY, USA, 47--48. Google ScholarDigital Library
- J. A. Hirsch and B. Bishop. 1981. Respiratory Sinus Arrhythmia in Humans: How Breathing Pattern Modulates Heart Rate. American Journal of Physiology-Heart and Circulatory Physiology 241, 4 (1981), H620--H629. arXiv:https://doi.org/10.1152/ajpheart.1981.241.4.H620 PMID: 7315987.Google ScholarCross Ref
- Da-Yuan Huang, Teddy Seyed, Linjun Li, Jun Gong, Zhihao Yao, Yuchen Jiao, Xiang 'Anthony' Chen, and Xing-Dong Yang. 2018. Orecchio: Extending Body-Language Through Actuated Static and Dynamic Auricular Postures. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 697--710. Google ScholarDigital Library
- G. Huisman. 2017. Social Touch Technology: A Survey of Haptic Technology for Social Touch. IEEE Transactions on Haptics 10, 3 (July 2017), 391--408.Google ScholarDigital Library
- Alexandra Ion, Edward Jay Wang, and Patrick Baudisch. 2015. Skin Drag Displays: Dragging a Physical Tactor Across the User's Skin Produces a Stronger Tactile Stimulus Than Vibrotactile. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2501--2504. Google ScholarDigital Library
- Jaronie Mohd Jani, Martin Leary, Aleksandar Subic, and Mark A Gibson. 2014. A Review of Shape Memory Alloy Research, Applications and Opportunities. Materials & Design (1980--2015) 56 (2014), 1078--1113.Google Scholar
- Y. S. Jin, H. Y. Chun, E. T. Kim, and S. Kang. 2014. VT-ware: A Wearable Tactile Device for Upper Extremity Motion Guidance. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. 335--340.Google Scholar
- Lynette A Jones, Jacquelyn Kunkel, and Erin Piateski. 2009. Vibrotactile Pattern Recognition on the Arm and Back. Perception 38, 1 (2009), 52-- 68. arXiv:https://doi.org/10.1068/p5914 PMID: 19323136.Google ScholarCross Ref
- Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly Prototyping On-skin User Interfaces Using Skin-friendly Materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, New York, NY, USA, 16--23. Google ScholarDigital Library
- Idin Karuei, Karon E. MacLean, Zoltan Foley-Fisher, Russell MacKenzie, Sebastian Koch, and Mohamed El-Zohairy. 2011. Detecting Vibrations Across the Body in Mobile Contexts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3267--3276. Google ScholarDigital Library
- S. C. Kim, C. H. Kim, G. H. Yang, T. H. Yang, B. K. Han, S. C. Kang, and D. S. Kwon. 2009. Small and lightweight tactile display(SaLT) and its application. In World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 69--74. Google ScholarDigital Library
- Espen Knoop and Jonathan Rossiter. 2015. The Tickler: A Compliant Wearable Tactile Display for Stroking and Tickling. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1133--1138. Google ScholarDigital Library
- I. M. Koo, K. Jung, J. C. Koo, J. D. Nam, Y. K. Lee, and H. R. Choi. 2008. Development of Soft-Actuator-Based Wearable Tactile Display. IEEE Transactions on Robotics 24, 3 (June 2008), 549--558. Google ScholarDigital Library
- Yuki Kuniyasu, Michi Sato, Shogo Fukushima, and Hiroyuki Kajimoto. 2012. Transmission of Forearm Motion by Tangential Deformation of the Skin. In Proceedings of the 3rd Augmented Human International Conference (AH '12). ACM, New York, NY, USA, Article 16, 4 pages. Google ScholarDigital Library
- Jaeyeon Lee and Geehyuk Lee. 2016. Designing a Non-contact Wearable Tactile Display Using Airflows. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 183--194. Google ScholarDigital Library
- Joanne Lo, Doris Jung Lin Lee, Nathan Wong, David Bui, and Eric Paulos. 2016. Skintillates: Designing and Creating Epidermal Interactions. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 853--864. Google ScholarDigital Library
- N Ma, G Song, and H-J Lee. 2004. Position Control of Shape Memory Alloy Actuators with Internal Electrical Resistance Feedback Using Neural Networks. Smart Materials and Structures 13, 4 (2004), 777. http://stacks.iop.org/0964--1726/13/i=4/a=015Google ScholarCross Ref
- M. Magno and D. Boyle. 2017. Wearable Energy Harvesting: From body to battery. In 2017 12th International Conference on Design Technology of Integrated Systems In Nanoscale Era (DTIS). 1--6.Google Scholar
- Yasutoshi Makino, Naoya Asamura, and Hiroyuki Shinoda. 2004. A Whole Palm Tactile Display Using Suction Pressure. In Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 IEEE International Conference on, Vol. 2. 1524--1529 Vol.2.Google ScholarCross Ref
- Kouta Minamizawa, Souichiro Fukamachi, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007. Gravity Grabber: Wearable Haptic Display to Present Virtual Mass Sensation. In ACM SIGGRAPH 2007 Emerging Technologies (SIGGRAPH '07). ACM, New York, NY, USA, Article 8. Google ScholarDigital Library
- C. Pacchierotti, S. Sinclair, M. Solazzi, A. Frisoli, V. Hayward, and D. Prattichizzo. 2017. Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives. IEEE Transactions on Haptics 10, 4 (Oct 2017), 580--600. Google ScholarDigital Library
- Pablo E. Paredes, Yijun Zhou, Nur Al-Huda Hamdan, Stephanie Balters, Elizabeth Murnane, Wendy Ju, and James A. Landay. 2018. Just Breathe: In-Car Interventions for Guided Slow Breathing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 28 (March 2018), 23 pages. Google ScholarDigital Library
- Jerome Pasquero, Scott J. Stobbe, and Noel Stonehouse. 2011. A Haptic Wristwatch for Eyes-free Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3257--3266. Google ScholarDigital Library
- Fabrizio Pece, Juan Jose Zarate, Velko Vechev, Nadine Besse, Olexandr Gudozhnik, Herbert Shea, and Otmar Hilliges. 2017. MagTics: Flexible and Thin Form Factor Magnetic Actuators for Dynamic and Wearable Haptic Feedback. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 143--154. Google ScholarDigital Library
- Henning Pohl, Peter Brandes, Hung Ngo Quang, and Michael Rohs. 2017. Squeezeback: Pneumatic Compression for Notifications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5318--5330. Google ScholarDigital Library
- Helena Pongrac. 2008. Vibrotactile Perception: Examining the Coding of Vibrations and the Just Noticeable Difference under Various Conditions. Multimedia systems 13, 4 (2008), 297--307. Google ScholarDigital Library
- Michael Rietzler, Katrin Plaumann, Taras Kränzle, Marcel Erath, Alexander Stahl, and Enrico Rukzio. 2017. VaiR: Simulating 3D Airflows in Virtual Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5669--5677. Google ScholarDigital Library
- R. Scheibe, M. Moehring, and B. Froehlich. 2007. Tactile Feedback at the Finger Tips for Improved Direct Interaction in Immersive Environments. In 2007 IEEE Symposium on 3D User Interfaces.Google Scholar
- M. Solazzi, W. R. Provancher, A. Frisoli, and M. Bergamasco. 2011. Design of a SMA actuated 2-DoF tactile device for displaying tangential skin displacement. In 2011 IEEE World Haptics Conference. 31--36.Google Scholar
- A. A. Stanley and K. J. Kuchenbecker. 2011. Design of Body-Grounded Tactile Actuators for Playback of Human Physical Contact. In 2011 IEEE World Haptics Conference. 563--568.Google Scholar
- A. A. Stanley and K. J. Kuchenbecker. 2012. Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance. IEEE Transactions on Haptics 5, 3 (Third 2012), 240--251. Google ScholarDigital Library
- Evan Strasnick, Jessica R. Cauchard, and James A. Landay. 2017. BrushTouch: Exploring an Alternative Tactile Method for Wearable Haptics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3120--3125. Google ScholarDigital Library
- Katja Suhonen, Kaisa Väänänen-Vainio-Mattila, and Kalle Mäkelä. 2012. User Experiences and Expectations of Vibrotactile, Thermal and Squeeze Feedback in Interpersonal Communication. In Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers (BCS-HCI '12). British Computer Society, Swinton, UK, UK, 205--214. http://dl.acm.org/citation.cfm?id=2377916.2377939 Google ScholarDigital Library
- Toki 2019. TOKI CORPORATION. Retrieved Jan 07, 2019 from https://www.toki.co.jp/biometal/english/contents.phpGoogle Scholar
- Dzmitry Tsetserukou. 2010. HaptiHug: A Novel Haptic Display for Communication of Hug over a Distance. In Haptics: Generating and Perceiving Tangible Sensations, Astrid M. L. Kappers, Jan B. F. van Erp, Wouter M. Bergmann Tiest, and Frans C. T. van der Helm (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 340--347. Google ScholarDigital Library
- Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2991--3000. Google ScholarDigital Library
- Martin Weigel, Aditya Shekhar Nittala, Alex Olwal, and Jürgen Steimle. 2017. SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3095--3105. Google ScholarDigital Library
- Graham Wilson, Stephen Brewster, Martin Halvey, and Stephen Hughes. 2012. Thermal Icons: Evaluating Structured Thermal Feedback for Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 309--312. Google ScholarDigital Library
- Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 365--378. Google ScholarDigital Library
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 143--146. Google ScholarDigital Library
- Steve Yohanan and Karon E. MacLean. 2012. The Role of Affective Touch in Human-Robot Interaction: Human Intent and Expectations in Touching the Haptic Creature. International Journal of Social Robotics 4, 2 (01 Apr 2012), 163--180.Google ScholarCross Ref
Index Terms
- Springlets: Expressive, Flexible and Silent On-Skin Tactile Interfaces
Recommendations
Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyThis paper introduces Tacttoo, a feel-through interface for electro-tactile output on the user's skin. Integrated in a temporary tattoo with a thin and conformal form factor, it can be applied on complex body geometries, including the fingertip, and is ...
Demonstration of Springlets: Expressive, Flexible and Silent On-Skin Tactile Interfaces
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsWe present Springlets, expressive, non-vibrating mechanotactile interfaces on the skin. Embedded with shape memory alloy springs, we implement Springlets as thin and flexible stickers to be worn on various body locations, thanks to their silent ...
Eyes-free graph legibility: using skin-dragging to provide a tactile graph visualization on the arm
AH '20: Proceedings of the 11th Augmented Human International ConferenceRecent technological advances have enabled novel tactile displays which have mainly focused on providing shorter sensations for notifications and/or simple messages. These have been primarily been used to enhance the user experience. In contrast, ...
Comments