ABSTRACT
Modern smartphones are built with capacitive-sensing touchscreens, which can detect anything that is conductive or has a dielectric differential with air. The human finger is an example of such a dielectric, and works wonderfully with such touchscreens. However, touch interactions are disrupted by raindrops, water smear, and wet fingers because capacitive touchscreens cannot distinguish finger touches from other conductive materials. When users' screens get wet, the screen's usability is significantly reduced. RainCheck addresses this hazard by filtering out potential touch points caused by water to differentiate fingertips from raindrops and water smear, adapting in real-time to restore successful interaction to the user. Specifically, RainCheck uses the low-level raw sensor data from touchscreen drivers and employs precise selection techniques to resolve water-fingertip ambiguity. Our study shows that RainCheck improves gesture accuracy by 75.7%, touch accuracy by 47.9%, and target selection time by 80.0%, making it a successful remedy to interference caused by rain and other water.
Supplemental Material
- Pär-Anders Albinsson and Shumin Zhai. 2003. High Precision Touch Screen Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 105--112. Google ScholarDigital Library
- Michelle Annett, Anoop Gupta, and Walter F. Bischof. 2014. Exploring and Understanding Unintended Touch During Direct Pen Interaction. ACM Trans. Comput.-Hum. Interact. 21, 5, Article 28 (Nov. 2014), 39 pages. Google ScholarDigital Library
- Hrvoje Benko, Andrew D. Wilson, and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 1263--1272. Google ScholarDigital Library
- Xiang 'Anthony' Chen, Tovi Grossman, and George Fitzmaurice. 2014. Swipeboard: A Text Entry Technique for Ultra-small Interfaces That Supports Novice to Expert Transitions. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 615--620. Google ScholarDigital Library
- Cypress.com. 2018. TrueTouch Touchscreen Controllers | Cypress Semiconductor. Retrieved January 21, 2018 from http://www.cypress.com/products/truetouch-touchscreen-controllersGoogle Scholar
- Mayank Goel, Leah Findlater, and Jacob Wobbrock. 2012. WalkType: Using Accelerometer Data to Accomodate Situational Impairments in Mobile Touch Screen Text Entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2687--2696. Google ScholarDigital Library
- Mayank Goel, Jacob Wobbrock, and Shwetak Patel. 2012. GripSense: Using Built-in Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 545--554. Google ScholarDigital Library
- Aamir Haider and Nowell Solish. 2005. Focal hyperhidrosis: diagnosis and management. CMAJ 172, 1 (2005), 69--75. http://www.cmaj.ca/content/172/1/69.full.pdfGoogle ScholarCross Ref
- Ken Hinckley, Michel Pahud, Hrvoje Benko, Pourang Irani, François Guimbretière, Marcel Gavriliu, Xiang 'Anthony' Chen, Fabrice Matulic, William Buxton, and Andrew Wilson. 2014. Sensing Techniques for Tablet+Stylus Interaction. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 605--614. Google ScholarDigital Library
- Ken Hinckley, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. Pen + Touch = New Tools. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, NY, USA, 27--36. Google ScholarDigital Library
- Christian Holz, Senaka Buthpitiya, and Marius Knaust. 2015. Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3011--3014. Google ScholarDigital Library
- Shaun K. Kane, Jacob O. Wobbrock, and Ian E. Smith. 2008. Getting off the Treadmill: Evaluating Walking User Interfaces for Mobile Devices in Public Spaces. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '08). ACM, New York, NY, USA, 109--118. Google ScholarDigital Library
- Gordon Kurtenbach and William Buxton. 1994. User Learning and Performance with Marking Menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94). ACM, New York, NY, USA, 258--264. Google ScholarDigital Library
- Min Lin, Rich Goldman, Kathleen J. Price, Andrew Sears, and Julie Jacko. 2007. How do people tap when walking? An empirical investigation of nomadic data entry. International Journal of Human-Computer Studies 65, 9 (2007), 759 -- 769. Google ScholarDigital Library
- Alexander Mariakakis, Mayank Goel, Md Tanvir Islam Aumi, Shwetak N. Patel, and Jacob O. Wobbrock. 2015. SwitchBack: Using Focus and Saccade Tracking to Guide Users' Attention for Mobile Task Resumption. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2953--2962. Google ScholarDigital Library
- Microchip.com. 2018. 2D maXTouch. Retrieved January 21, 2018 from https://www.microchip.com/design-centers/capacitive-touch-sensing/2d-touch/maxtouchGoogle Scholar
- Sachi Mizobuchi, Mark Chignell, and David Newton. 2005. Mobile Text Entry: Relationship Between Walking Speed and Text Input Task Difficulty. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services (MobileHCI '05). ACM, New York, NY, USA, 122--128. Google ScholarDigital Library
- Stephen Oney, Chris Harrison, Amy Ogan, and Jason Wiese. 2013. ZoomBoard: A Diminutive Qwerty Soft Keyboard Using Iterative Zooming for Ultra-small Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2799--2802. Google ScholarDigital Library
- Antti Oulasvirta, Sakari Tamminen, Virpi Roto, and Jaana Kuorelahti. 2005. Interaction in 4-second Bursts: The Fragmented Nature of Attentional Resources in Mobile HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 919--928. Google ScholarDigital Library
- Jason Pascoe, Nick Ryan, and David Morse. 2000. Using While Moving: HCI Issues in Fieldwork Environments. ACM Trans. Comput.-Hum. Interact. 7, 3 (Sept. 2000), 417--437. Google ScholarDigital Library
- Zhanna Sarsenbayeva, Jorge Goncalves, Juan García, Simon Klakegg, Sirkka Rissanen, Hannu Rintamäki, Jari Hannu, and Vassilis Kostakos. 2016. Situational Impairments to Mobile Interaction in Cold Environments. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 85--96. Google ScholarDigital Library
- Martin Schedlbauer and Jesse Heines. {n. d.}. Schedlbauer, M. and Heines, J. Selecting While Walking Keywords Selecting While Walking: An Investigation of Aiming Performance in a Mobile Work Context.Google Scholar
- Andrew Sears and Ben Shneiderman. 1991. High precision touchscreens: design strategies and comparisons with a mouse. International Journal of Man-Machine Studies 34, 4 (1991), 593--613. Google ScholarDigital Library
- Andrew Sears and Mark Young. 2003. The Human-computer Interaction Handbook. L. Erlbaum Associates Inc., Hillsdale, NJ, USA, Chapter Physical Disabilities and Computing Technologies: An Analysis of Impairments, 482--503. http://dl.acm.org/citation.cfm?id=772072.772105 Google ScholarDigital Library
- Tomoki Shibata, Daniel Afergan, Danielle Kong, Beste F. Yuksel, I. Scott MacKenzie, and Robert J.K. Jacob. 2016. DriftBoard: A Panning-Based Text Entry Technique for Ultra-Small Touchscreens. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 575--582. Google ScholarDigital Library
- STMicroelectronics. 2018. Touchscreen Controllers. Retrieved January 21, 2018 from http://www.st.com/en/mems-and-sensors/touchscreen-controllers.html?querycriteria=productId=SC1717Google Scholar
- Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Penbased Interfaces Using Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 657--666. Google ScholarDigital Library
- Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell, and Chia Shen. 2007. Lucid Touch: A See-through Mobile Device. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 269--278. Google ScholarDigital Library
- JacobO.Wobbrock. 2006. The Future of Mobile Device Research in HCI. Retrieved May 2, 2018 from http://faculty.washington.edu/wobbrock/pubs/chi-06.05.pdfGoogle Scholar
- T. Yamabe and K. Takahashi. 2007. Experiments in Mobile User Interface Adaptation for Walking Users. In The 2007 International Conference on Intelligent Pervasive Computing (IPC 2007). 280--284. Google ScholarDigital Library
- Koji Yatani, Kurt Partridge, Marshall Bern, and Mark W. Newman. 2008. Escape: A Target Selection Technique Using Visually-cued Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 285--294. Google ScholarDigital Library
- Koji Yatani and Khai N. Truong. 2009. An evaluation of stylus-based text entry methods on handheld devices studied in different user mobility states. Pervasive and Mobile Computing 5, 5 (2009), 496 -- 508. Google ScholarDigital Library
- Yeliz Yesilada, Simon Harper, Tianyi Chen, and Shari Trewin. 2010. Small-device users situationally impaired by input. Computers in Human Behavior 26, 3 (2010), 427--435. Google ScholarDigital Library
Index Terms
RainCheck: Overcoming Capacitive Interference Caused by Rainwater on Smartphones
Recommendations
Enhancing Pinch-Drag-Flick Paradigm with Two New Gestures: Two-Finger-Tap for Tablets and Tap&Tap for Smartphones
Human-Computer Interaction – INTERACT 2015AbstractThe mobile versions of services such as Google Maps or Open Street Maps allow the exploration of maps on smartphones and tablets. The gestures used are the pinch to adjust the zoom level and the drag/flick to move the map. In this paper, two new ...
Ergonomic characteristics of gestures for front- and back-of-tablets interaction with grasping hands
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesThe thumb and the fingers have different flexibility, and thus, gestures performed on the back of a held tablet are suggested to be different from ones performed on the touchscreen with the thumb of grasping hands. APIs for back-of-device gesture ...
Touch and gesture: mediating content display, inscriptions, and gestures across multiple devices
Recent advances in computer design and technology have broadened the range of devices enabled for inscription and touch-based interaction and increased their adoption in collaborative work settings. Since most of the past research has focused on optimal ...
Comments