Ken Pfeuffer
Yasmeen Abdrabou
Yomna Abdelrahman
Florian Alt
ABSTRACT
Tablets are attractive for design work anywhere, but 3D manipulations are notoriously difficult. We explore how engaging the stylus and multi-touch in concert can render such tasks easier. We introduce Bi-3D, an interaction concept where touch gestures are combined with 2D pen commands for 3D manipulation. For example, for a fast and intuitive 3D drag & drop technique: the pen drags the object on-screen, and parallel pinch-to-zoom moves it in the third dimension. In this paper, we describe the Bi-3D design space, crossing two-handed input and the degrees-of-freedom (DOF) of 3D manipulation and navigation tasks. We demonstrate sketching and manipulation tools in a prototype 3D design application, where users can fluidly combine 3D operations through alternating and parallel use of the modalities. We evaluate the core technique, bi-manual 3DOF input, against widget and mid-air baselines in an object movement task. We find that Bi-3D is a fast and practical way for multi-dimensional manipulation of graphical objects, promising to facilitate 3D design on stylus and tablet devices.
Supplemental Material
- Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: As-natural-as-possible Sketching System for Creating 3D Curve Models. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (Monterey, CA, USA) (UIST ’08). ACM, New York, NY, USA, 151–160. https://doi.org/10.1145/1449715.1449740Google Scholar
Digital Library
- Ravin Balakrishnan, George Fitzmaurice, Gordon Kurtenbach, and William Buxton. 1999. Digital Tape Drawing. In Proceedings of the 12th Annual ACM Symposium on User Interface Software and Technology (Asheville, North Carolina, USA) (UIST ’99). Association for Computing Machinery, New York, NY, USA, 161–169. https://doi.org/10.1145/320719.322598Google ScholarDigital Library
- Ravin Balakrishnan and Gordon Kurtenbach. 1999. Exploring Bimanual Camera Control and Object Manipulation in 3D Graphics Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). ACM, New York, NY, USA, 56–62. https://doi.org/10.1145/302979.302991Google ScholarDigital Library
- Amartya Banerjee, Jesse Burstyn, Audrey Girouard, and Roel Vertegaal. 2011. Pointable: An In-air Pointing Technique to Manipulate Out-of-reach Targets on Tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS ’11). ACM, New York, NY, USA, 11–20. https://doi.org/10.1145/2076354.2076357Google ScholarDigital Library
- Michel Beaudouin-Lafon and Henry Michael Lassen. 2000. The Architecture and Implementation of CPN2000, a Post-WIMP Graphical Application. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology(San Diego, California, USA) (UIST ’00). Association for Computing Machinery, New York, NY, USA, 181–190. https://doi.org/10.1145/354401.354761Google Scholar
- Hrvoje Benko and Steven Feiner. 2007. Balloon selection: A multi-finger technique for accurate low-fatigue 3d selection. In 2007 IEEE symposium on 3D user interfaces(3D UI ’09). IEEE. https://doi.org/10.1109/3DUI.2007.340778Google ScholarCross Ref
- Peter Brandl, Clifton Forlines, Daniel Wigdor, Michael Haller, and Chia Shen. 2008. Combining and Measuring the Benefits of Bimanual Pen and Direct-touch Interaction on Horizontal Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (Napoli, Italy) (AVI ’08). ACM, New York, NY, USA, 154–161. https://doi.org/10.1145/1385569.1385595Google ScholarDigital Library
- Thomas Butkiewicz, Andrew H. Stevens, and Colin Ware. 2019. Multi-Touch 3D Positioning with the Pantograph Technique. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (Montreal, Quebec, Canada) (I3D ’19). Association for Computing Machinery, New York, NY, USA, Article 13, 9 pages. https://doi.org/10.1145/3306131.3317014Google ScholarDigital Library
- W. Buxton and B. Myers. 1986. A Study in Two-handed Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’86). ACM, New York, NY, USA, 321–326. https://doi.org/10.1145/22627.22390Google ScholarDigital Library
- Drini Cami, Fabrice Matulic, Richard G. Calland, Brian Vogel, and Daniel Vogel. 2018. Unimanual Pen+Touch Input Using Variations of Precision Grip Postures. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology(Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 825–837. https://doi.org/10.1145/3242587.3242652Google ScholarDigital Library
- Xiang Cao and Ravin Balakrishnan. 2003. VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (Vancouver, Canada) (UIST ’03). Association for Computing Machinery, New York, NY, USA, 173–182. https://doi.org/10.1145/964696.964716Google ScholarDigital Library
- Jonathan M. Cohen, Lee Markosian, Robert C. Zeleznik, John F. Hughes, and Ronen Barzel. 1999. An Interface for Sketching 3D Curves. In Proceedings of the 1999 Symposium on Interactive 3D Graphics (Atlanta, Georgia, USA) (I3D ’99). Association for Computing Machinery, New York, NY, USA, 17–21. https://doi.org/10.1145/300523.300655Google ScholarDigital Library
- Philip L. Davidson and Jefferson Y. Han. 2008. Extending 2D Object Arrangement with Pressure-Sensitive Layering Cues. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology(Monterey, CA, USA) (UIST ’08). Association for Computing Machinery, New York, NY, USA, 87–90. https://doi.org/10.1145/1449715.1449730Google Scholar
- Bruno R. De Araùjo, Géry Casiez, and Joaquim A. Jorge. 2012. Mockup Builder: Direct 3D Modeling on and above the Surface in a Continuous Interaction Space. In Proceedings of Graphics Interface 2012 (Toronto, Ontario, Canada) (GI ’12). Canadian Information Processing Society, CAN, 173–180.Google Scholar
- Julie Dorsey, Songhua Xu, Gabe Smedresman, Holly Rushmeier, and Leonard McMillan. 2007. The Mental Canvas: A Tool for Conceptual Architectural Design and Analysis. In Proceedings of the 15th Pacific Conference on Computer Graphics and Applications(PG ’07). IEEE Computer Society, Washington, DC, USA, 201–210. https://doi.org/10.1109/PG.2007.62Google ScholarDigital Library
- Tomas Dorta, Gokce Kinayoglu, and Michael Hoffmann. 2014. Hyve-3D: A New Embodied Interface for Immersive Collaborative 3D Sketching. In ACM SIGGRAPH 2014 Studio (Vancouver, Canada) (SIGGRAPH ’14). Association for Computing Machinery, New York, NY, USA, Article 37, 1 pages. https://doi.org/10.1145/2619195.2656325Google ScholarDigital Library
- Yotam Gingold, Takeo Igarashi, and Denis Zorin. 2009. Structured Annotations for 2D-to-3D Modeling. ACM Trans. Graph. 28, 5 (Dec. 2009), 1–9. https://doi.org/10.1145/1618452.1618494Google ScholarDigital Library
- Yves Guiard. 1987. Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. In Journal of Motor Behavior, Vol. 19. 486–517.Google Scholar
- Mark Hancock, Sheelagh Carpendale, and Andy Cockburn. 2007. Shallow-Depth 3d Interaction: Design and Evaluation of One-, Two- and Three-Touch Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 1147–1156. https://doi.org/10.1145/1240624.1240798Google ScholarDigital Library
- Mark Hancock, Thomas ten Cate, and Sheelagh Carpendale. 2009. Sticky Tools: Full 6DOF Force-Based Interaction for Multi-Touch Tables. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Banff, Alberta, Canada) (ITS ’09). Association for Computing Machinery, New York, NY, USA, 133–140. https://doi.org/10.1145/1731903.1731930Google ScholarDigital Library
- Rorik Henrikson, Bruno De Araujo, Fanny Chevalier, Karan Singh, and Ravin Balakrishnan. 2016. Storeoboard: Sketching Stereoscopic Storyboards. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 4587–4598. https://doi.org/10.1145/2858036.2858079Google ScholarDigital Library
- Ken Hinckley, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. Pen + Touch = New Tools. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). ACM, New York, NY, USA, 27–36. https://doi.org/10.1145/1866029.1866036Google ScholarDigital Library
- Stephanie Houde. 1992. Iterative Design of an Interface for Easy 3-D Direct Manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Monterey, California, USA) (CHI ’92). Association for Computing Machinery, New York, NY, USA, 135–142. https://doi.org/10.1145/142750.142772Google ScholarDigital Library
- Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: A Sketching Interface for 3D Freeform Design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’99). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 409–416. https://doi.org/10.1145/311535.311602Google ScholarDigital Library
- Robert J. K. Jacob, Linda E. Sibert, Daniel C. McFarlane, and M. Preston Mullen, Jr.1994. Integrality and Separability of Input Devices. ACM Trans. Comput.-Hum. Interact. 1, 1 (March 1994), 3–26. https://doi.org/10.1145/174630.174631Google ScholarDigital Library
- Kiia Kallio. 2005. 3D6B Editor: Projective 3D Sketching with Line-Based Rendering. In Eurographics Workshop on Sketch-Based Interfaces and Modeling, Joaquim Armando Pires Jorge and Takeo Igarashi (Eds.). The Eurographics Association. https://doi.org/10.2312/SBM/SBM05/073-079Google Scholar
- Yongkwan Kim, Sang-Gyun An, Joon Hyub Lee, and Seok-Hyung Bae. 2018. Agile 3D Sketching with Air Scaffolding. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, New York, NY, USA, Article 238, 12 pages. https://doi.org/10.1145/3173574.3173812Google ScholarDigital Library
- Kenrick Kin, Maneesh Agrawala, and Tony DeRose. 2009. Determining the Benefits of Direct-Touch, Bimanual, and Multifinger Input on a Multitouch Workstation. In Proceedings of Graphics Interface 2009 (Kelowna, British Columbia, Canada) (GI ’09). Canadian Information Processing Society, CAN, 119–124.Google ScholarDigital Library
- Sebastian Knoedel and Martin Hachet. 2011. Multi-Touch RST in 2D and 3D Spaces: Studying the Impact of Directness on User Performance. In Proceedings of the 2011 IEEE Symposium on 3D User Interfaces(3DUI ’11). IEEE Computer Society, USA, 75–78.Google ScholarCross Ref
- P. Lapides, E. Sharlin, M. C. Sousa, and L. Streit. 2006. The 3D Tractus: a three-dimensional drawing board. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP ’06). 8 pp.–.Google Scholar
- Celine Latulipe, Craig S. Kaplan, and Charles L. A. Clarke. 2005. Bimanual and Unimanual Image Alignment: An Evaluation of Mouse-Based Techniques. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (Seattle, WA, USA) (UIST ’05). Association for Computing Machinery, New York, NY, USA, 123–131. https://doi.org/10.1145/1095034.1095057Google Scholar
- Celine Latulipe, Stephen Mann, Craig S. Kaplan, and Charlie L. A. Clarke. 2006. SymSpline: Symmetric Two-Handed Spline Manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI ’06). Association for Computing Machinery, New York, NY, USA, 349–358. https://doi.org/10.1145/1124772.1124825Google Scholar
- Jinha Lee and Hiroshi Ishii. 2010. Beyond: Collapsible Tools and Gestures for Computational Design. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3931–3936. https://doi.org/10.1145/1753846.1754081Google Scholar
- Jingbo Liu, Oscar Kin-Chung Au, Hongbo Fu, and Chiew-Lan Tai. 2012. Two-Finger Gestures for 6DOF Manipulation of 3D Objects. Comput. Graph. Forum 31, 7pt1 (Sept. 2012), 2047–2055. https://doi.org/10.1111/j.1467-8659.2012.03197.xGoogle ScholarDigital Library
- Pedro Lopes, Daniel Mendes, Bruno Araújo, and Joaquim A. Jorge. 2011. Combining Bimanual Manipulation and Pen-based Input for 3D Modelling. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling (Vancouver, British Columbia, Canada) (SBIM ’11). ACM, New York, NY, USA, 15–22. https://doi.org/10.1145/2021164.2021168Google ScholarDigital Library
- Sylvain Malacria, Eric Lecolinet, and Yves Guiard. 2010. Clutch-Free Panning and Integrated Pan-Zoom Control on Touch-Sensitive Surfaces: The Cyclostar Approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 2615–2624. https://doi.org/10.1145/1753326.1753724Google ScholarDigital Library
- Anthony Martinet, Gery Casiez, and Laurent Grisoni. 2010. The design and evaluation of 3d positioning techniques for multi-touch displays. In 2010 IEEE symposium on 3D user interfaces (3DUI). IEEE, 115–118.Google ScholarDigital Library
- Anthony Martinet, Géry Casiez, and Laurent Grisoni. 2010. The Effect of DOF Separation in 3D Manipulation Tasks with Multi-Touch Displays. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology (Hong Kong) (VRST ’10). Association for Computing Machinery, New York, NY, USA, 111–118. https://doi.org/10.1145/1889863.1889888Google ScholarDigital Library
- Anthony Martinet, Gery Casiez, and Laurent Grisoni. 2012. Integrality and Separability of Multitouch Interaction Techniques in 3D Manipulation Tasks. IEEE Transactions on Visualization and Computer Graphics 18, 3 (March 2012), 369–380. https://doi.org/10.1109/TVCG.2011.129Google ScholarDigital Library
- Fabrice Matulic and Moira Norrie. 2012. Empirical Evaluation of Uni- and Bimodal Pen and Touch Interaction Properties on Digital Tabletops. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). ACM, New York, NY, USA, 143–152. https://doi.org/10.1145/2396636.2396659Google ScholarDigital Library
- Fabrice Matulic and Moira C. Norrie. 2013. Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS ’13). ACM, New York, NY, USA, 41–50. https://doi.org/10.1145/2512349.2512802Google ScholarDigital Library
- Daniel Mendes, Fabio Marco Caputo, Andrea Giachetti, Alfredo Ferreira, and J Jorge. 2019. A survey on 3d virtual object manipulation: From the desktop to immersive virtual environments. In Computer graphics forum, Vol. 38. Wiley Online Library, 21–45.Google Scholar
- D. Mendes, F. Fonseca, B. Araùjo, A. Ferreira, and J. Jorge. 2014. Mid-air interactions above stereoscopic interactive tables. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). 3–10. https://doi.org/10.1109/3DUI.2014.6798833Google ScholarCross Ref
- M. Nebeling and M. Speicher. 2018. The Trouble with Augmented Reality/Virtual Reality Authoring Tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 333–337. https://doi.org/10.1109/ISMAR-Adjunct.2018.00098Google Scholar
- Dan R. Olsen and Travis Nielsen. 2001. Laser Pointer Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA) (CHI ’01). ACM, New York, NY, USA, 17–22. https://doi.org/10.1145/365024.365030Google ScholarDigital Library
- J. Karen Parker, Regan L. Mandryk, and Kori M. Inkpen. 2005. TractorBeam: Seamless Integration of Local and Remote Pointing for Tabletop Displays. In Proceedings of Graphics Interface 2005 (Victoria, British Columbia) (GI ’05). Canadian Human-Computer Communications Society, Waterloo, CAN, 33–40.Google Scholar
- Ken Pfeuffer, Jason Alexander, Ming Ki Chong, and Hans Gellersen. 2014. Gaze-Touch: Combining Gaze with Multi-Touch for Interaction on the Same Surface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 509–518. https://doi.org/10.1145/2642918.2647397Google ScholarDigital Library
- Ken Pfeuffer, Jason Alexander, and Hans Gellersen. 2016. Partially-indirect Bimanual Input with Gaze, Pen, and Touch for Pan, Zoom, and Ink Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, New York, NY, USA, 2845–2856. https://doi.org/10.1145/2858036.2858201Google ScholarDigital Library
- Ken Pfeuffer, Ken Hinckley, Michel Pahud, and Bill Buxton. 2017. Thumb + Pen Interaction on Tablets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 3254–3266. https://doi.org/10.1145/3025453.3025567Google ScholarDigital Library
- Jason L. Reisman, Philip L. Davidson, and Jefferson Y. Han. 2009. A Screen-Space Formulation for 2D and 3D Direct Manipulation. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST ’09). Association for Computing Machinery, New York, NY, USA, 69–78. https://doi.org/10.1145/1622176.1622190Google ScholarDigital Library
- Hugo Romat, Emmanuel Pietriga, Nathalie Henry-Riche, Ken Hinckley, and Caroline Appert. 2019. SpaceInk: Making Space for In-Context Annotations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 871–882. https://doi.org/10.1145/3332165.3347934Google ScholarDigital Library
- Emanuel Sachs, Andrew Roberts, and David Stoops. 1991. 3-Draw: A Tool for Designing 3D Shapes. IEEE Comput. Graph. Appl. 11, 6 (Nov. 1991), 18–26. https://doi.org/10.1109/38.103389Google ScholarDigital Library
- Ken Shoemake. 1992. ARCBALL: A User Interface for Specifying Three-Dimensional Orientation Using a Mouse. In Proceedings of the Conference on Graphics Interface ’92 (Vancouver, British Columbia, Canada). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 151–156. https://doi.org/10.5555/155294.155312Google ScholarDigital Library
- Arjun Srinivasan, Bongshin Lee, Nathalie Henry Riche, Steven M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376782Google ScholarDigital Library
- Sven Strothoff, Dimitar Valkov, and Klaus Hinrichs. 2011. Triangle Cursor: Interactions with Objects above the Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS ’11). Association for Computing Machinery, New York, NY, USA, 111–119. https://doi.org/10.1145/2076354.2076377Google ScholarDigital Library
- Mental Canvas Authoring System. Accessed 7 April, 2021. Mental Canvas Authoring System. http://www.mentalcanvas.com.Google Scholar
- Robert Wang, Sylvain Paris, and Jovan Popović. 2011. 6D Hands: Markerless Hand-Tracking for Computer Aided Design. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 549–558. https://doi.org/10.1145/2047196.2047269Google ScholarDigital Library
- Andrew M. Webb, Andruid Kerne, Zach Brown, Jun-Hyun Kim, and Elizabeth Kellogg. 2016. LayerFish: Bimanual Layering with a Fisheye In-Place. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS ’16). Association for Computing Machinery, New York, NY, USA, 189–198. https://doi.org/10.1145/2992154.2992171Google ScholarDigital Library
- Daniel Wigdor, Hrvoje Benko, John Pella, Jarrod Lombardo, and Sarah Williams. 2011. Rock & Rails: Extending Multi-touch Interactions with Shape Gestures to Enable Precise Spatial Manipulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 1581–1590. https://doi.org/10.1145/1978942.1979173Google ScholarDigital Library
- Christian Winkler, Ken Pfeuffer, and Enrico Rukzio. 2012. Investigating Mid-air Pointing Interaction for Projector Phones. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). ACM, New York, NY, USA, 85–94. https://doi.org/10.1145/2396636.2396650Google ScholarDigital Library
- Anusha Withana, Makoto Kondo, Yasutoshi Makino, Gota Kakehi, Maki Sugimoto, and Masahiko Inami. 2011. ImpAct: Immersive Haptic Stylus to Enable Direct Touch and Manipulation for Surface Computing. Comput. Entertain. 8, 2, Article 9 (Dec. 2011), 16 pages. https://doi.org/10.1145/1899687.1899691Google Scholar
- Siju Wu, Amine Chellali, Samir Otmane, and Guillaume Moreau. 2015. TouchSketch: A Touch-based Interface for 3D Object Manipulation and Editing. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology (Beijing, China) (VRST ’15). ACM, New York, NY, USA, 59–68. https://doi.org/10.1145/2821592.2821606Google ScholarDigital Library
- Haijun Xia, Ken Hinckley, Michel Pahud, Xiao Tu, and Bill Buxton. 2017. WritLarge: Ink Unleashed by Unified Scope, Action, & Zoom. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 3227–3240. https://doi.org/10.1145/3025453.3025664Google ScholarDigital Library
- Min Xin, Ehud Sharlin, and Mario Costa Sousa. 2008. Napkin Sketch: Handheld Mixed Reality 3D Sketching. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (Bordeaux, France) (VRST ’08). Association for Computing Machinery, New York, NY, USA, 223–226. https://doi.org/10.1145/1450579.1450627Google ScholarDigital Library
- Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization. ACM Trans. Graph. 33, 4, Article 131 (July 2014), 13 pages. https://doi.org/10.1145/2601097.2601128Google ScholarDigital Library
- Ka-Ping Yee. 2004. Two-Handed Interaction on a Tablet Display. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (Vienna, Austria) (CHI EA ’04). Association for Computing Machinery, New York, NY, USA, 1493–1496. https://doi.org/10.1145/985921.986098Google Scholar
- Dongwook Yoon, Nicholas Chen, and François Guimbretière. 2013. TextTearing: Opening White Space for Digital Ink Annotation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). ACM, New York, NY, USA, 107–112. https://doi.org/10.1145/2501988.2502036Google ScholarDigital Library
- Dongwook Yoon, Nicholas Chen, François Guimbretière, and Abigail Sellen. 2014. RichReview: Blending Ink, Speech, and Gesture to Support Collaborative Document Review. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 481–490. https://doi.org/10.1145/2642918.2647390Google ScholarDigital Library
- Robert Zeleznik, Andrew Bragdon, Ferdi Adeputra, and Hsu-Sheng Ko. 2010. Hands-on Math: A Page-based Multi-touch and Pen Desktop for Technical Work and Problem Solving. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). ACM, New York, NY, USA, 17–26. https://doi.org/10.1145/1866029.1866035Google ScholarDigital Library
Recommendations
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen Tilt
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous MultimediaDigital video technologies have been changing dramatically in the field of media production but reduced the tangibility of working with film. One interesting approach to get back such tangibility in digital systems is using pen and touch interactions. ...
Exploring and Understanding Unintended Touch during Direct Pen Interaction
The user experience on tablets that support both touch and styli is less than ideal, due in large part to the problem of unintended touch or palm rejection. Devices are often unable to distinguish between intended touch (i.e., interaction on the screen ...
Comments