Top

Published in:

2025 | OriginalPaper | Chapter

A Tangible Interface for Creating Virtual Cutaways in Mixed Reality

Authors : Xuyu Li, Priyansh Jalan, John Dingliana

Published in: Virtual Reality and Mixed Reality

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this paper, we discuss work-in-progress research on tangible interfaces for interactive cutaway visualizations in Mixed Reality (MR). We present an approach that allows users to flexibly and intuitively define virtual cutaway geometry by directly interacting with real-world objects. Using hand movements the user physically traces the shape of the cutaway on an object, without the need for specialized input devices. Tangible interaction allows more accurate interaction and makes it easier for users to plan the placement and shape of required cutaways that fit the object. We developed a prototype demonstrator on the Microsoft HoloLens 2 and present the design and implementation details for such a system and discuss insights, gained from preliminary testing, that motivate compelling directions for future work.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Enhancing Materiality in Adaptive BRDF Display with Light Ray Diffusion

next chapter MarkAR: Exploring the Benefits of Combining Microgestures and Mid-Air Marks to Trigger Commands in Augmented Reality

https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/.

https://developer.vuforia.com/.

https://youtu.be/ywb5qWBbyeY.

https://lumalabs.ai/.

Arora, J., Saini, A., Mehra, N., Jain, V., Shrey, S., Parnami, A.: VirtualBricks: exploring a scalable, modular toolkit for enabling physical manipulation in VR. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, pp. 1–12. ACM, New York (2019). https://doi.org/10.1145/3290605.3300286

Besançon, L., Issartel, P., Ammi, M., Isenberg, T.: Mouse, tactile, and tangible input for 3D manipulation. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI 2017, pp. 4727–4740. ACM, New York (2017). https://doi.org/10.1145/3025453.3025863

Brooke, J.: SUS: a quick and dirty usability scale. In: Jordan, P., Thomas, B., Weerdmeester, B., McClelland, I. (eds.) Usability Evaluation in Industry, pp. 189–194. CRC Press (1996)

Burns, M., Finkelstein, A.: Adaptive cutaways for comprehensible rendering of polygonal scenes. ACM Trans. Graphics 27(5), 154:1–154:7 (2008). https://doi.org/10.1145/1409060.1409107

Coffin, C., Hollerer, T.: Interactive perspective cut-away views for general 3D scenes. In: 3D User Interfaces (3DUI 2006), pp. 25–28 (2006). https://doi.org/10.1109/VR.2006.88

Diepstraten, J., Weiskopf, D., Ertl, T.: Interactive cutaway illustrations. Comput. Graph. Forum 22(3), 523–532 (2003). https://doi.org/10.1111/1467-8659.t01-3-00700CrossRef

Feiner, S.K., Seligmann, D.D.: Cutaways and ghosting: satisfying visibility constraints in dynamic 3D illustrations. Vis. Comput. 8(5), 292–302 (1992). https://doi.org/10.1007/BF01897116CrossRef

He, F., Hu, X., Shi, J., Qian, X., Wang, T., Ramani, K.: UBI edge: authoring edge-based opportunistic tangible user interfaces in augmented reality. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023, pp. 1–14. ACM, New York (2023). https://doi.org/10.1145/3544548.3580704

Hettiarachchi, A., Wigdor, D.: Annexing reality: enabling opportunistic use of everyday objects as tangible proxies in augmented reality. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 2016, pp. 1957–1967. ACM, New York (2016). https://doi.org/10.1145/2858036.2858134

10.

Ishii, H.: The tangible user interface and its evolution. Commun. ACM 51(6), 32–36 (2008). https://doi.org/10.1145/1349026.1349034CrossRef

11.

Lee, G.A., Kim, G.J., Billinghurst, M.: Immersive authoring: what you experience is what you get (WYXIWYG). Commun. ACM 48(7), 76–81 (2005). https://doi.org/10.1145/1070838.1070840CrossRef

12.

Li, W., Ritter, L., Agrawala, M., Curless, B., Salesin, D.: Interactive cutaway illustrations of complex 3D models. ACM Trans. Graph. 26(3), 31–es (2007). https://doi.org/10.1145/1276377.1276416

13.

Liang, R., Clapworthy, G., Krokos, M., Mayoral, R.: Real-time predefined shape cutaway with parametric boundaries. In: International Conference on Computer Graphics, Imaging and Visualization (CGIV 2005), pp. 227–231 (2005). https://doi.org/10.1109/CGIV.2005.64

14.

Lidal, E.M., Hauser, H., Viola, I.: Design principles for cutaway visualization of geological models. In: Proceedings of the 28th Spring Conference on Computer Graphics, SCCG 2012, pp. 47–54. ACM, New York (2012). https://doi.org/10.1145/2448531.2448537

15.

Looser, J., Billinghurst, M., Cockburn, A.: Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces. In: Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, GRAPHITE 2004, pp. 204–211. ACM, New York (2004). https://doi.org/10.1145/988834.988870

16.

Matviienko, A., Langer, M., Müller, F., Schmitz, M., Mühlhäuser, M.: VRtangibles: assisting children in creating virtual scenes using tangible objects and touch input. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021, pp. 1–7. ACM, New York (2021). https://doi.org/10.1145/3411763.3451671

17.

Monteiro, K., Vatsal, R., Chulpongsatorn, N., Parnami, A., Suzuki, R.: Teachable reality: prototyping tangible augmented reality with everyday objects by leveraging interactive machine teaching. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023, pp. 1–15. ACM, New York (2023). https://doi.org/10.1145/3544548.3581449

18.

Netto, L.F., Celes, W.: A new focus+context visualization technique for inspecting black oil reservoir models. In: 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 25–32 (2021). https://doi.org/10.1109/SIBGRAPI54419.2021.00013. ISSN 2377-5416

19.

Shaer, O., Hornecker, E.: Tangible user interfaces: past, present, and future directions. Found. Trends Hum.-Comput. Interact. 3(1–2), 4–137 (2010). https://doi.org/10.1561/1100000026CrossRef

20.

Sigg, S., Fuchs, R., Carnecky, R., Peikert, R.: Intelligent cutaway illustrations. In: 2012 IEEE Pacific Visualization Symposium, pp. 185–192 (2012). https://doi.org/10.1109/PacificVis.2012.6183590. ISSN 2165-8773

21.

Sin, A.K., Badioze Zaman, H.: Tangible interaction in learning astronomy through augmented reality book-based educational tool. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Schröder, H., Shih, T.K. (eds.) IVIC 2009. LNCS, vol. 5857, pp. 302–313. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-05036-7_29CrossRef

22.

Wang, Q., Li, C., Huang, X., Tang, M.: Tangible interface: integration of the real and virtual. In: The 7th International Conference on Computer Supported Cooperative Work in Design, pp. 408–412. IEEE, Rio de Janeiro, Brazil (2002). https://doi.org/10.1109/CSCWD.2002.1047723

Title: A Tangible Interface for Creating Virtual Cutaways in Mixed Reality
Authors: Xuyu Li
Priyansh Jalan
John Dingliana
Publisher: Springer Nature Switzerland
Book: Virtual Reality and Mixed Reality
Print ISBN: 978-3-031-78592-4

Electronic ISBN: 978-3-031-78593-1

Copyright Year: 2025
DOI: https://doi.org/10.1007/978-3-031-78593-1_10

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"