Skip to main content

2021 | OriginalPaper | Buchkapitel

Virtual Annotations as Assistance for Construction Equipment Teleoperation

verfasst von : Zirui Hong, Qiqi Zhang, Xing Su

Erschienen in: Proceedings of the 24th International Symposium on Advancement of Construction Management and Real Estate

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Construction equipment teleoperation is a promising solution when the site environment is hazardous to operators. However, limited situational awareness of the operator exists as one of the major bottlenecks for the implementation. Virtual annotations (VAs) have great potential to improve an operator’s situational awareness. This paper focuses on a VA-based system for construction equipment teleoperation. The background and the challenges were introduced, relative VA researches were reviewed, and a VA-aided construction equipment teleoperation system was proposed. A pilot test was conducted to investigate the potential of the proposed system and the results were analyzed. The potential research directions enlightened by the test were discussed at the end.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wang, X., & Dunston, P. S. (2006). Compatibility issues in augmented reality systems for AEC: An experimental prototype study. Automation in Construction., 15, 314–326.CrossRef Wang, X., & Dunston, P. S. (2006). Compatibility issues in augmented reality systems for AEC: An experimental prototype study. Automation in Construction., 15, 314–326.CrossRef
2.
Zurück zum Zitat Cichon, T., & Roßmann, J. (2017). Robotic teleoperation: Mediated and supported by virtual testbeds. In 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR) (pp. 55–60). IEEE. Cichon, T., & Roßmann, J. (2017). Robotic teleoperation: Mediated and supported by virtual testbeds. In 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR) (pp. 55–60). IEEE.
3.
Zurück zum Zitat Ha, Q., Yen, L., & Balaguer, C. J. (2019). Robotic autonomous systems for earthmoving in military applications. 107, 102934 Ha, Q., Yen, L., & Balaguer, C. J. (2019). Robotic autonomous systems for earthmoving in military applications. 107, 102934
4.
Zurück zum Zitat Asano, J. (1978). Amphibious bulldozer construction methods. Asano, J. (1978). Amphibious bulldozer construction methods.
5.
Zurück zum Zitat Paulson, B. C. (1985). Automation and robotics for construction. Journal of Construction Engineering and Management., 111, 190–207.CrossRef Paulson, B. C. (1985). Automation and robotics for construction. Journal of Construction Engineering and Management., 111, 190–207.CrossRef
6.
Zurück zum Zitat Kawatsuma, S., Fukushima, M., & Okada, T. (2012). Emergency response by robots to Fukushima-Daiichi accident: Summary and lessons learned. Industrial Robot: An International Journal., 39, 428–435.CrossRef Kawatsuma, S., Fukushima, M., & Okada, T. (2012). Emergency response by robots to Fukushima-Daiichi accident: Summary and lessons learned. Industrial Robot: An International Journal., 39, 428–435.CrossRef
7.
Zurück zum Zitat Segawa, Y., Nanamori, Y., Sanji, S., Kitada, T., & Tadokoro, S. (2013). An introduction to Japanese R&D activity and political direction on special environment robots. 29–34. Segawa, Y., Nanamori, Y., Sanji, S., Kitada, T., & Tadokoro, S. (2013). An introduction to Japanese R&D activity and political direction on special environment robots. 29–34.
8.
Zurück zum Zitat Murphy, R.R., & Burke, J. L. (2005). Up from the rubble: Lessons learned about HRI from search and rescue. 49, 437–441 Murphy, R.R., & Burke, J. L. (2005). Up from the rubble: Lessons learned about HRI from search and rescue. 49, 437–441
9.
Zurück zum Zitat Endsley, M. R. (1988). Design and evaluation for situation awareness enhancement (Vol. 32, pp. 97–101). Endsley, M. R. (1988). Design and evaluation for situation awareness enhancement (Vol. 32, pp. 97–101).
10.
Zurück zum Zitat Woods, D. D., Tittle, J., Feil, M., Roesler, A. Envisioning human-robot coordination in future operations. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 34, 210–218. Woods, D. D., Tittle, J., Feil, M., Roesler, A. Envisioning human-robot coordination in future operations. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 34, 210–218.
11.
Zurück zum Zitat Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., et al. (2006). Common metrics for human-robot interaction. In Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction (pp. 33–40). ACM. Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., et al. (2006). Common metrics for human-robot interaction. In Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction (pp. 33–40). ACM.
12.
Zurück zum Zitat Rahnamaei, S., & Sirouspour, S. Automatic viewpoint planning in teleoperation of a mobile robot. Journal of Intelligent & Robotic Systems, 76, 443–460. Rahnamaei, S., & Sirouspour, S. Automatic viewpoint planning in teleoperation of a mobile robot. Journal of Intelligent & Robotic Systems, 76, 443–460.
13.
Zurück zum Zitat Hansen, F. A. (2006). Ubiquitous annotation systems: technologies and challenges. In Seventeenth Conference on Hypertext and Hypermedia (pp. 121–32). Hansen, F. A. (2006). Ubiquitous annotation systems: technologies and challenges. In Seventeenth Conference on Hypertext and Hypermedia (pp. 121–32).
14.
Zurück zum Zitat Orlosky, J., Kiyokawa, K., & Takemura, H. (2014). Managing mobile text in head mounted displays. ACM SIGMOBILE Mobile Computing and Communications Review., 18, 20–31.CrossRef Orlosky, J., Kiyokawa, K., & Takemura, H. (2014). Managing mobile text in head mounted displays. ACM SIGMOBILE Mobile Computing and Communications Review., 18, 20–31.CrossRef
15.
Zurück zum Zitat Williams, M., Yao, K. K., & Nurse, J. R. (2017). ToARist: an augmented reality tourism app created through user-centred design. In Proceedings of the 31st British Computer Society Human Computer Interaction Conference (p. 1). BCS Learning & Development Ltd. Williams, M., Yao, K. K., & Nurse, J. R. (2017). ToARist: an augmented reality tourism app created through user-centred design. In Proceedings of the 31st British Computer Society Human Computer Interaction Conference (p. 1). BCS Learning & Development Ltd.
16.
Zurück zum Zitat Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Gomez, G., & Marley, S, et al. (2016). Virtual annotations of the surgical field through an augmented reality transparent display. 32, 1481–1498. Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Gomez, G., & Marley, S, et al. (2016). Virtual annotations of the surgical field through an augmented reality transparent display. 32, 1481–1498.
17.
Zurück zum Zitat Larabi, S. (2018). Augmented reality for mobile devices: textual annotation of outdoor locations. In Augmented reality and virtual reality (pp. 353–362). Springer. Larabi, S. (2018). Augmented reality for mobile devices: textual annotation of outdoor locations. In Augmented reality and virtual reality (pp. 353–362). Springer.
18.
Zurück zum Zitat Tylecek, R., & Fisher, R. J. S. (2018). Consistent semantic annotation of outdoor datasets via 2D/3D label transfer. 18, 2249. Tylecek, R., & Fisher, R. J. S. (2018). Consistent semantic annotation of outdoor datasets via 2D/3D label transfer. 18, 2249.
19.
Zurück zum Zitat Wither, J., Di Verdi, S., Hllerer, T. Annotation in outdoor augmented reality. Computers & Graphics, 33, 679–689. Wither, J., Di Verdi, S., Hllerer, T. Annotation in outdoor augmented reality. Computers & Graphics, 33, 679–689.
20.
Zurück zum Zitat Hernandez, D., Garimella, R., & Eltorai, A. E. (2017). Daniels AHJOs. Computer-Assisted Orthopaedic Surgery., 9, 152–158.CrossRef Hernandez, D., Garimella, R., & Eltorai, A. E. (2017). Daniels AHJOs. Computer-Assisted Orthopaedic Surgery., 9, 152–158.CrossRef
21.
Zurück zum Zitat Fang, Y., Cho, Y. K., & Chen, J. J. (2016). A framework for real-time pro-active safety assistance for mobile crane lifting operations. 72, 367–379. Fang, Y., Cho, Y. K., & Chen, J. J. (2016). A framework for real-time pro-active safety assistance for mobile crane lifting operations. 72, 367–379.
22.
Zurück zum Zitat Kim, K., Kim, H., & Kim, H. J. (2017). Image-based construction hazard avoidance system using augmented reality in wearable device. 83, 390–403. Kim, K., Kim, H., & Kim, H. J. (2017). Image-based construction hazard avoidance system using augmented reality in wearable device. 83, 390–403.
23.
Zurück zum Zitat Hughes, S. B., & Lewis, M. (2005). Task-driven camera operations for robotic exploration. IEEE Transactions on Systems, Man, and Cybernetics - Part a: Systems and Humans., 35, 513–522.CrossRef Hughes, S. B., & Lewis, M. (2005). Task-driven camera operations for robotic exploration. IEEE Transactions on Systems, Man, and Cybernetics - Part a: Systems and Humans., 35, 513–522.CrossRef
24.
Zurück zum Zitat Ruddle, R. A., Savage, J. C. D., & Jones, D. M. (2003). Levels of control during a collaborative carrying task. Presence: Teleoperators and Virtual Environments, 12, 140–155. Ruddle, R. A., Savage, J. C. D., & Jones, D. M. (2003). Levels of control during a collaborative carrying task. Presence: Teleoperators and Virtual Environments, 12, 140–155.
25.
Zurück zum Zitat Casper, J., & Murphy, R.R. (2003). Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 33, 367. Casper, J., & Murphy, R.R. (2003). Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 33, 367.
26.
Zurück zum Zitat Long, L. O., Gomer, J. A., Wong, J. T., & Pagano, C. C. (2011). Visual spatial abilities in uninhabited ground vehicle task performance during teleoperation and direct line of sight. Presence: Teleoperators and Virtual Environments, 20, 466–479. Long, L. O., Gomer, J. A., Wong, J. T., & Pagano, C. C. (2011). Visual spatial abilities in uninhabited ground vehicle task performance during teleoperation and direct line of sight. Presence: Teleoperators and Virtual Environments, 20, 466–479.
27.
Zurück zum Zitat Casner, S. M. (2005). The effect of GPS and moving map displays on navigational awareness while flying under VFR. Journal of Applied Aviation Studies, 5, 153–165. Casner, S. M. (2005). The effect of GPS and moving map displays on navigational awareness while flying under VFR. Journal of Applied Aviation Studies, 5, 153–165.
28.
Zurück zum Zitat Lohrenz, M. C., Edwards, S. S., Myrick, S. A., Gendron, M. L., & Trenchard, M. E. Demonstration of a moving-map system for improved precise lane navigation of amphibious vehicles and landing craft. 1247–1254. Lohrenz, M. C., Edwards, S. S., Myrick, S. A., Gendron, M. L., & Trenchard, M. E. Demonstration of a moving-map system for improved precise lane navigation of amphibious vehicles and landing craft. 1247–1254.
29.
Zurück zum Zitat Werner, S. (2002). Cognitive reference systems and their role in designing spatial information displays. Ki., 16, 10–13. Werner, S. (2002). Cognitive reference systems and their role in designing spatial information displays. Ki., 16, 10–13.
30.
Zurück zum Zitat Thomas, L. C., & Wickens, C. D. (2001). Visual displays and cognitive tunneling: Frames of reference effects on spatial judgments and change detection. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (pp. 336–340) Los Angeles, CA: SAGE Publications Sage CA. Thomas, L. C., & Wickens, C. D. (2001). Visual displays and cognitive tunneling: Frames of reference effects on spatial judgments and change detection. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (pp. 336–340) Los Angeles, CA: SAGE Publications Sage CA.
31.
Zurück zum Zitat Chen, J. Y. C., & Haas, E. C., & Barnes, M. J. (2007). Human performance issues and user interface design for teleoperated robots. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 37, 1231–1245. Chen, J. Y. C., & Haas, E. C., & Barnes, M. J. (2007). Human performance issues and user interface design for teleoperated robots. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 37, 1231–1245.
32.
Zurück zum Zitat Menchaca-Brandan, M. A., Liu, A. M., Oman, C. M., & Natapoff, A. (2007). Influence of perspective-taking and mental rotation abilities in space teleoperation. 271. Menchaca-Brandan, M. A., Liu, A. M., Oman, C. M., & Natapoff, A. (2007). Influence of perspective-taking and mental rotation abilities in space teleoperation. 271.
33.
Zurück zum Zitat Su, X., Pan, J., & Grinter, M. (2015). Improving construction equipment operation safety from a human-centered perspective. Procedia Engineering., 118, 290–295.CrossRef Su, X., Pan, J., & Grinter, M. (2015). Improving construction equipment operation safety from a human-centered perspective. Procedia Engineering., 118, 290–295.CrossRef
34.
Zurück zum Zitat Anderson, J. R. (2005). Cognitive psychology and its implications. Macmillan. Anderson, J. R. (2005). Cognitive psychology and its implications. Macmillan.
35.
Zurück zum Zitat Draper, J. V., Kaber, D. B., & Usher, J. M. J. H. Telepresence. 40, 354–375. Draper, J. V., Kaber, D. B., & Usher, J. M. J. H. Telepresence. 40, 354–375.
36.
Zurück zum Zitat Riley, J. M., Kaber, D. B., & Draper, J. V. J. H. F. (2004). Situation awareness and attention allocation measures for quantifying telepresence experiences in teleoperation. Manufacturing Ei, Industries S, 14, 51–67. Riley, J. M., Kaber, D. B., & Draper, J. V. J. H. F. (2004). Situation awareness and attention allocation measures for quantifying telepresence experiences in teleoperation. Manufacturing Ei, Industries S, 14, 51–67.
37.
Zurück zum Zitat Matthews, T., Rattenbury, T., Carter, S., Dey, A., & Mankoff , J. J. Berkeley Technotes, UCB//CSD-03. A peripheral display toolkit. 168. Matthews, T., Rattenbury, T., Carter, S., Dey, A., & Mankoff , J. J. Berkeley Technotes, UCB//CSD-03. A peripheral display toolkit. 168.
38.
Zurück zum Zitat Kahneman, D. (1973). Attention and effort. Citeseer. Kahneman, D. (1973). Attention and effort. Citeseer.
39.
Zurück zum Zitat Norman, D. (2013). The design of everyday things: Revised and expanded edition. In Basic books. Norman, D. (2013). The design of everyday things: Revised and expanded edition. In Basic books.
40.
Zurück zum Zitat Leykin, A., & Tuceryan, M. (2004). Automatic determination of text readability over textured backgrounds for augmented reality systems. In 2004 ISMAR 2004 Third IEEE and ACM International Symposium on Mixed and Augmented Reality (pp. 224–230). IEEE. Leykin, A., & Tuceryan, M. (2004). Automatic determination of text readability over textured backgrounds for augmented reality systems. In 2004 ISMAR 2004 Third IEEE and ACM International Symposium on Mixed and Augmented Reality (pp. 224–230). IEEE.
41.
Zurück zum Zitat Gabbard, J. L., Swan, J. E., & Hix, D. The effects of text drawing styles, background textures, and natural lighting on text legibility in outdoor augmented reality. Presence: Teleoperators and Virtual Environments, 15, 16–32. Gabbard, J. L., Swan, J. E., & Hix, D. The effects of text drawing styles, background textures, and natural lighting on text legibility in outdoor augmented reality. Presence: Teleoperators and Virtual Environments, 15, 16–32.
42.
Zurück zum Zitat Balali, V., & Golparvar-Fard, M. (2015). Segmentation and recognition of roadway assets from car-mounted camera video streams using a scalable non-parametric image parsing method. Automation in Construction., 49, 27–39.CrossRef Balali, V., & Golparvar-Fard, M. (2015). Segmentation and recognition of roadway assets from car-mounted camera video streams using a scalable non-parametric image parsing method. Automation in Construction., 49, 27–39.CrossRef
43.
Zurück zum Zitat Chong, Z. J., Qin, B., Bandyopadhyay, T., Wongpiromsarn, T., Rebsamen, B., & Dai, P., et al. (2013). Autonomy for Mobility on Demand, 671–682. Chong, Z. J., Qin, B., Bandyopadhyay, T., Wongpiromsarn, T., Rebsamen, B., & Dai, P., et al. (2013). Autonomy for Mobility on Demand, 671–682.
44.
Zurück zum Zitat Green, P. E., Wada, T., Oberholtzer, J., Green, P. A., Schweitzer, J., Eoh, H. (2007). How do distracted and normal driving differ: an analysis of the ACAS naturalistic driving data. Green, P. E., Wada, T., Oberholtzer, J., Green, P. A., Schweitzer, J., Eoh, H. (2007). How do distracted and normal driving differ: an analysis of the ACAS naturalistic driving data.
45.
Zurück zum Zitat Makishita, H. (1999). Accidents caused by distracted driving in Japan. Safety Science Monitor. Makishita, H. (1999). Accidents caused by distracted driving in Japan. Safety Science Monitor.
46.
Zurück zum Zitat Yovcheva, Z., Buhalis, D., Gatzidis, C., & van Elzakker, C. P. J. M. (2014). Empirical evaluation of smartphone augmented reality browsers in an urban tourism destination context. International Journal of Mobile Human Computer Interaction, 6, 10–31.CrossRef Yovcheva, Z., Buhalis, D., Gatzidis, C., & van Elzakker, C. P. J. M. (2014). Empirical evaluation of smartphone augmented reality browsers in an urban tourism destination context. International Journal of Mobile Human Computer Interaction, 6, 10–31.CrossRef
Metadaten
Titel
Virtual Annotations as Assistance for Construction Equipment Teleoperation
verfasst von
Zirui Hong
Qiqi Zhang
Xing Su
Copyright-Jahr
2021
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-8892-1_83