Skip to main content

Advertisement

Log in

A comprehensive operating room information system using the Kinect sensors and RFID

  • Original Research
  • Published:
Journal of Clinical Monitoring and Computing Aims and scope Submit manuscript

Abstract

Occasionally, surgeons do need various types of information to be available rapidly, efficiently and safely during surgical procedures. Meanwhile, they need to free up hands throughout the surgery to necessarily access the mouse to control any application in the sterility mode. In addition, they are required to record audio as well as video files, and enter and save some data. This is an attempt to develop a comprehensive operating room information system called “Medinav” to tackle all mentioned issues. An integrated and comprehensive operating room information system is introduced to be compatible with Health Level 7 (HL7) and digital imaging and communications in medicine (DICOM). DICOM is a standard for handling, storing, printing, and transmitting information in medical imaging. Besides, a natural user interface (NUI) is designed specifically for operating rooms where touch-less interactions with finger and hand tracking are in use. Further, the system could both record procedural data automatically, and view acquired information from multiple perspectives graphically. A prototype system is tested in a live operating room environment at an Iranian teaching hospital. There are also contextual interviews and usability satisfaction questionnaires conducted with the “MediNav” system to investigate how useful the proposed system could be. The results reveal that integration of these systems into a complete solution is the key to not only stream up data and workflow but maximize surgical team usefulness as well. It is now possible to comprehensively collect and visualize medical information, and access a management tool with a touch-less NUI in a rather quick, practical, and harmless manner.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Meyer MA. Use of location data for the surveillance, analysis, and optimization of clinical processes Massachusetts Institute of Technology 2006.

  2. Meyer M, Levine W, Egan M, Cohen B, Spitz G, Garcia P, Chueh H, Sandberg W. A computerized perioperative data integration and display system. Int J Comput Assist Radiol Surg. 2007;2:191–202.

    Article  Google Scholar 

  3. Ruppert GC, Reis LO, Amorim PH, de Moraes TF, da Silva JV. Touchless gesture user interface for interactive image visualization in urological surgery. World J Urol. 2012;30:687–91.

    Article  PubMed  Google Scholar 

  4. Wachs J, Stern H, Edan Y, Gillam M, Handler J, Feied C, Smith M. A gesture-based tool for sterile browsing of radiology images. J Am Med Inform Assoc. 2008;15:321–3.

    Article  PubMed Central  PubMed  Google Scholar 

  5. Wu HQ, Lv ZM, Geng XY, Jiang K, Tang LM, Zhou GM, Dong JC. Interoperative fundus image and report sharing in compliance with integrating the healthcare enterprise conformance and web access to digital imaging and communication in medicine persistent object protocol. Int J Ophthalmol. 2013;6(6):879–83. doi:10.3980/j.issn.2222-3959.2013.06.24.

    PubMed Central  PubMed  Google Scholar 

  6. Blake J. Manning early access program natural user interface version 8. Manning Publications Co. 2011.

  7. Chi H-L, Kang S-C, Wang X. Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Autom Constr. 2013;33:116–22.

    Article  Google Scholar 

  8. Wigdor D, Wixon D. Brave NUI world: designing natural user interfaces for touch and gesture. USA: Elsevier; 2011.

  9. LaBelle K. Evaluation of Kinect joint tracking for clinical and in-home stroke rehabilitation tools. Undergraduate Program in Computer Science, Thesis. Notre Dame, Indiana; 2011. http://netscale.cse.nd.edu/twiki/pub/Edu/KinectRehabilitation/Eval_of_Kinect_for_Rehab.pdf.

  10. HL7. About HL7 [Online]. Health Level Seven International Website. 2011. http://www.hl7.org/about/index.cfm?ref=nav.

  11. Bogdan O, Alin C, Aurel V, Serban M. Integrated medical system using DICOM and HL7 standards. In: Lazinica A editor. New advanced technologies. InTech; 2010 pp. 232–246.

  12. Park KW, Smaltz D, McFadden D, Souba W. The operating room dashboard. J Surg Res. 2010;164(2):294–300. doi:10.1016/j.jss.2009.09.011.

    Article  PubMed  Google Scholar 

  13. Lewis JR. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum Comput Interact. 1995;7:57–78.

    Article  Google Scholar 

  14. Wachs J, Stern H, Edan Y, Gillam M, Feied C, Smith M, Handler J. Gestix: a doctor-computer sterile gesture interface for dynamic environments. In: Soft computing in industrial applications. Berlin: Springer; 2007. pp. 30–39.

  15. Gratzel C, Fong T, Grange S, Baur C. A non-contact mouse for surgeon-computer interaction. Technol Health Care. 2004;12:245–57.

    CAS  PubMed  Google Scholar 

  16. Ruppert GC, Reis LO, Amorim PH, de Moraes TF, da Silva JV. Touchless gesture user interface for interactive image visualization in urological surgery. World J Urol. 2012;30(5):687–91. doi:10.1007/s00345-012-0879-0.

    Article  PubMed  Google Scholar 

  17. Hartmann F, Schlaefer A. Feasibility of touch-less control of operating room lights. Int J Comput Assist Radiol Surg. 2013;8(2):259–68. doi:10.1007/s11548-012-0778-2.

    Article  PubMed  Google Scholar 

  18. Ebert LC, Hatch G, Thali MJ, Ross S. Invisible touch-control of a DICOM viewer with finger gestures using the Kinect depth camera. J Forensic Radiol Imaging 1:10–14.

  19. Anacleto J, Fels S, Silvestre R. Transforming a paper based process to a natural user interfaces process in a Chronic Care Hospital. Procedia Comput Sci. 2012;14:173–80.

    Article  Google Scholar 

  20. Liu CCH, Chang C-H, Su M-C, Chu H-T, Hung S-H, Wong J-M, Wang P-C. RFID-initiated workflow control to facilitate patient safety and utilization efficiency in operation theater. Comput Methods Programs Biomed. 2011;104:435–42.

    Article  PubMed  Google Scholar 

  21. Kranzfelder M, Zywitza D, Jell T, Schneider A, Gillen S, Friess H, Feussner H. Real-time monitoring for detection of retained surgical sponges and team motion in the surgical operation room using radio-frequency-identification (RFID) technology: a preclinical evaluation. J Surg Res. 2012;175(2):191–8. doi:10.1016/j.jss.2011.03.029.

    Article  PubMed  Google Scholar 

  22. Voruganti A, Mayoral R, Vazquez A, Burgert, O. A modular video streaming method for surgical assistance in operating room networks. Int J Comput Assist Radiol Surg 5:489–499.

  23. Taniguchi A, Nakamura E, Yaegashi K. Introduction of a simple audio recording system to the operating room–experience at a small local hospital. Masui. 2012;61(10):1156–8.

    PubMed  Google Scholar 

  24. Orza B, Cordos A, Vlaicu A, Meza S, Petrovan B. An integrated eHealth system using medical information standards. In: Proceedings of the 14th WSEAS international conference on computers: part of the 14th WSEAS CSCC multiconference-Volume I. World Scientific and Engineering Academy and Society (WSEAS), pp. 63–68.

  25. Ang S. Experience with an innovative operating room dashboard system to improve quality and efficiency in an Academic Medical Center in Singapore. Anaesth Intensive Care. 2013;41(6):821.

    CAS  PubMed  Google Scholar 

  26. Nagy PG, Konewko R, Warnock M, Bernstein W, Seagull J, Xiao Y, George I, Park A. Novel, web-based, information-exploration approach for improving operating room logistics and system processes. Surg Innov. 2008;15:7–16.

    Article  PubMed  Google Scholar 

  27. Jacobs B, Duncan JR, Street M, Murray D. Audio and video recording system for routine documentation of fluoroscopic procedures. J Vasc Interv Radiol. 2010;21(5):725–9.

Download references

Conflict of interest

The authors received research grants from Green Cyber Inc., Ontario, Canada to finance the conduct of this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Somayeh Ghazalbash.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nouei, M.T., Kamyad, A.V., Soroush, A.R. et al. A comprehensive operating room information system using the Kinect sensors and RFID. J Clin Monit Comput 29, 251–261 (2015). https://doi.org/10.1007/s10877-014-9591-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10877-014-9591-5

Keywords

Navigation