Abstract
The field of surgical interventions emphasizes knowledge and experience; explicit and detailed models of surgical processes are hard to obtain by observation or measurement. However, in medical engineering and related developments, such models are highly valuable. Surgical process modeling deals with the generation of complex process descriptions by observation. This places high demands on the observers, who have to use a sizable terminology to denominate surgical actions, instruments, and patient anatomies, and to describe processes unambiguously. Here, we present a novel method, employing an ontology-based user interface that adapts to the actual situation and describe the principles of the system. A validation study showed that this method enables observers with little recording experience to reach a recording accuracy of >90%. Furthermore, this method can be used for live and video observation. We conclude that the method of ontology-supported recording for complex behaviors can be advantageously employed when surgical processes are modeled.
Article PDF
Similar content being viewed by others
References
Ahmadi, S., Sielhorst, T., Stauder, R., Horn, M., Feussner, H., & Navab, N. (2006). Recovery of surgical workflow without explicit models. In R. Larsen, M. Nielsen, & J. Sporring (Eds.), Proceedings of Medical Image Computing and Computer-Assisted Intervention— MICCAI 2006: Part I. Lecture notes in computer science (Vol. 4190, pp. 420–428). Berlin: Springer.
Archer, T., & Macario, A. (2006). The drive for operating room efficiency will increase quality of patient care. Current Opinion in Anaesthesiology, 19, 171–176.
Berrais, A. (1997). Knowledge-based expert systems: User interface implications. Advances in Engineering Software, 28, 31–41. doi:10.1016/S0965-9978(96)00030-0
Cao, A., Chintamani, K., Pandya, A., & Ellis, R. (2009). NASA TLX: Software for assessing subjective mental workload. Behavior Research Methods, 41, 113–117. doi:10.3758/BRM.41.1.113
Castellano, J., Perea, A., Alday, L., & Mendo, A. (2008). The measuring and observation tool in sports. Behavior Research Methods, 40, 898–905.
den Boer, K., Straatsburg, I., Schellinger, A., de Wit, L., Dankelman, J., & Gouma, D. (1999). Quantitative analysis of the functionality and efficiency of three surgical dissection techniques: A time-motion analysis. Journal of Laparoendoscopic & Advanced Surgical Techniques, 9, 389–395.
German Federal Statistical Office (Ed.) (2008). International Classification of Diseases 10: National health statistics for 2007.
Gruber, T. (1993). A translation approach to portable ontologies. Knowledge Acquisition, 5, 199–220.
Hänninen, L., & Pastell, M. (2009). CowLog: Open-source software for coding behaviors from digital video. Behavior Research Methods, 41, 472–476. doi:10.3758/BRM.41.2.472
Hart, S., & Staveland, L. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload, 1, 139–183.
Held, J., & Manser, T. (2005). A PDA-based system for online recording and analysis of concurrent events in complex behavioral processes. Behavior Research Methods, 37, 155–164.
Jablonski, S., & Bussler, C. (1996). Workflow-management: Modelling concepts, architecture and implementation. London: ITP New Media.
James, A., Vieira, D., Lo, B., Darzi, A., & Yang, G. (2007). Eye-gaze driven surgical workflow segmentation. In R. Larsen, M. Nielsen, & J. Sporring (Eds.), Proceedings of Medical Image Computing and Computer-Assisted Intervention—MICCAI 2007: Part II. Lecture notes in computer science (Vol. 4792, pp. 110–117). Berlin: Springer.
Jannin, P., Raimbault, M., Morandi, X., Riffaud, L., & Gibaud, B. (2003). Model of surgical procedures for multimodal image-guided neurosurgery. Computer Aided Surgery, 8, 98–106.
Kuehme, T. (1993). Adaptive action prompting: A complementary aid to support task-oriented interaction in explorative user interfaces (Graphics, Visualization and Usability Center [GVU Center] Tech. Rep. GIT-GVU-93-19). Retrieved September 3, 2009, from http://smartech.gatech.edu/handle/1853/3629.
Leong, J., Nicolaou, M., Atallah, L., Mylonas, G., Darzi, A., & Yang, G. (2007). HMM assessment of quality of movement trajectory in laparoscopic surgery. Computer Aided Surgery, 12, 335–346.
Love, B., Jones, M., Tomlinson, M., & Howe, M. (2008). Predicting information needs: Adaptive display in dynamic environments. In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 875–880). Austin, TX: Cognitive Science Society.
MacLin, O., & MacLin, M. (2005). Coding observational data: A software solution. Behavior Research Methods, 37, 224–231.
Malik, R., White, P., & Macewen, C. (2003). Using human reliability analysis to detect surgical error in endoscopic DCR surgery. Clinical Otolaryngology & Allied Sciences, 28, 456–460.
Megali, G., Signigaglia, S., Tonet, O., & Dario, P. (2006). Modelling and evaluation of surgical performance using hidden Markov models. IEEE Transactions on Biomedical Engineering, 53, 1911–1919. doi:10.1109/TBME.2006.881784
Mehta, N., Haluck, R., Frecker, M., & Snyder, A. (2002). Sequence and task analysis of instrument use in common laparoscopic procedures. Surgical Endoscopy, 16, 280–285. doi:10.1007/s004640080009
Neumuth, T., Czygan, M., Strauss, G., Meixensberger, J., & Burgert, O. (2009). Computer assisted acquisition of surgical process models with a sensor-driven ontology. In MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), London.
Neumuth, T., Durstewitz, N., Fischer, M., Strauß, G., Dietz, A., Meixensberger, J., et al. (2006). Structured recording of intraoperative surgical workflows. In S. Horii & O. Ratib (Eds.), SPIE Medical Imaging 2006—PACS and imaging informatics: Progress in biomedical optics and imaging (Vol. 7, p. CID 61450A). Bellingham, WA: SPIE Press.
Neumuth, T., Jannin, P., Strauss, G., Meixensberger, J., & Burgert, O. (2009). Validation of knowledge acquisition for surgical process models. Journal of the American Medical Informatics Association (JAMIA), 16, 72–80. doi: 10.1197/jamia.M2748
Neumuth, T., Strauss, G., Meixensberger, J., Lemke, H.-U., & Burgert, O. (2006). Acquisition of process descriptions from surgical interventions. In S. Bressan, J. Küng, & R. Wagner (Eds.), Proceedings of the 17th International Conference on Database and Expert Systems Applications (DEXA ’06) (Vol. 4080, pp. 602–611). Berlin: Springer.
Neumuth, T., Trantakis, C., Riffaud, L., Strauss, G., Meixensberger, J., & Burgert, O. (2009). Assessment of technical needs for surgical equipment by surgical process models. Minimally Invasive Therapy & Allied Technologies, 18, 841–849.
Padoy, N., Blum, T., Essa, I., Feussner, H., Berger, M., & Navab, N. (2007). A boosted segmentation method for surgical workflow analysis. In R. Larsen, M. Nielsen, & J. Sporring (Eds.), Proceedings of Medical Image Computing and Computer-Assisted Intervention— MICCAI 2007: Part I. Lecture notes in computer science (Vol. 4791, pp. 102–109). Berlin: Springer.
PostgreSQL Global Development Group (2009). PostgreSQL: The world’s most advanced open source database. Retrieved July 27, 2009, from www.postgresql.org.
Racer Systems (2009). RacerPro—Renamed Abox and Concept Expression Reasoner. Retrieved September 28, 2009, from www.sts.tu-harburg.de/~r.f.moeller/racer.
Raimbault, M., Morandi, X., & Jannin, P. (2005). Towards models of surgical procedures: Analyzing a database of neurosurgical cases. In O. Ratib & S. Horii (Eds.), Medical Imaging 2005: PACS and imaging informatics (Vol. 5748, pp. 97–104). Bellingham, WA: SPIE Press.
Richards, C., Rosen, J., Hannaford, B., Pellegrini, C., & Sinanan, M. (2000). Skills evaluation in minimally invasive surgery using force/torque signatures. Surgical Endoscopy, 14, 791–798.
Rosen, J., Brown, J., Chang, L., & Hannaford, B. (2006). Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete Markov model. IEEE Transactions on Biomedical Engineering, 53, 399–413.
Sarkar, A., Dutta, A., Dhingra, U., Dhingra, P., Verma, P., Juyal, R., et al. (2006). Development and use of behavior and social interaction software installed on Palm handheld for observation of a child’s social interactions with the environment. Behavior Research Methods, 38, 407–415.
Schuster, M., Wicha, L., Fiege, M., & Goetz, A. (2007). Utilization rates and turnover times as indicators of OR workflow efficiency. Der Anaesthesist, 56, 1060–1066.
Stanford University (2009). The Protégé Ontology Editor and Knowledge Acquisition System Version 3.4.1. Retrieved July 24, 2009, from http://protege.stanford.edu/.
Strauss, G., Fischer, M., Meixensberger, J., Falk, V., Trantakis, C., Winkler, D., et al. (2006). Workflow analysis to assess the efficiency of intraoperative technology using the example of functional endoscopic sinus surgery. HNO, 54, 528–535. doi:10.1007/s00106-005-1345-8
Workflow Management Coalition (1999). Terminology and glossary (Document WFMC-TC-1011, Document Status-Issue 3.0). Winchester, U.K.: Author.
Author information
Authors and Affiliations
Corresponding author
Additional information
ICCAS is funded by the German Federal Ministry of Education and Research (BMBF) and the Saxon Ministry of Science and Fine Arts (SMWK) in the scope of the Unternehmen Region by Grants 03 ZIK 031 and 03 ZIK 032 and by the European Regional Development Fund (ERDF) within the framework of measures supporting the technology sector.
Rights and permissions
About this article
Cite this article
Neumuth, T., Kaschek, B., Neumuth, D. et al. An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions. Behavior Research Methods 42, 1049–1058 (2010). https://doi.org/10.3758/BRM.42.4.1049
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BRM.42.4.1049