Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 9/2018

11-05-2018 | Original Article

Robust path planning for flexible needle insertion using Markov decision processes

Authors: Xiaoyu Tan, Pengqian Yu, Kah-Bin Lim, Chee-Kong Chui

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 9/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Flexible needle has the potential to accurately navigate to a treatment region in the least invasive manner. We propose a new planning method using Markov decision processes (MDPs) for flexible needle navigation that can perform robust path planning and steering under the circumstance of complex tissue–needle interactions.

Methods

This method enhances the robustness of flexible needle steering from three different perspectives. First, the method considers the problem caused by soft tissue deformation. The method then resolves the common needle penetration failure caused by patterns of targets, while the last solution addresses the uncertainty issues in flexible needle motion due to complex and unpredictable tissue–needle interaction.

Results

Computer simulation and phantom experimental results show that the proposed method can perform robust planning and generate a secure control policy for flexible needle steering. Compared with a traditional method using MDPs, the proposed method achieves higher accuracy and probability of success in avoiding obstacles under complicated and uncertain tissue–needle interactions. Future work will involve experiment with biological tissue in vivo.

Conclusion

The proposed robust path planning method can securely steer flexible needle within soft phantom tissues and achieve high adaptability in computer simulation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Abolhassani N, Patel R, Moallem M (2007) Needle insertion into soft tissue: a survey. Med Eng Phys 29(4):413–431CrossRefPubMed Abolhassani N, Patel R, Moallem M (2007) Needle insertion into soft tissue: a survey. Med Eng Phys 29(4):413–431CrossRefPubMed
4.
go back to reference Doi K (2007) Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph 31(4):198–211CrossRefPubMedPubMedCentral Doi K (2007) Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph 31(4):198–211CrossRefPubMedPubMedCentral
5.
go back to reference Nath S, Chen Z, Yue N, Trumpore S, Peschel R (2000) Dosimetric effects of needle divergence in prostate seed implant using 125i and 103pd radioactive seeds. Med Phys 27(5):1058–1066CrossRefPubMed Nath S, Chen Z, Yue N, Trumpore S, Peschel R (2000) Dosimetric effects of needle divergence in prostate seed implant using 125i and 103pd radioactive seeds. Med Phys 27(5):1058–1066CrossRefPubMed
6.
go back to reference Carr JJ, Hemler PF, Halford PW, Freimanis RI, Choplin RH, Chen MYM (2001) Stereotactic localization of breast lesions: how it works and methods to improve accuracy. Radiographics 21(2):463–473CrossRefPubMed Carr JJ, Hemler PF, Halford PW, Freimanis RI, Choplin RH, Chen MYM (2001) Stereotactic localization of breast lesions: how it works and methods to improve accuracy. Radiographics 21(2):463–473CrossRefPubMed
7.
go back to reference Taschereau R, Pouliot J, Roy J, Tremblay D (2000) Seed misplacement and stabilizing needles in transperineal permanent prostate implants. Radiother Oncol 55(1):59–63CrossRefPubMed Taschereau R, Pouliot J, Roy J, Tremblay D (2000) Seed misplacement and stabilizing needles in transperineal permanent prostate implants. Radiother Oncol 55(1):59–63CrossRefPubMed
8.
go back to reference Narayana V, Roberson PL, Winfield RJ, Kessler ML, McLaughlin PW (1996) Optimal placement of radioisotopes for permanent prostate implants. Radiology 199(2):457–460CrossRefPubMed Narayana V, Roberson PL, Winfield RJ, Kessler ML, McLaughlin PW (1996) Optimal placement of radioisotopes for permanent prostate implants. Radiology 199(2):457–460CrossRefPubMed
9.
go back to reference Alterovitz R, Branicky M, Goldberg K (2008) Motion planning under uncertainty for image-guided medical needle steering. Int J Robot Res 27(11–12):1361–1374CrossRef Alterovitz R, Branicky M, Goldberg K (2008) Motion planning under uncertainty for image-guided medical needle steering. Int J Robot Res 27(11–12):1361–1374CrossRef
10.
go back to reference Donaldson MS, Corrigan JM, Kohn LT (2000) To err is human: building a safer health system, vol 6. National Academies Press, Washington Donaldson MS, Corrigan JM, Kohn LT (2000) To err is human: building a safer health system, vol 6. National Academies Press, Washington
11.
go back to reference Robert J, Webster III, Kim JS, Cowan NJ, Chirikjian GS, Okamura AM (2006) Nonholonomic modeling of needle steering. Int J Robot Res 25(5–6):509–525 Robert J, Webster III, Kim JS, Cowan NJ, Chirikjian GS, Okamura AM (2006) Nonholonomic modeling of needle steering. Int J Robot Res 25(5–6):509–525
12.
go back to reference Webster RJ, Memisevic J, Okamura AM (2005) Design considerations for robotic needle steering. In: Proceedings of the 2005 IEEE international conference on robotics and automation, ICRA 2005. IEEE, pp 3588–3594 Webster RJ, Memisevic J, Okamura AM (2005) Design considerations for robotic needle steering. In: Proceedings of the 2005 IEEE international conference on robotics and automation, ICRA 2005. IEEE, pp 3588–3594
13.
go back to reference Leong F, Huang W-H, Chui C-K (2013) Modeling and analysis of coagulated liver tissue and its interaction with a scalpel blade. Med Biol Eng Comput 51(6):687–695CrossRefPubMed Leong F, Huang W-H, Chui C-K (2013) Modeling and analysis of coagulated liver tissue and its interaction with a scalpel blade. Med Biol Eng Comput 51(6):687–695CrossRefPubMed
14.
go back to reference Fu YB, Chui CK (2014) Modelling and simulation of porcine liver tissue indentation using finite element method and uniaxial stress–strain data. J Biomech 47(10):2430–2435CrossRefPubMed Fu YB, Chui CK (2014) Modelling and simulation of porcine liver tissue indentation using finite element method and uniaxial stress–strain data. J Biomech 47(10):2430–2435CrossRefPubMed
15.
go back to reference Fu YB, Chui CK, Teo CL (2013) Liver tissue characterization from uniaxial stress-strain data using probabilistic and inverse finite element methods. J Mech Behav Biomed Mater 20:105–112CrossRefPubMed Fu YB, Chui CK, Teo CL (2013) Liver tissue characterization from uniaxial stress-strain data using probabilistic and inverse finite element methods. J Mech Behav Biomed Mater 20:105–112CrossRefPubMed
16.
go back to reference O’Reilly MS, Boehm T, Shing Y, Fukai N, Vasios G, Lane WS, Flynn E, Birkhead JR, Olsen BR, Folkman J (1997) Endostatin: an endogenous inhibitor of angiogenesis and tumor growth. Cell 88(2):277–285CrossRefPubMed O’Reilly MS, Boehm T, Shing Y, Fukai N, Vasios G, Lane WS, Flynn E, Birkhead JR, Olsen BR, Folkman J (1997) Endostatin: an endogenous inhibitor of angiogenesis and tumor growth. Cell 88(2):277–285CrossRefPubMed
17.
go back to reference Abayazid M, Vrooijink GJV, Patil S, Alterovitz R, Misra S (2014) Experimental evaluation of ultrasound-guided 3d needle steering in biological tissue. Int J Comput Assist Radiol Surg 9(6):931–939CrossRefPubMedPubMedCentral Abayazid M, Vrooijink GJV, Patil S, Alterovitz R, Misra S (2014) Experimental evaluation of ultrasound-guided 3d needle steering in biological tissue. Int J Comput Assist Radiol Surg 9(6):931–939CrossRefPubMedPubMedCentral
18.
go back to reference Vrooijink JG, Abayazid M, Patil S, Alterovitz R, Misra S (2014) Needle path planning and steering in a three-dimensional non-static environment using two-dimensional ultrasound images. Int J Robot Res 33(10):1361–1374CrossRef Vrooijink JG, Abayazid M, Patil S, Alterovitz R, Misra S (2014) Needle path planning and steering in a three-dimensional non-static environment using two-dimensional ultrasound images. Int J Robot Res 33(10):1361–1374CrossRef
20.
go back to reference Alterovitz R, Lim A, Goldberg K, Chirikjian GS, Okamura AM (2005) Steering flexible needles under Markov motion uncertainty. In: 2005 IEEE/RSJ international conference on intelligent robots and systems, (IROS 2005). IEEE, pp 1570–1575 Alterovitz R, Lim A, Goldberg K, Chirikjian GS, Okamura AM (2005) Steering flexible needles under Markov motion uncertainty. In: 2005 IEEE/RSJ international conference on intelligent robots and systems, (IROS 2005). IEEE, pp 1570–1575
21.
go back to reference Alterovitz R, Siméon T, Goldberg KY (2007) The stochastic motion roadmap: a sampling framework for planning with Markov motion uncertainty. In: Robotics: science and systems, vol 3, pp 233–241 Alterovitz R, Siméon T, Goldberg KY (2007) The stochastic motion roadmap: a sampling framework for planning with Markov motion uncertainty. In: Robotics: science and systems, vol 3, pp 233–241
22.
go back to reference Pengqian Y, Huan X (2016) Distributionally robust counterpart in Markov decision processes. IEEE Trans Autom Control 61(9):2538–2543CrossRef Pengqian Y, Huan X (2016) Distributionally robust counterpart in Markov decision processes. IEEE Trans Autom Control 61(9):2538–2543CrossRef
23.
go back to reference DiMaio S, Salcudean SE (2003) Needle insertion modeling and simulation. IEEE Trans Robot Autom 19(5):864–875CrossRef DiMaio S, Salcudean SE (2003) Needle insertion modeling and simulation. IEEE Trans Robot Autom 19(5):864–875CrossRef
24.
go back to reference DiMaio PS, Salcudean SE (2005) Needle steering and motion planning in soft tissues. IEEE Trans Biomed Eng 52(6):965–974CrossRefPubMed DiMaio PS, Salcudean SE (2005) Needle steering and motion planning in soft tissues. IEEE Trans Biomed Eng 52(6):965–974CrossRefPubMed
25.
go back to reference Glozman D, Shoham M (2006) Flexible needle steering for percutaneous therapies. Computer Aided Surg 11(4):194–201CrossRef Glozman D, Shoham M (2006) Flexible needle steering for percutaneous therapies. Computer Aided Surg 11(4):194–201CrossRef
27.
go back to reference Shahriari N, Roesthuis RJ, van de Berg NJ, van den Dobbelsteen JJ, Misra S (2016) Steering an actuated-tip needle in biological tissue: fusing fbg-sensor data and ultrasound images. In: 2016 IEEE international conference on robotics and automation (ICRA). IEEE, pp 4443–4449 Shahriari N, Roesthuis RJ, van de Berg NJ, van den Dobbelsteen JJ, Misra S (2016) Steering an actuated-tip needle in biological tissue: fusing fbg-sensor data and ultrasound images. In: 2016 IEEE international conference on robotics and automation (ICRA). IEEE, pp 4443–4449
28.
go back to reference Suetens P (2017) Fundamentals of medical imaging. Cambridge University Press, CambridgeCrossRef Suetens P (2017) Fundamentals of medical imaging. Cambridge University Press, CambridgeCrossRef
29.
go back to reference Thie PR (1983) Markov decision processes. Comap, Incorporated, Bedford Thie PR (1983) Markov decision processes. Comap, Incorporated, Bedford
30.
go back to reference Bertsekas DP, Bertsekas DP, Bertsekas DP, Bertsekas DP (1995) Dynamic programming and optimal control, vol 1. Athena Scientific, Belmont Bertsekas DP, Bertsekas DP, Bertsekas DP, Bertsekas DP (1995) Dynamic programming and optimal control, vol 1. Athena Scientific, Belmont
31.
go back to reference Mostafa A, Fouad A, Elfattah MA, Hassanien AE, Hefny H, Zhu SY, Schaefer G (2015) Ct liver segmentation using artificial bee colony optimisation. Proc Comput Sci 60:1622–1630CrossRef Mostafa A, Fouad A, Elfattah MA, Hassanien AE, Hefny H, Zhu SY, Schaefer G (2015) Ct liver segmentation using artificial bee colony optimisation. Proc Comput Sci 60:1622–1630CrossRef
32.
go back to reference Norajitra T, Meinzer H-P, Maier-Hein KH (2015) 3d statistical shape models incorporating 3d random forest regression voting for robust ct liver segmentation. In: Proceedings of SPIE, vol 9414, p 941406 Norajitra T, Meinzer H-P, Maier-Hein KH (2015) 3d statistical shape models incorporating 3d random forest regression voting for robust ct liver segmentation. In: Proceedings of SPIE, vol 9414, p 941406
33.
go back to reference Duan B, Wen R, Chng C-B, Wang W, Liu P, Qin J, Peneyra JL, Chang Stephen K-Y, Heng P-A, Chui C-K (2015) Image-guided robotic system for radiofrequency ablation of large liver tumor with single incision. In: 2015 12th international conference on ubiquitous robots and ambient intelligence (URAI). IEEE, pp 284–289 Duan B, Wen R, Chng C-B, Wang W, Liu P, Qin J, Peneyra JL, Chang Stephen K-Y, Heng P-A, Chui C-K (2015) Image-guided robotic system for radiofrequency ablation of large liver tumor with single incision. In: 2015 12th international conference on ubiquitous robots and ambient intelligence (URAI). IEEE, pp 284–289
34.
go back to reference Yang L, Wen R, Qin J, Chui C-K, Lim K-B, Chang SK-Y (2010) A robotic system for overlapping radiofrequency ablation in large tumor treatment. IEEE/ASME Trans Mechatron 15(6):887–897CrossRef Yang L, Wen R, Qin J, Chui C-K, Lim K-B, Chang SK-Y (2010) A robotic system for overlapping radiofrequency ablation in large tumor treatment. IEEE/ASME Trans Mechatron 15(6):887–897CrossRef
35.
go back to reference Liu Y, Kerdok AE, Howe RD (2004) A nonlinear finite element model of soft tissue indentation. Lect Notes Comput Sci 3078:67–76CrossRef Liu Y, Kerdok AE, Howe RD (2004) A nonlinear finite element model of soft tissue indentation. Lect Notes Comput Sci 3078:67–76CrossRef
36.
go back to reference Varadhan G, Manocha D (2006) Accurate Minkowski sum approximation of polyhedral models. Graph Models 68(4):343–355CrossRef Varadhan G, Manocha D (2006) Accurate Minkowski sum approximation of polyhedral models. Graph Models 68(4):343–355CrossRef
37.
go back to reference van de Berg NJ, van Gerwen DJ, Dankelman J, van den Dobbelsteen JJ (2015) Design choices in needle steeringa review. IEEE/ASME Trans Mechatron 20(5):2172–2183CrossRef van de Berg NJ, van Gerwen DJ, Dankelman J, van den Dobbelsteen JJ (2015) Design choices in needle steeringa review. IEEE/ASME Trans Mechatron 20(5):2172–2183CrossRef
38.
go back to reference Tan X, Chng C-B, Duan B, Ho Y, Wen R, Chen X, Lim K-B, Chui C-K (2016) Design and implementation of a patient-specific cognitive engine for robotic needle insertion. In: 2016 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 000560–000565 Tan X, Chng C-B, Duan B, Ho Y, Wen R, Chen X, Lim K-B, Chui C-K (2016) Design and implementation of a patient-specific cognitive engine for robotic needle insertion. In: 2016 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 000560–000565
39.
go back to reference Tan X, Chng C-B, Duan B, Ho Y, Wen R, Chen X, Lim K-B, Chui C-K (2017) Cognitive engine for robot-assisted radio-frequency ablation system. Acta Polytech Hung 14(1):129–145 Tan X, Chng C-B, Duan B, Ho Y, Wen R, Chen X, Lim K-B, Chui C-K (2017) Cognitive engine for robot-assisted radio-frequency ablation system. Acta Polytech Hung 14(1):129–145
Metadata
Title
Robust path planning for flexible needle insertion using Markov decision processes
Authors
Xiaoyu Tan
Pengqian Yu
Kah-Bin Lim
Chee-Kong Chui
Publication date
11-05-2018
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 9/2018
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1783-x

Other articles of this Issue 9/2018

International Journal of Computer Assisted Radiology and Surgery 9/2018 Go to the issue

Premium Partner