Skip to main content
Top
Published in: The Journal of Supercomputing 7/2021

02-01-2021

Enhanced path planning for automated nanites drug delivery based on reinforcement learning and polymorphic improved ant colony optimization

Authors: Seyyed Parham Haghighate Pazhohe Tabrizi, Akram Reza, Seyed Mahdi Jameii

Published in: The Journal of Supercomputing | Issue 7/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nanorobots have the potential to greatly accelerate the evolution of modern medical approaches and practices. Moreover, using artificial intelligence in a medical procedure is a rapidly growing part of today’s research. Medical surgery equipment’s are undergoing evolutionary advancement and microscopy procedures turn out to be an indispensable tool for nano-sample imaging, injection of medicine or surgery. In nanoscale, accurate path planning for nanites in order to reach their destination is still a challenge especially when most of the surgeries involving nanites are still being proceeded by a human operator through an interface. This article presents an algorithm capable of parallel processing of path planning with Q-learning and ACO order to reach a considerable improvement in nano-medicine delivery and optimization of path length and increasing accuracy of the results. We used autonomous path planning for post-nanite injection in vessels. We reached environmental perception and the ability to navigate quicker and more accurately in exchange with for more processing power and memory usage which will be considered an efficient trade-off (ANDD framework). The main objective of the experiments is to evaluate the performance of the proposed adaptive agent’s method after it efficiently planed the path autonomously and optimized the length of the nanite swarm traveling distance. Simulation outcomes reveal that the introduced method can accomplish various objectives continuously, such as recalculation of an optimal path in case of a sudden change in patient tumor location, time efficiency in decision-making through the operation and decrease in error ratio.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Footnotes
1
Dynamic Q-learning.
 
Literature
1.
go back to reference Diller E, Zhang J (2018) Mobile device for grasping and active release of objects. Google Patents Diller E, Zhang J (2018) Mobile device for grasping and active release of objects. Google Patents
3.
go back to reference Yadav S, Sheoran P (2016) Smart wheelchairs-a literature review. Int J Inov Emerg Res Eng 3(2):86–90 Yadav S, Sheoran P (2016) Smart wheelchairs-a literature review. Int J Inov Emerg Res Eng 3(2):86–90
4.
go back to reference Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, CambridgeMATH Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, CambridgeMATH
5.
go back to reference Gigras Y, Gupta K (2012) Ant colony based path planning algorithm for autonomous robotic vehicles. Int J Artif Intell Appl 3(6):31 Gigras Y, Gupta K (2012) Ant colony based path planning algorithm for autonomous robotic vehicles. Int J Artif Intell Appl 3(6):31
6.
go back to reference Hachour O (2008) Path planning of autonomous mobile robot. Int J Syst Appl Eng Dev 2(4):178–190 Hachour O (2008) Path planning of autonomous mobile robot. Int J Syst Appl Eng Dev 2(4):178–190
7.
go back to reference Tuncer A, Yildirim M (2012) Dynamic path planning of mobile robots with improved genetic algorithm. Comput Electr Eng 38(6):1564–1572CrossRef Tuncer A, Yildirim M (2012) Dynamic path planning of mobile robots with improved genetic algorithm. Comput Electr Eng 38(6):1564–1572CrossRef
8.
go back to reference Florczyk S (2005) Robot vision: video-based indoor exploration with autonomous and mobile robots. Wiley, Hoboken Florczyk S (2005) Robot vision: video-based indoor exploration with autonomous and mobile robots. Wiley, Hoboken
9.
go back to reference Eichhorn V, Carlson K, Andersen K, Fatikow S, Boggild P (2007) Nanorobotic manipulation setup for pick-and-place handling and nondestructive characterization of carbon nanotubes. In: 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems Eichhorn V, Carlson K, Andersen K, Fatikow S, Boggild P (2007) Nanorobotic manipulation setup for pick-and-place handling and nondestructive characterization of carbon nanotubes. In: 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems
10.
go back to reference Abdulkader MM, Gajpal Y, ElMekkawy TY (2015) Hybridized ant colony algorithm for the multi compartment vehicle routing problem. Appl Soft Comput 37:196–203CrossRef Abdulkader MM, Gajpal Y, ElMekkawy TY (2015) Hybridized ant colony algorithm for the multi compartment vehicle routing problem. Appl Soft Comput 37:196–203CrossRef
11.
go back to reference Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: MHS’95. Proceedings of the sixth international symposium on micro machine and human science Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: MHS’95. Proceedings of the sixth international symposium on micro machine and human science
12.
go back to reference Huang H, Savkin AV (2017) Viable path planning for data collection robots in a sensing field with obstacles. Comput Commun 111:84–96CrossRef Huang H, Savkin AV (2017) Viable path planning for data collection robots in a sensing field with obstacles. Comput Commun 111:84–96CrossRef
13.
go back to reference Li G, Xi N, Yu M, Fung W-K (2004) Development of augmented reality system for AFM-based nanomanipulation. IEEE ASME Trans Mechatron 9(2):358–365CrossRef Li G, Xi N, Yu M, Fung W-K (2004) Development of augmented reality system for AFM-based nanomanipulation. IEEE ASME Trans Mechatron 9(2):358–365CrossRef
14.
go back to reference Xu J-M, Cao X-B, Wang X-F (2005) Polymorphic ant colony algorithm. J Univ Sci Technol China 35(1):59–65MathSciNet Xu J-M, Cao X-B, Wang X-F (2005) Polymorphic ant colony algorithm. J Univ Sci Technol China 35(1):59–65MathSciNet
15.
go back to reference Rizvi NS, Keole RR (2014) Preliminary review of swarm intelligence: a clever algorithm and data clustering. Int J Comput Sci Info Technol 5(2):1892–1899 Rizvi NS, Keole RR (2014) Preliminary review of swarm intelligence: a clever algorithm and data clustering. Int J Comput Sci Info Technol 5(2):1892–1899
16.
go back to reference Holland OE, Melhuish CR (1997) Getting the most from the least: lessons for the nanoscale from minimal mobile agents. In: Langton CG, Shimohara K (eds) Artificial life v: proceedings of the fifth international workshop on the synthesis and simulation of living systems. MIT Press, pp 59–66 Holland OE, Melhuish CR (1997) Getting the most from the least: lessons for the nanoscale from minimal mobile agents. In: Langton CG, Shimohara K (eds) Artificial life v: proceedings of the fifth international workshop on the synthesis and simulation of living systems. MIT Press, pp 59–66
17.
go back to reference Jiao Z, Ma K, Rong Y, Wang P, Zhang H, Wang S (2018) A path planning method using adaptive polymorphic ant colony algorithm for smart wheelchairs. J Comput Sci 25:50–57MathSciNetCrossRef Jiao Z, Ma K, Rong Y, Wang P, Zhang H, Wang S (2018) A path planning method using adaptive polymorphic ant colony algorithm for smart wheelchairs. J Comput Sci 25:50–57MathSciNetCrossRef
18.
go back to reference Moreno L, Puente EA, Salichs MA (1992) World modelling and sensor data fusion in a non static environment. Appl Mob Robots 25(6):433–436 Moreno L, Puente EA, Salichs MA (1992) World modelling and sensor data fusion in a non static environment. Appl Mob Robots 25(6):433–436
19.
go back to reference Xu T, Zhang J, Salehizadeh M, Onaizah O, Diller E (2019) Millimeter-scale flexible robots with programmable three-dimensional magnetization and motions. Science 4(29):eaav4494 Xu T, Zhang J, Salehizadeh M, Onaizah O, Diller E (2019) Millimeter-scale flexible robots with programmable three-dimensional magnetization and motions. Science 4(29):eaav4494
20.
go back to reference Bartenwerfer M, Fatikow S (2012) Nanorobot-based handling and transfer of individual silicon nanowires. Int J Intell Mechatron Robot (IJIMR) 2(2):34–46 Bartenwerfer M, Fatikow S (2012) Nanorobot-based handling and transfer of individual silicon nanowires. Int J Intell Mechatron Robot (IJIMR) 2(2):34–46
21.
go back to reference Luo H, Jian X, Lu W (2014) Optimal test node selection based on dynamic ant colony algorithm for analog circuit. Chin J Sci Instrum 35(10):2231–2237 Luo H, Jian X, Lu W (2014) Optimal test node selection based on dynamic ant colony algorithm for analog circuit. Chin J Sci Instrum 35(10):2231–2237
22.
go back to reference Hachour O (2009) The proposed hybrid intelligent system for path planning of intelligent autonomous systems. Int J Math Comput Simul 3:133–145 Hachour O (2009) The proposed hybrid intelligent system for path planning of intelligent autonomous systems. Int J Math Comput Simul 3:133–145
23.
go back to reference Qu H, Huang L-W, Ke X (2015) Research of improved ant colony based robot path planning under dynamic environment. J Univ Electron Sci Technol China 44(2):260–265 Qu H, Huang L-W, Ke X (2015) Research of improved ant colony based robot path planning under dynamic environment. J Univ Electron Sci Technol China 44(2):260–265
24.
go back to reference Zhang Y, Yang J, Wang S, Dong Z, Phillips P (2017) Pathological brain detection in MRI scanning via Hu moment invariants and machine learning. J Exp Theor Artif Intell 29(2):299–312CrossRef Zhang Y, Yang J, Wang S, Dong Z, Phillips P (2017) Pathological brain detection in MRI scanning via Hu moment invariants and machine learning. J Exp Theor Artif Intell 29(2):299–312CrossRef
25.
go back to reference Zhang Y, Wang S, Phillips P, Ji G-B (2014) Binary PSO with mutation operator for feature selection using decision tree applied to spam detection. Knowl Based Syst 64:22–31CrossRef Zhang Y, Wang S, Phillips P, Ji G-B (2014) Binary PSO with mutation operator for feature selection using decision tree applied to spam detection. Knowl Based Syst 64:22–31CrossRef
26.
go back to reference Thompson SE, Chau RS, Ghani T, Mistry K, Tyagi S, Bohr MT (2005) In search of “Forever” continued transistor scaling one new material at a time. IEEE Trans Semicond Manuf 18(1):26–36CrossRef Thompson SE, Chau RS, Ghani T, Mistry K, Tyagi S, Bohr MT (2005) In search of “Forever” continued transistor scaling one new material at a time. IEEE Trans Semicond Manuf 18(1):26–36CrossRef
27.
go back to reference Falcone E, Gockley R, Porter E, Nourbakhsh I (2003) The personal rover project: the comprehensive design of a domestic personal robot. Robot Auton Syst 42(3–4):245–258CrossRef Falcone E, Gockley R, Porter E, Nourbakhsh I (2003) The personal rover project: the comprehensive design of a domestic personal robot. Robot Auton Syst 42(3–4):245–258CrossRef
28.
go back to reference Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B (Cybern) 26(1):29–41CrossRef Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B (Cybern) 26(1):29–41CrossRef
29.
go back to reference Lim C, Dehuri S (2009) Innovations in swarm intelligence, vol 248. Springer, BerlinCrossRef Lim C, Dehuri S (2009) Innovations in swarm intelligence, vol 248. Springer, BerlinCrossRef
30.
go back to reference Zhang Y, Lu S, Zhou X, Yang M, Wu L, Liu B et al (2016) Comparison of machine learning methods for stationary wavelet entropy-based multiple sclerosis detection: decision tree, k-nearest neighbors, and support vector machine. Simulation 92(9):861–871CrossRef Zhang Y, Lu S, Zhou X, Yang M, Wu L, Liu B et al (2016) Comparison of machine learning methods for stationary wavelet entropy-based multiple sclerosis detection: decision tree, k-nearest neighbors, and support vector machine. Simulation 92(9):861–871CrossRef
31.
go back to reference Son C (2016) Intelligent rule-based sequence planning algorithm with fuzzy optimization for robot manipulation tasks in partially dynamic environments. Inf Sci 342:209–221CrossRef Son C (2016) Intelligent rule-based sequence planning algorithm with fuzzy optimization for robot manipulation tasks in partially dynamic environments. Inf Sci 342:209–221CrossRef
32.
go back to reference Tulevski GS, Franklin AD, Frank D, Lobez JM, Cao Q, Park H et al (2014) Toward high-performance digital logic technology with carbon nanotubes. ACS Nano 8(9):8730–8745CrossRef Tulevski GS, Franklin AD, Frank D, Lobez JM, Cao Q, Park H et al (2014) Toward high-performance digital logic technology with carbon nanotubes. ACS Nano 8(9):8730–8745CrossRef
33.
go back to reference Neoh S, Morad N, Marzuki A, Lim C, Aziz Z (2009) A multi-resolution GA-PSO layered encoding cascade optimization model. In: Neoh S, Morad N, Marzuki A, Lim C, Aziz Z (eds) Innovations in swarm intelligence. Springer, Berlin, pp 121–140CrossRef Neoh S, Morad N, Marzuki A, Lim C, Aziz Z (2009) A multi-resolution GA-PSO layered encoding cascade optimization model. In: Neoh S, Morad N, Marzuki A, Lim C, Aziz Z (eds) Innovations in swarm intelligence. Springer, Berlin, pp 121–140CrossRef
34.
go back to reference Savkin AV, Huang H (2017). Optimal aircraft planar navigation in static threat environments. IEEE Trans Aerosp Electron Syst 53(5):2413–2426CrossRef Savkin AV, Huang H (2017). Optimal aircraft planar navigation in static threat environments. IEEE Trans Aerosp Electron Syst 53(5):2413–2426CrossRef
35.
go back to reference Wang Y, Yang Z, Chen T, Yang L, Sun L, Fukuda T (2016) CNT handling with van der Waals force inside a SEM for FET application. In: 2016 IEEE 11th Annual International Conference on Nano/micro Engineered and Molecular Systems (NEMS) Wang Y, Yang Z, Chen T, Yang L, Sun L, Fukuda T (2016) CNT handling with van der Waals force inside a SEM for FET application. In: 2016 IEEE 11th Annual International Conference on Nano/micro Engineered and Molecular Systems (NEMS)
36.
go back to reference Zhang Y, Wu L, Wei G, Wang S (2011) A novel algorithm for all pairs shortest path problem based on matrix multiplication and pulse coupled neural network. Digit Signal Process 21(4):517–521CrossRef Zhang Y, Wu L, Wei G, Wang S (2011) A novel algorithm for all pairs shortest path problem based on matrix multiplication and pulse coupled neural network. Digit Signal Process 21(4):517–521CrossRef
37.
go back to reference Sheng G, Wen T, Guo Q, Song X (2013) Trustworthy service discovery based on a modified ant colony algorithm. J Commun 34(10):37–48 Sheng G, Wen T, Guo Q, Song X (2013) Trustworthy service discovery based on a modified ant colony algorithm. J Commun 34(10):37–48
38.
go back to reference Korayem MH, Hoshiar AK, Nazarahari M (2016) A hybrid co-evolutionary genetic algorithm for multiple nanoparticle assembly task path planning. Int J Adv Manuf Technol 87(9–12):3527–3543CrossRef Korayem MH, Hoshiar AK, Nazarahari M (2016) A hybrid co-evolutionary genetic algorithm for multiple nanoparticle assembly task path planning. Int J Adv Manuf Technol 87(9–12):3527–3543CrossRef
39.
go back to reference Chang Y, Wang X, An Z, Wang H (2018) Robotic path planning using A* algorithm for automatic navigation in magnetic resonance angiography. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, pp 734–737 Chang Y, Wang X, An Z, Wang H (2018) Robotic path planning using A* algorithm for automatic navigation in magnetic resonance angiography. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, pp 734–737
40.
go back to reference Elsayed S, Amin S, Alarif T (2014) Assessment of applying path planning technique to nanorobots in a human blood environment. In: 2014 European modelling symposium. IEEE, pp 45–51 Elsayed S, Amin S, Alarif T (2014) Assessment of applying path planning technique to nanorobots in a human blood environment. In: 2014 European modelling symposium. IEEE, pp 45–51
Metadata
Title
Enhanced path planning for automated nanites drug delivery based on reinforcement learning and polymorphic improved ant colony optimization
Authors
Seyyed Parham Haghighate Pazhohe Tabrizi
Akram Reza
Seyed Mahdi Jameii
Publication date
02-01-2021
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 7/2021
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-020-03559-6

Other articles of this Issue 7/2021

The Journal of Supercomputing 7/2021 Go to the issue

Premium Partner