Skip to main content
Top

2020 | OriginalPaper | Chapter

9. Introducing Domain Knowledge

Authors : Akka Zemmari, Jenny Benois-Pineau

Published in: Deep Learning in Mining of Visual Content

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this chapter we will consider another application case of Deep learning: classification of brain images for detection of Alzheimer’s disease. In this particular application of medical imaging domain, Deep NNs have become the mandatory tool. In this chapter we give some highlights on how the usual steps in design of a Deep Neural Network classifier are implemented in the case when domain knowledge has to be considered. But more than that: faithful to our principle of showing new aspects of Deep Learning even in application cases, we will show how information fusion with siamese CNNs helps in increasing of performances of these classifiers.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
ABBP+17.
go back to reference Karim Aderghal, Manuel Boissenin, Jenny Benois-Pineau, Gwenaëlle Catheline, and Karim Afdel. Classification of sMRI for AD diagnosis with convolutional neuronal networks: A pilot 2d+𝜖 study on ADNI. In International Conference on Multimedia Modeling, pages 690–701. Springer, Cham, 2017. Karim Aderghal, Manuel Boissenin, Jenny Benois-Pineau, Gwenaëlle Catheline, and Karim Afdel. Classification of sMRI for AD diagnosis with convolutional neuronal networks: A pilot 2d+𝜖 study on ADNI. In International Conference on Multimedia Modeling, pages 690–701. Springer, Cham, 2017.
ABPAC17.
go back to reference Karim Aderghal, Jenny Benois-Pineau, Karim Afdel, and Gwenaëlle Catheline. FuseMe: Classification of sMRI images by fusion of deep CNNs in 2d+𝜖 projections. In Proceedings of the 15th International Workshop on Content-Based Indexing, page 34. ACM, 2017. Karim Aderghal, Jenny Benois-Pineau, Karim Afdel, and Gwenaëlle Catheline. FuseMe: Classification of sMRI images by fusion of deep CNNs in 2d+𝜖 projections. In Proceedings of the 15th International Workshop on Content-Based Indexing, page 34. ACM, 2017.
AF97.
go back to reference John Ashburner and K Friston. Multimodal image coregistration and partitioning—a unified framework. Neuroimage, 6(3):209–217, 1997.CrossRef John Ashburner and K Friston. Multimodal image coregistration and partitioning—a unified framework. Neuroimage, 6(3):209–217, 1997.CrossRef
AKK+18.
go back to reference Karim Aderghal, Alexander Khvostikov, Andrei Krylov, Jenny Benois-Pineau, Karim Afdel, and Gwenaelle Catheline. Classification of Alzheimer disease on imaging modalities with deep CNNs using cross-modal transfer learning. In 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS), pages 345–350. IEEE, 2018. Karim Aderghal, Alexander Khvostikov, Andrei Krylov, Jenny Benois-Pineau, Karim Afdel, and Gwenaelle Catheline. Classification of Alzheimer disease on imaging modalities with deep CNNs using cross-modal transfer learning. In 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS), pages 345–350. IEEE, 2018.
ANC+97.
go back to reference John Ashburner, P Neelin, DL Collins, A Evans, and K Friston. Incorporating prior knowledge into image registration. Neuroimage, 6(4):344–352, 1997.CrossRef John Ashburner, P Neelin, DL Collins, A Evans, and K Friston. Incorporating prior knowledge into image registration. Neuroimage, 6(4):344–352, 1997.CrossRef
BB91.
go back to reference Heiko Braak and Eva Braak. Neuropathological stageing of Alzheimer-related changes. Acta neuropathologica, 82(4):239–259, 1991.CrossRef Heiko Braak and Eva Braak. Neuropathological stageing of Alzheimer-related changes. Acta neuropathologica, 82(4):239–259, 1991.CrossRef
BBB+93.
go back to reference Jane Bromley, James W. Bentz, Léon Bottou, Isabelle Guyon, Yann LeCun, Cliff Moore, Eduard Säckinger, and Roopak Shah. Signature verification using A “siamese” time delay neural network. IJPRAI, 7(4):669–688, 1993. Jane Bromley, James W. Bentz, Léon Bottou, Isabelle Guyon, Yann LeCun, Cliff Moore, Eduard Säckinger, and Roopak Shah. Signature verification using A “siamese” time delay neural network. IJPRAI, 7(4):669–688, 1993.
BCH+14.
go back to reference Robert W. Brown, Y.-C. Norman Cheng, Mark E. Haacke, Michael R. Thomson, and Ramesh Vnekatesan. Magnetic Resonance Imaging: Physical Principles and Sequence Design 2nd Edition. John Wiley & Sons, Inc. N.Y., 2014. Robert W. Brown, Y.-C. Norman Cheng, Mark E. Haacke, Michael R. Thomson, and Ramesh Vnekatesan. Magnetic Resonance Imaging: Physical Principles and Sequence Design 2nd Edition. John Wiley & Sons, Inc. N.Y., 2014.
BGL+94.
go back to reference Jane Bromley, Isabelle Guyon, Yann LeCun, Eduard Säckinger, and Roopak Shah. Signature verification using a “siamese” time delay neural network. In Advances in neural information processing systems, pages 737–744, 1994. Jane Bromley, Isabelle Guyon, Yann LeCun, Eduard Säckinger, and Roopak Shah. Signature verification using a “siamese” time delay neural network. In Advances in neural information processing systems, pages 737–744, 1994.
BML94.
go back to reference Peter J Basser, James Mattiello, and Denis LeBihan. MR diffusion tensor spectroscopy and imaging. Biophysical journal, 66(1):259–267, 1994.CrossRef Peter J Basser, James Mattiello, and Denis LeBihan. MR diffusion tensor spectroscopy and imaging. Biophysical journal, 66(1):259–267, 1994.CrossRef
DGS+01.
go back to reference Bradford C Dickerson, I Goncharova, MP Sullivan, C Forchetti, RS Wilson, DA Bennett, Laurel A Beckett, and L deToledo Morrell. MRI-derived entorhinal and hippocampal atrophy in incipient and very mild Alzheimer’s disease. Neurobiology of aging, 22(5):747–754, 2001.CrossRef Bradford C Dickerson, I Goncharova, MP Sullivan, C Forchetti, RS Wilson, DA Bennett, Laurel A Beckett, and L deToledo Morrell. MRI-derived entorhinal and hippocampal atrophy in incipient and very mild Alzheimer’s disease. Neurobiology of aging, 22(5):747–754, 2001.CrossRef
DLP+95.
go back to reference Bernard Deweer, Stephane Lehericy, Bernard Pillon, Michel Baulac, J Chiras, C Marsault, Y Agid, and B Dubois. Memory disorders in probable Alzheimer’s disease: the role of hippocampal atrophy as shown with MRI. Journal of Neurology, Neurosurgery & Psychiatry, 58(5):590–597, 1995.CrossRef Bernard Deweer, Stephane Lehericy, Bernard Pillon, Michel Baulac, J Chiras, C Marsault, Y Agid, and B Dubois. Memory disorders in probable Alzheimer’s disease: the role of hippocampal atrophy as shown with MRI. Journal of Neurology, Neurosurgery & Psychiatry, 58(5):590–597, 1995.CrossRef
FAF+95.
go back to reference Karl J Friston, John Ashburner, Christopher D Frith, J-B Poline, John D Heather, and Richard SJ Frackowiak. Spatial registration and normalization of images. Human brain mapping, 3(3):165–189, 1995.CrossRef Karl J Friston, John Ashburner, Christopher D Frith, J-B Poline, John D Heather, and Richard SJ Frackowiak. Spatial registration and normalization of images. Human brain mapping, 3(3):165–189, 1995.CrossRef
FFJJ+10.
go back to reference Giovanni B Frisoni, Nick C Fox, Clifford R Jack Jr, Philip Scheltens, and Paul M Thompson. The clinical use of structural MRI in Alzheimer disease. Nature Reviews Neurology, 6(2):67, 2010.CrossRef Giovanni B Frisoni, Nick C Fox, Clifford R Jack Jr, Philip Scheltens, and Paul M Thompson. The clinical use of structural MRI in Alzheimer disease. Nature Reviews Neurology, 6(2):67, 2010.CrossRef
Fri96.
go back to reference Karl J Friston. Statistical parametric mapping and other analyses of functional imaging data. Brain mapping: The methods, 1996. Karl J Friston. Statistical parametric mapping and other analyses of functional imaging data. Brain mapping: The methods, 1996.
FTS+05.
go back to reference GB Frisoni, C Testa, F Sabattoli, A Beltramello, H Soininen, and MP Laakso. Structural correlates of early and late onset Alzheimer’s disease: voxel based morphometric study. Journal of Neurology, Neurosurgery & Psychiatry, 76(1):112–114, 2005.CrossRef GB Frisoni, C Testa, F Sabattoli, A Beltramello, H Soininen, and MP Laakso. Structural correlates of early and late onset Alzheimer’s disease: voxel based morphometric study. Journal of Neurology, Neurosurgery & Psychiatry, 76(1):112–114, 2005.CrossRef
IBPQ14.
go back to reference Bogdan Ionescu, Jenny Benois-Pineau, Tomas Piatrik, and Georges Quénot, editors. Fusion in Computer Vision - Understanding Complex Visual Content. Advances in Computer Vision and Pattern Recognition. Springer, 2014. Bogdan Ionescu, Jenny Benois-Pineau, Tomas Piatrik, and Georges Quénot, editors. Fusion in Computer Vision - Understanding Complex Visual Content. Advances in Computer Vision and Pattern Recognition. Springer, 2014.
JJBF+08.
go back to reference Clifford R Jack Jr, Matt A Bernstein, Nick C Fox, Paul Thompson, Gene Alexander, Danielle Harvey, Bret Borowski, Paula J Britson, Jennifer L. Whitwell, Chadwick Ward, et al. The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine, 27(4):685–691, 2008. Clifford R Jack Jr, Matt A Bernstein, Nick C Fox, Paul Thompson, Gene Alexander, Danielle Harvey, Bret Borowski, Paula J Britson, Jennifer L. Whitwell, Chadwick Ward, et al. The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine, 27(4):685–691, 2008.
JPX+99.
go back to reference Clifford R Jack, Ronald C Petersen, Yue Cheng Xu, Peter C O’Brien, Glenn E Smith, Robert J Ivnik, Bradley F Boeve, Stephen C Waring, Eric G Tangalos, and Emre Kokmen. Prediction of ad with MRI-based hippocampal volume in mild cognitive impairment. Neurology, 52(7):1397–1397, 1999.CrossRef Clifford R Jack, Ronald C Petersen, Yue Cheng Xu, Peter C O’Brien, Glenn E Smith, Robert J Ivnik, Bradley F Boeve, Stephen C Waring, Eric G Tangalos, and Emre Kokmen. Prediction of ad with MRI-based hippocampal volume in mild cognitive impairment. Neurology, 52(7):1397–1397, 1999.CrossRef
KABP+18.
go back to reference Alexander Khvostikov, Karim Aderghal, Jenny Benois-Pineau, Andrey Krylov, and Gwenaelle Catheline. 3D CNN-based classification using sMRI and MD-DTI images for Alzheimer disease studies. arXiv preprint arXiv:1801.05968, 2018. Alexander Khvostikov, Karim Aderghal, Jenny Benois-Pineau, Andrey Krylov, and Gwenaelle Catheline. 3D CNN-based classification using sMRI and MD-DTI images for Alzheimer disease studies. arXiv preprint arXiv:1801.05968, 2018.
KZS15.
go back to reference Gregory Koch, Richard Zemel, and Ruslan Salakhutdinov. Siamese neural networks for one-shot image recognition. In ICML deep learning workshop, volume 2, 2015. Gregory Koch, Richard Zemel, and Ruslan Salakhutdinov. Siamese neural networks for one-shot image recognition. In ICML deep learning workshop, volume 2, 2015.
LCW+18.
go back to reference Manhua Liu, Danni Cheng, Kundong Wang, Yaping Wang, Alzheimer’s Disease Neuroimaging Initiative, et al. Multi-modality cascaded convolutional neural networks for Alzheimer’s disease diagnosis. Neuroinformatics, pages 1–14, 2018. Manhua Liu, Danni Cheng, Kundong Wang, Yaping Wang, Alzheimer’s Disease Neuroimaging Initiative, et al. Multi-modality cascaded convolutional neural networks for Alzheimer’s disease diagnosis. Neuroinformatics, pages 1–14, 2018.
LIK+18.
go back to reference Collin C. Luk, Abdullah Ishaque, Muhammad Khan, Daniel Ta, Sneha Chenji, Yee-Hong Yang, Dean Eurich, and Sanjay Kalra. Alzheimer’s disease: 3-dimensional MRI texture for prediction of conversion from mild cognitive impairment. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring, 10:755 – 763, 2018. Collin C. Luk, Abdullah Ishaque, Muhammad Khan, Daniel Ta, Sneha Chenji, Yee-Hong Yang, Dean Eurich, and Sanjay Kalra. Alzheimer’s disease: 3-dimensional MRI texture for prediction of conversion from mild cognitive impairment. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring, 10:755 – 763, 2018.
LKB+17.
go back to reference Geert Litjens, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud Arindra Adiyoso Setio, Francesco Ciompi, Mohsen Ghafoorian, Jeroen Awm Van Der Laak, Bram Van Ginneken, and Clara I Sánchez. A survey on deep learning in medical image analysis. Medical image analysis, 42:60–88, 2017.CrossRef Geert Litjens, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud Arindra Adiyoso Setio, Francesco Ciompi, Mohsen Ghafoorian, Jeroen Awm Van Der Laak, Bram Van Ginneken, and Clara I Sánchez. A survey on deep learning in medical image analysis. Medical image analysis, 42:60–88, 2017.CrossRef
LLL17.
go back to reference Suhuai Luo, Xuechen Li, and Jiaming Li. Automatic Alzheimer’s disease recognition from MRI data using deep learning method. Journal of Applied Mathematics and Physics, 5(09):1892, 2017.CrossRef Suhuai Luo, Xuechen Li, and Jiaming Li. Automatic Alzheimer’s disease recognition from MRI data using deep learning method. Journal of Applied Mathematics and Physics, 5(09):1892, 2017.CrossRef
NM79.
go back to reference M. Nagao and T. Matsyama. Edge preserving smoothing. Computer graphics and image processing, 9:394–407, 1979.CrossRef M. Nagao and T. Matsyama. Edge preserving smoothing. Computer graphics and image processing, 9:394–407, 1979.CrossRef
PKL+12.
go back to reference Julien Pinquier, Svebor Karaman, Laetitia Letoupin, Patrice Guyot, Rémi Mégret, Jenny Benois-Pineau, Yann Gaëstel, and Jean-François Dartigues. Strategies for multiple feature fusion with hierarchical HMM: application to activity recognition from wearable audiovisual sensors. In ICPR, pages 3192–3195. IEEE Computer Society, 2012. Julien Pinquier, Svebor Karaman, Laetitia Letoupin, Patrice Guyot, Rémi Mégret, Jenny Benois-Pineau, Yann Gaëstel, and Jean-François Dartigues. Strategies for multiple feature fusion with hierarchical HMM: application to activity recognition from wearable audiovisual sensors. In ICPR, pages 3192–3195. IEEE Computer Society, 2012.
SILH+16.
go back to reference Lauge Sørensen, Christian Igel, Naja Liv Hansen, Merete Osler, Martin Lauritzen, Egill Rostrup, Mads Nielsen, Alzheimer’s Disease Neuroimaging Initiative, the Australian Imaging Biomarkers, and Lifestyle Flagship Study of Ageing. Early detection of Alzheimer’s disease using MRI hippocampal texture. Human brain mapping, 37(3):1148–1161, 2016. Lauge Sørensen, Christian Igel, Naja Liv Hansen, Merete Osler, Martin Lauritzen, Egill Rostrup, Mads Nielsen, Alzheimer’s Disease Neuroimaging Initiative, the Australian Imaging Biomarkers, and Lifestyle Flagship Study of Ageing. Early detection of Alzheimer’s disease using MRI hippocampal texture. Human brain mapping, 37(3):1148–1161, 2016.
TMLP+02.
go back to reference Nathalie Tzourio-Mazoyer, Brigitte Landeau, Dimitri Papathanassiou, Fabrice Crivello, Olivier Etard, Nicolas Delcroix, Bernard Mazoyer, and Marc Joliot. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage, 15(1):273–289, 2002.CrossRef Nathalie Tzourio-Mazoyer, Brigitte Landeau, Dimitri Papathanassiou, Fabrice Crivello, Olivier Etard, Nicolas Delcroix, Bernard Mazoyer, and Marc Joliot. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage, 15(1):273–289, 2002.CrossRef
YTQ12.
go back to reference Xianfeng Yang, Ming Zhen Tan, and Anqi Qiu. CSF and brain structural imaging markers of the Alzheimer’s pathological cascade. PLoS One, 7(12):e47406, 2012.CrossRef Xianfeng Yang, Ming Zhen Tan, and Anqi Qiu. CSF and brain structural imaging markers of the Alzheimer’s pathological cascade. PLoS One, 7(12):e47406, 2012.CrossRef
Metadata
Title
Introducing Domain Knowledge
Authors
Akka Zemmari
Jenny Benois-Pineau
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-34376-7_9

Premium Partner