Skip to main content
Top
Published in: Neural Processing Letters 5/2021

27-07-2020

Knowledge Acquisition and Design Using Semantics and Perception: A Case Study for Autonomous Robots

Authors: Cristiano Russo, Kurosh Madani, Antonio M. Rinaldi

Published in: Neural Processing Letters | Issue 5/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The pervasive use of artificial intelligence and neural networks in several different research fields has noticeably improved multiple aspects of human life. The application of these techniques to machines has made them progressively more “intelligent” and able to solve tasks considered extremely complex for a human being. This technological evolution has deeply influenced the way we interact with machines. Purely symbolic artificial intelligence and techniques like ontologies, have also been successfully used in the past applied to robotics, but have also shown some limitations and failings in the knowledge construction task. In fact, the exhibited “intelligence” is rarely the result of a real autonomous decision, but it is rather hard-encoded in the machine. While a number of approaches have already been proposed in literature concerning knowledge acquisition from the surrounding environment, they are either exclusively based on low-level features or they involve solely high-level semantics-based attributes. Moreover, they often don’t use a general high-level knowledge base for grounding the acquired knowledge. In this contexts, the use of semantics technologies, such as ontologies, is mostly employed for action-oriented tasks. In this article we propose an extension of a novel approach for knowledge acquisition based on a general semantic knowledge-base and the fusion of semantics and visual information by means of neural networks and ontologies. The proposed approach has been implemented on a humanoid robotic platform and the experimental results are shown and discussed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wu Y, Giger ML, Dois K, Vyborny CJ, Schmidt RA, Metz CE (1993) Artificial neural networks in mammography: application to decision making in the diagnosis of breast cancer. Radiology 187(1):81–87CrossRef Wu Y, Giger ML, Dois K, Vyborny CJ, Schmidt RA, Metz CE (1993) Artificial neural networks in mammography: application to decision making in the diagnosis of breast cancer. Radiology 187(1):81–87CrossRef
2.
go back to reference Akay MF (2009) Support vector machines combined with feature selection for breast cancer diagnosis. Expert Syst Appl 36(2):3240–3247CrossRef Akay MF (2009) Support vector machines combined with feature selection for breast cancer diagnosis. Expert Syst Appl 36(2):3240–3247CrossRef
3.
go back to reference Trippi Robert R, Efraim T (1992) Neural networks in finance and investing: using artificial intelligence to improve real world performance. McGraw-Hill Inc., New York Trippi Robert R, Efraim T (1992) Neural networks in finance and investing: using artificial intelligence to improve real world performance. McGraw-Hill Inc., New York
4.
go back to reference Raza MQ, Khosravi A (2015) A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings. Renew Sustain Energy Rev 50:1352–1372CrossRef Raza MQ, Khosravi A (2015) A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings. Renew Sustain Energy Rev 50:1352–1372CrossRef
5.
go back to reference Peguin-Feissolle A (1999) A comparison of the power of some tests for conditional heteroskedasticity. Econ Lett 63(1):5–17MathSciNetCrossRef Peguin-Feissolle A (1999) A comparison of the power of some tests for conditional heteroskedasticity. Econ Lett 63(1):5–17MathSciNetCrossRef
6.
go back to reference Chinmoy P, Vishwakarma GK (2017) Back propagation neural networks and multiple regressions in the case of heteroskedasticity. Commun Stat Simulat Comput 46(9):6772–6789MathSciNetCrossRef Chinmoy P, Vishwakarma GK (2017) Back propagation neural networks and multiple regressions in the case of heteroskedasticity. Commun Stat Simulat Comput 46(9):6772–6789MathSciNetCrossRef
7.
go back to reference Ajay K D, Bhalla VK (2010) Financial time series forecasting: comparison of neural networks and arch models. Int R J Finance Econ 49:185–202 Ajay K D, Bhalla VK (2010) Financial time series forecasting: comparison of neural networks and arch models. Int R J Finance Econ 49:185–202
8.
go back to reference Shiroishi Y, Uchiyama K, Suzuki N (2018) Society 5.0: For human security and well-being. Computer 51(7):91–95CrossRef Shiroishi Y, Uchiyama K, Suzuki N (2018) Society 5.0: For human security and well-being. Computer 51(7):91–95CrossRef
9.
go back to reference Iwano K, Kimura Y, Takashima Y, Bannai S, Yamada N (2017) Future services & societal systems in society 5.0. In: Workshop Report. Center for Research and Development Strategy Japan Science and Technology Agency Iwano K, Kimura Y, Takashima Y, Bannai S, Yamada N (2017) Future services & societal systems in society 5.0. In: Workshop Report. Center for Research and Development Strategy Japan Science and Technology Agency
10.
go back to reference Gruber T (2008) Collective knowledge systems: where the social web meets the semantic web. Web Semant Sci Serv Agents World Wide Web 6(1):4–13CrossRef Gruber T (2008) Collective knowledge systems: where the social web meets the semantic web. Web Semant Sci Serv Agents World Wide Web 6(1):4–13CrossRef
11.
go back to reference Antonio L, Mehul B, Alessandro O, Vernon D (2017) The role of cognitive architectures in general artificial intelligence. Cognit Syst Res 48:1–9 Antonio L, Mehul B, Alessandro O, Vernon D (2017) The role of cognitive architectures in general artificial intelligence. Cognit Syst Res 48:1–9
12.
go back to reference Oltramari A, Lebiere C (2012) Pursuing artificial general intelligence by leveraging the knowledge capabilities of act-r. In: International conference on artificial general intelligence. Springer, pp 199–208 Oltramari A, Lebiere C (2012) Pursuing artificial general intelligence by leveraging the knowledge capabilities of act-r. In: International conference on artificial general intelligence. Springer, pp 199–208
13.
go back to reference Vernon D (2014) Artificial cognitive systems: a primer. MIT Press, Cambridge Vernon D (2014) Artificial cognitive systems: a primer. MIT Press, Cambridge
14.
go back to reference Langley P (2006) Cognitive architectures and general intelligent systems. AI Mag 27(2):33MathSciNet Langley P (2006) Cognitive architectures and general intelligent systems. AI Mag 27(2):33MathSciNet
16.
go back to reference Russo C, Madani K, Rinaldi AM (2019) Knowledge construction through semantic interpretation of visual information. In: International work-conference on artificial neural network. Springer, pp 246–257 Russo C, Madani K, Rinaldi AM (2019) Knowledge construction through semantic interpretation of visual information. In: International work-conference on artificial neural network. Springer, pp 246–257
18.
go back to reference Brooks R (1986) A robust layered control system for a mobile robot. IEEE J Robot Autom 2(1):14–23CrossRef Brooks R (1986) A robust layered control system for a mobile robot. IEEE J Robot Autom 2(1):14–23CrossRef
19.
go back to reference Brooks Rodney A (1990) Elephants don’t play chess. Robot Autonom Syst 6(1–2):3–15CrossRef Brooks Rodney A (1990) Elephants don’t play chess. Robot Autonom Syst 6(1–2):3–15CrossRef
20.
go back to reference Brooks Rodney A (1991) Intelligence without representation. Artif Intell 47(1–3):139–159CrossRef Brooks Rodney A (1991) Intelligence without representation. Artif Intell 47(1–3):139–159CrossRef
21.
go back to reference Ramík DM, Sabourin C, Moreno R, Madani K (2014) A machine learning based intelligent vision system for autonomous object detection and recognition. Appl Intell 40(2):358–375CrossRef Ramík DM, Sabourin C, Moreno R, Madani K (2014) A machine learning based intelligent vision system for autonomous object detection and recognition. Appl Intell 40(2):358–375CrossRef
22.
go back to reference Ramík DM, Madani K, Sabourin C (2013) From visual patterns to semantic description: a cognitive approach using artificial curiosity as the foundation. Pattern Recogn Lett 34(14):1577–1588CrossRef Ramík DM, Madani K, Sabourin C (2013) From visual patterns to semantic description: a cognitive approach using artificial curiosity as the foundation. Pattern Recogn Lett 34(14):1577–1588CrossRef
23.
go back to reference Ramík DM, Sabourin C, Madani K (2013) Autonomous knowledge acquisition based on artificial curiosity: Application to mobile robots in an indoor environment. Robot Autonom Syst 61(12):1680–1695CrossRef Ramík DM, Sabourin C, Madani K (2013) Autonomous knowledge acquisition based on artificial curiosity: Application to mobile robots in an indoor environment. Robot Autonom Syst 61(12):1680–1695CrossRef
24.
go back to reference Bodiroza S, Schillaci G, Hafner VV (2011) Robot ego-sphere: an approach for saliency detection and attention manipulation in humanoid robots for intuitive interaction. In: 2011 11th IEEE-RAS international conference on humanoid robots. IEEE, pp 689–694 Bodiroza S, Schillaci G, Hafner VV (2011) Robot ego-sphere: an approach for saliency detection and attention manipulation in humanoid robots for intuitive interaction. In: 2011 11th IEEE-RAS international conference on humanoid robots. IEEE, pp 689–694
25.
go back to reference Ruesch J, Lopes M, Bernardino A, Hornstein J, Santos-Victor J, Pfeifer R (2008) Multimodal saliency-based bottom-up attention a framework for the humanoid robot icub. In: 2008 IEEE international conference on robotics and automation. IEEE, pp 962–967 Ruesch J, Lopes M, Bernardino A, Hornstein J, Santos-Victor J, Pfeifer R (2008) Multimodal saliency-based bottom-up attention a framework for the humanoid robot icub. In: 2008 IEEE international conference on robotics and automation. IEEE, pp 962–967
26.
go back to reference Metta G, Sandini G, Vernon D, Natale L, Nori F (2008) The ICUB humanoid robot: an open platform for research in embodied cognition. In: Proceedings of the 8th workshop on performance metrics for intelligent systems, pp 50–56 Metta G, Sandini G, Vernon D, Natale L, Nori F (2008) The ICUB humanoid robot: an open platform for research in embodied cognition. In: Proceedings of the 8th workshop on performance metrics for intelligent systems, pp 50–56
27.
go back to reference Chella A, Lanza F, Pipitone A, Seidita V (2018) Knowledge acquisition through introspection in human-robot cooperation. Biol Inspired Cognit Arch 25:1–7 Chella A, Lanza F, Pipitone A, Seidita V (2018) Knowledge acquisition through introspection in human-robot cooperation. Biol Inspired Cognit Arch 25:1–7
28.
go back to reference Lemaignan S, Ros R, Mösenlechner L, Alami R, Beetz M (2010) Oro, a knowledge management platform for cognitive architectures in robotics. In: 2010 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 3548–3553 Lemaignan S, Ros R, Mösenlechner L, Alami R, Beetz M (2010) Oro, a knowledge management platform for cognitive architectures in robotics. In: 2010 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 3548–3553
29.
go back to reference Lemaignan S, Alami R (2013) Explicit knowledge and the deliberative layer: lessons learned. In: 2013 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 5700–5707 Lemaignan S, Alami R (2013) Explicit knowledge and the deliberative layer: lessons learned. In: 2013 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 5700–5707
30.
go back to reference Lemaignan S, Warnier M, Sisbot EA, Clodic A, Alami R (2017) Artificial cognition for social human–robot interaction: an implementation. Artif Intell 247:45–69MathSciNetCrossRef Lemaignan S, Warnier M, Sisbot EA, Clodic A, Alami R (2017) Artificial cognition for social human–robot interaction: an implementation. Artif Intell 247:45–69MathSciNetCrossRef
31.
go back to reference Tenorth M (2011) Knowledge processing for autonomous robots. PhD thesis, Technische Universität München Tenorth M (2011) Knowledge processing for autonomous robots. PhD thesis, Technische Universität München
32.
go back to reference Milliez G, Warnier M, Clodic A, Alami R (2014) A framework for endowing an interactive robot with reasoning capabilities about perspective-taking and belief management. In: The 23rd IEEE international symposium on robot and human interactive communication. IEEE, pp 1103–1109 Milliez G, Warnier M, Clodic A, Alami R (2014) A framework for endowing an interactive robot with reasoning capabilities about perspective-taking and belief management. In: The 23rd IEEE international symposium on robot and human interactive communication. IEEE, pp 1103–1109
33.
go back to reference Hasanuzzaman Md, Zhang T, Ampornaramveth V, Ueno H (2006) Gesture-based human-robot interaction using a knowledge-based software platform. Ind Robot Int J 33(1):37–49CrossRef Hasanuzzaman Md, Zhang T, Ampornaramveth V, Ueno H (2006) Gesture-based human-robot interaction using a knowledge-based software platform. Ind Robot Int J 33(1):37–49CrossRef
34.
go back to reference Bauer A, Wollherr D, Buss M (2008) Human-robot collaboration: a survey. Int J Humanoid Rob 5(01):47–66CrossRef Bauer A, Wollherr D, Buss M (2008) Human-robot collaboration: a survey. Int J Humanoid Rob 5(01):47–66CrossRef
35.
go back to reference Chandrasekaran B, Conrad JM (2015) Human-robot collaboration: a survey. In: SoutheastCon 2015. IEEE, pp 1–8 Chandrasekaran B, Conrad JM (2015) Human-robot collaboration: a survey. In: SoutheastCon 2015. IEEE, pp 1–8
36.
go back to reference Bülthoff HH, Wallraven C, Giese MA (2008) Perceptual robotics. In: Springer Handbook of Robotics. Springer, pp 1481–1498 Bülthoff HH, Wallraven C, Giese MA (2008) Perceptual robotics. In: Springer Handbook of Robotics. Springer, pp 1481–1498
37.
go back to reference Taniguchi A, Taniguchi T, Inamura T (2016) Spatial concept acquisition for a mobile robot that integrates self-localization and unsupervised word discovery from spoken sentences. IEEE Trans Cognit Dev Syst 8(4):285–297 Taniguchi A, Taniguchi T, Inamura T (2016) Spatial concept acquisition for a mobile robot that integrates self-localization and unsupervised word discovery from spoken sentences. IEEE Trans Cognit Dev Syst 8(4):285–297
38.
go back to reference Vanzo A, Part JL, Yu Y, Nardi D, Lemon O (2018) Incrementally learning semantic attributes through dialogue interaction. In: Proceedings of the 17th international conference on autonomous agents and multiagent systems. International foundation for autonomous agents and multiagent systems, pp 865–873 Vanzo A, Part JL, Yu Y, Nardi D, Lemon O (2018) Incrementally learning semantic attributes through dialogue interaction. In: Proceedings of the 17th international conference on autonomous agents and multiagent systems. International foundation for autonomous agents and multiagent systems, pp 865–873
40.
go back to reference Qiu J, Sun K, Wang T, Gao H (2019) Observer-based fuzzy adaptive event-triggered control for pure-feedback nonlinear systems with prescribed performance. IEEE Trans Fuzzy Syst 27(11):2152–2162CrossRef Qiu J, Sun K, Wang T, Gao H (2019) Observer-based fuzzy adaptive event-triggered control for pure-feedback nonlinear systems with prescribed performance. IEEE Trans Fuzzy Syst 27(11):2152–2162CrossRef
41.
go back to reference Sun K, Mou S, Qiu J, Wang T, Gao H (2018) Adaptive fuzzy control for nontriangular structural stochastic switched nonlinear systems with full state constraints. IEEE Trans Fuzzy Syst 27(8):1587–1601CrossRef Sun K, Mou S, Qiu J, Wang T, Gao H (2018) Adaptive fuzzy control for nontriangular structural stochastic switched nonlinear systems with full state constraints. IEEE Trans Fuzzy Syst 27(8):1587–1601CrossRef
42.
go back to reference Caldarola EG, Rinaldi AM (2016) An approach to ontology integration for ontology reuse. In: 2016 IEEE 17th international conference on information reuse and integration (IRI). IEEE, pp 384–393 Caldarola EG, Rinaldi AM (2016) An approach to ontology integration for ontology reuse. In: 2016 IEEE 17th international conference on information reuse and integration (IRI). IEEE, pp 384–393
43.
go back to reference Rinaldi AM, Russo C (2018) A matching framework for multimedia data integration using semantics and ontologies. In: 2018 IEEE 12th international conference on semantic computing (ICSC). IEEE, pp 363–368 Rinaldi AM, Russo C (2018) A matching framework for multimedia data integration using semantics and ontologies. In: 2018 IEEE 12th international conference on semantic computing (ICSC). IEEE, pp 363–368
44.
go back to reference Rinaldi AM, Russo C (2018) A semantic-based model to represent multimedia big data. In: Proceedings of the 10th international conference on management of digital ecosystems. ACM, pp 31–38 Rinaldi AM, Russo C (2018) A semantic-based model to represent multimedia big data. In: Proceedings of the 10th international conference on management of digital ecosystems. ACM, pp 31–38
45.
go back to reference Rinaldi AM, Russo C (2018) User-centered information retrieval using semantic multimedia big data. In: 2018 IEEE international conference on big data (Big Data). IEEE, pp 2304–2313 Rinaldi AM, Russo C (2018) User-centered information retrieval using semantic multimedia big data. In: 2018 IEEE international conference on big data (Big Data). IEEE, pp 2304–2313
46.
go back to reference Rinaldi Antonio M (2014) Using multimedia ontologies for automatic image annotation and classification. In: 2014 IEEE International Congress on Big Data (BigData Congress). IEEE, pp 242–249 Rinaldi Antonio M (2014) Using multimedia ontologies for automatic image annotation and classification. In: 2014 IEEE International Congress on Big Data (BigData Congress). IEEE, pp 242–249
47.
go back to reference Rinaldi AM (2015) A complete framework to manage multimedia ontologies in digital ecosystems. Int J Bus Process Integrat Manag 7(4):274–288CrossRef Rinaldi AM (2015) A complete framework to manage multimedia ontologies in digital ecosystems. Int J Bus Process Integrat Manag 7(4):274–288CrossRef
48.
go back to reference Fan J, Luo H, Gao Y (2005) Learning the semantics of images by using unlabeled samples. In: CVPR 2005. IEEE computer society conference on computer vision and pattern recognition, 2005, vol 2. IEEE, pp 704–710 Fan J, Luo H, Gao Y (2005) Learning the semantics of images by using unlabeled samples. In: CVPR 2005. IEEE computer society conference on computer vision and pattern recognition, 2005, vol 2. IEEE, pp 704–710
49.
go back to reference Nöth E, De Mori R, Fischer J, Gebhard A, Harbeck S, Kompe R, Kuhn R, Niemann H, Mast M (1996) An integrated model of acoustics and language using semantic classification trees Nöth E, De Mori R, Fischer J, Gebhard A, Harbeck S, Kompe R, Kuhn R, Niemann H, Mast M (1996) An integrated model of acoustics and language using semantic classification trees
50.
go back to reference Rinaldi Antonio M (2014) A multimedia ontology model based on linguistic properties and audio-visual features. Inf Sci 277:234–246CrossRef Rinaldi Antonio M (2014) A multimedia ontology model based on linguistic properties and audio-visual features. Inf Sci 277:234–246CrossRef
51.
go back to reference Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39–41CrossRef Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39–41CrossRef
52.
go back to reference Danesi M, Perron P (1999) Analyzing cultures: an introduction and handbook. Indiana University Press, Bloomington Danesi M, Perron P (1999) Analyzing cultures: an introduction and handbook. Indiana University Press, Bloomington
53.
go back to reference Deng J, Dong W, Socher R, Li Li-J, Li K, Fei-FL (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255 Deng J, Dong W, Socher R, Li Li-J, Li K, Fei-FL (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255
54.
55.
56.
go back to reference Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655 Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655
Metadata
Title
Knowledge Acquisition and Design Using Semantics and Perception: A Case Study for Autonomous Robots
Authors
Cristiano Russo
Kurosh Madani
Antonio M. Rinaldi
Publication date
27-07-2020
Publisher
Springer US
Published in
Neural Processing Letters / Issue 5/2021
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10311-x

Other articles of this Issue 5/2021

Neural Processing Letters 5/2021 Go to the issue