Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
International Journal of Machine Learning and Cybernetics
Published in: International Journal of Machine Learning and Cybernetics 6/2017

22-06-2016 | Original Article

A dual approach for machine-awareness in indoor environment combining pseudo-3D imaging and soft-computing techniques

Authors: Kurosh Madani, Dayana Hassan, Christophe Sabourin

Published in: International Journal of Machine Learning and Cybernetics | Issue 6/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

3D spatial characterization of objects is a key-step for autonomous knowledge extraction leading to machine-awareness. In this paper we describe a dual-images-based approach for objects’ 3D characterization and localization for Machine-Awareness in indoor environment. The so-called dual images are provided by color and depth cameras of Kinect system, which presents an appealing potential for 3D objects modeling and localization. Placing the human–machine (including human-robot) interaction as a primary outcome of the intended visual Machine-Awareness in investigated system, we aspire proffering the machine spatial awareness about its surrounding environment with identification and semantically description of relative positions of detected items in that environment. In this research work, the aforementioned pseudo-3D imaging and Soft-computing techniques are combined in order to extract, to recognize and to spatially characterize objects and the distance between objects in 3D environment. In other words, on the one hand, a pseudo-3D object modeling and localization method based on the dual-images of Kinect system is proposed, in which the computation of object’s spatial characterization is presented. On the other hand, a computational semantically description algorithm by using Fuzzy Inference System is proposed, in which the numerical-to-semantic conversion for machine awareness is accomplished. Experimental results validating the investigated approach are reported and discussed.
previous article Optimizing ranking for response prediction via triplet-wise learning from historical feedback
next article Improving landmark detection accuracy for self-localization through baseboard recognition

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Show more products
Literature
1.
Karray FO, De Silva CW (2004) Soft computing and intelligent systems design: theory, tools and applications, ISBN: 9780321116178, Addison-Wesley Longman
2.
3.
Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man-Mach Stud 7:1–13CrossRefMATH
4.
T. Takagi and M. Sugeno (1985) “Fuzzy identification of systems and its applications to modeling and control,” IEEE Tran Syst Man Cybern SMC 15:116–132
5.
Guillaume S (2001) Designing fuzzy inference systems from data: an interpretability-oriented review. IEEE Trans Fuzzy Syst 9(3):426–443CrossRef
6.
7.
Zhang Z (2012) Microsoft Kinect sensor and its effect. IEEE Multimedia Mag. 19(2):4–10CrossRef
8.
S. Meister S, Izadi S, Kohli P, Haemmerle M, Rother C, Kondermann D (2012) “When can we use KinectFusion for ground truth acquisition?”, in Proc. Workshop Color-Depth Camera Fusion Robot
9.
Roth H, Vona M (2012) Moving volume KinectFusion. Proc Br Mach Vision Conf 1–11
10.
Whelan T, Kaess M, Fallon M, Johannsson H, Leonard J, McDonald J (2012) Kintinuous: Spatially extended KinectFusion. Proc Workshop RGB-D Adv Reason Depth Cameras, article 4
11.
Han J, Shao L, Xu D, Shotton J (2013) Enhanced computer vision with microsoft kinect sensor: a review. IEEE Trans Cybern 43(5):1318–1334CrossRef
12.
Camplani M, Mantecon T, Salgado L (2013) Depth-color fusion strategy for 3-D scene modeling with kinect. IEEE Trans Cybern 43(6):1560–1571CrossRef
13.
Lloyd R, Mc Closkey S (2014) Recognition of 3D package shapes for single camera metrology. Proc IEEE Winter Confer Appl Comp Vision (IEEE-WACV 2014) 99–106
14.
Skalski A, Machura B (2015) Metrological analysis of microsoft kinect in the context of object localization. J Metril Meas Systems 22(4):469–478
15.
Zolkiewski S, Pioskowik D (2014) Robot control and online programming by human gestures using a kinect motion sensor. New Perspectives in Information Systems and Technologies, Vol. 1, Advances in Intelligent Systems and Computing 275, Springer, pp 593–604
16.
Stone EE, Skubic M (2015) Fall detection in homes of older adults using the microsoft kinect. IEEE J Biomed Health Inform 19(1):290–301CrossRef
17.
González-Jorge H, Zancajo S, González-Aguilera D, Arias P (2015) Application of kinect gaming sensor in forensic science. J Forensic Sci 60(1):206–211CrossRef
18.
Khoshelham K, Elberink SO (2012) Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 12(2):1437–1454CrossRef
19.
Tuytelaars T, Mikolajczyk K (2008) Local invariant feature detectors: a survey. J Found Trends Comp Graph Vision 3(3):177–280CrossRef
20.
Hinterstoisser S, Lepetit V, Ilic S, Fua P, Navab N (2010) Dominant orientation templates for real-time detection of texture-less objects. Proc IEEE Confer Comp Vision Patt Recogn (CVPR 2010), pp. 2257–2264
21.
Lowe D (2004) Distinctive image features from scale-in-variant key-points. Int J Comput Vision 20(1):91–110CrossRef
22.
Y. Ke and R. Sukthankar.PCA-SIFT (2004) A more distinctive representation for local image descriptors. Proc Conf Comp Vision Pattern Recognit, pp 511–517
23.
Bay H, Ess A, Tuytelaars T, Van Gool L (2008) SURF: speeded up robust features. Computer Vision and Image Understanding (CVIU) 110(3):346–359CrossRef
24.
Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. Comp Vision (ICCV), IEEE Int Conf IEEE
25.
A. Golovinskiy A, Kim VG, Funkhouser T (2009) Shap-based recognition of 3D point clouds in urban environments. Proc 12th IEEE Int Conf Comp Vision, pp 2154–2161
26.
B. Steder, G. Grisetti, W. Burgard, “Robust Place Recognition for 3D Range Data Based on Point Features”, Proc of IEEE Internationel Conference on Robotics ans Automation (IEEE – ICRA 2010), 3-7 May, pp. 1400-1405, 2010
27.
Ramik DM (2012) Contribution to Complex Visual Information processing and Autonomous Knwledge Extraction: Aplication to Autonomous Robotics. University Paris-Est, PhD disertation
28.
S. Vasudevan, S. Gachter, V. Nguyen, R. Siegwart, “Cognitive maps for mobile robots-an object based approach”, Robotics and Autonomous Systems, pp. 359–371, 2007
29.
C. Galindo, A. Saffiotti, S. Coradeschi, P. Buschka, J. A. Fernandez-Madrigal, “Multi-Hierarchical Semantic Maps for Mobile Robotics”, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Edmonton, pp. 2278-2283, 2005
30.
M. Persson, T. Duckett, C. Valgren, A. Lilenthal, “Probabilistic Semantic Mapping with a Virtual Sensor for Building/Nature detection”, Proceedings of the 7th IEEE International Symposium on Computational Intelligence in Robotics and Automation, Jacksonville, pp. 236-242, 2007
31.
A. Nüchter, J. Hertzberg, “Towards semantic maps for mobile robots”, Robotics and Autonomous Systems, pp. 915-926, 2008
32.
S. Ekvall, P. Jensfelt, D. Kragic, “Integrating Active Mobile Robot Object Recognition and SLAM in Natural Environments”, Proceedings of International Conference on Intelligent Robots and Systems, IEEE/RSJ, Beijing, 2006
33.
J. Hertzberg, S. Albrecht, M. Günther, K. Lingemann, J. Sprickerhof, W. Thomas, “From Semantic Mapping to Anchored Knowledge Bases”, Proceedings of the 10th Biannual Meeting of German Socciety of Cognitive Science, Symposium Adaptivity of Hybrid Cognitive Systems, Potsdam, pp. 33-37, 2010
34.
J. Civera, D. Gálvez-López, L. Riazuelo, J. D. Tardós, J. M. M. Montiel, “Towards semantic SLAM using a monocular camera”, Proceedings of International Conference on Intelligent Robots and Systems (IROS), pp. 1277-1284, 2012
35.
J. Hartmann, D. Forouher, M. Litza, J. H. Klüssendorff, E. Maehle, “Real-Time Visual SLAM Using FastSLAM and the Microsoft Kinect Camera”, Proc. of 7th German Conference on Robotics (ROBOTIK 2012), 21-22 May, Munich, Germany, pp. 1-6, (2012)
36.
D. Santos Ortiz Correa, D. Fernando Sciotti, M. Gomes Prado, D. Oliva Sales, D. F. Wolf, F. Santos Osório, “Mobile Robots Navigation in Indoor Environments Using Kinect Sensor”, Proc. of 2nd Brazilian Conference on Critical Embedded Systems, 20-25 May, Campinas, Brazil, pp. 36-41, (2012)
37.
Byung-soo Kim, Shili Xu Silvio Savarese, “Accurate Localization of 3D Objects from GRB-D Data using Segmentation Hypotheses”, CVPR’13 Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3182-3189, 2013
38.
K.Lai, L.Bo, X.Ren, D.Fox, “A Large-Scale Hierarchical Multi-View RGB-D Object Dataset”, Proc. Of International Conference on Robotics and Automation (ICRA), 2011
39.
Martin A. Fischler and Robert C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography”, Comm. Of the ACM, vol. 24, pp. 381–395, 1981
40.
Shamik Sural, Gang Qian and Sakti Pramanik, “Segmentation and histogram generation using the HSV color space for image retrivial” Dept. of Computer Science and Engineering, 3115 Engineering Building, Michigan State University, East Lansing, MI 48824, USA
41.
C.Zhang, Z.Zhang, “Calibration between Depth and Color Sensors for Commodity Depth Cameras”, in Intl.Wokshop on Hot Topics in 3D, Barcelona,Spain, 2011
42.
C.D. Herrera, J.Kannala, J.Heikkilä, “Acurate and Patical Caibration of a Depth and Color Camera Pair”, in Proc. 14th Int. Conf. Comp. Anal; Images Patt., LNCS, Vol. 6855, pp. 435-445. Springer, 2011
43.
A. Staranowicz, F. Morbidi, G. L. Mariottini, Depth-camera calibration toolbox(dcct): “Accurate, robust, and pratical calibration of Depths cameras”, in Proc. Of the Brit. Mach. Vision Conf., 2012
44.
45.
Lu YW, Lai ZH, Fan ZZ, Cui JR, Zhu Q (2015) Manifold Discriminant Regression Learning For Image Classification. Neurocomputing 166:475–486CrossRef
46.
Han Y, Xu C, Baciu G, Li M (2015) Lightness Biased Cartoon-And-Texture Decomposition for Textile Image Segmentation. Neurocomputing 168:575–587CrossRef
47.
Wang XZ, Ashfaq RAR, Fu AM (2015) Fuzziness Based Sample Categorization for Classifier Performance Improvement. Journal of Intelligent & Fuzzy Systems 29(3):1185–1196CrossRefMathSciNet
Metadata
Title
A dual approach for machine-awareness in indoor environment combining pseudo-3D imaging and soft-computing techniques
Authors
Kurosh Madani
Dayana Hassan
Christophe Sabourin
Publication date
22-06-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 6/2017
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-016-0559-2

Other articles of this Issue 6/2017

International Journal of Machine Learning and Cybernetics 6/2017 Go to the issue

Original Article

Effective micro-expression recognition using relaxed K-SVD algorithm

Original Article

Optimizing ranking for response prediction via triplet-wise learning from historical feedback

Original Article

Multiple attribute group decision making based on generalized trapezoid fuzzy linguistic prioritized weighted average operator

Original Article

Integrated artificial intelligence-based resizing strategy and multiple criteria decision making technique to form a management decision in an imbalanced environment

Original Article

Backstepping control of MEMS gyroscope using adaptive neural observer

Original Article

A segmentation-based adaptive image enhancement method inspired by the self-adjust features of HVS