Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
KI - Künstliche Intelligenz
Published in: KI - Künstliche Intelligenz 4/2019

12-09-2019 | Technical Contribution

Benchmarking Functionalities of Domestic Service Robots Through Scientific Competitions

Authors: Meysam Basiri, Enrico Piazza, Matteo Matteucci, Pedro Lima

Published in: KI - Künstliche Intelligenz | Issue 4/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Benchmarking via carefully designed competitions makes it possible to provide a common framework for the rigorous comparison of intelligent and autonomous systems; competitions may play the role of scientific experiments while being appealing both to researchers and to the general public thus promoting critical analysis of systems outside the labs. This paper describes our approach to benchmarking domestic service robots through organizing recurrent competitions under the European Robotics League. It details the tools and benchmarks designed to evaluate the performance of robots at task and functionality levels. In particular, the functionality benchmarks for object perception and navigation are described and an overview of the new benchmarks to appear in the league is presented.
previous article SocRob@Home
next article Reg3DFacePtCd: Registration of 3D Point Clouds Using a Common Set of Landmarks for Alignment of Human Face Images

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

KI - Künstliche Intelligenz

The Scientific journal "KI – Künstliche Intelligenz" is the official journal of the division for artificial intelligence within the "Gesellschaft für Informatik e.V." (GI) – the German Informatics Society - with constributions from troughout the field of artificial intelligence.

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Show more products
Footnotes
1
With replicable experiments we refer to experiments, and benchmarks, which are both reproducible and repeatable.
 
8
A 3D model of the positioner used at the ERL is available at https://​github.​com/​rockin-robot-challenge/​ERL-Reports-Attachements.
 
Literature
1.
Amigoni F, Bastianelli E, Berghofer J, Bonarini A, Fontana G, Hochgeschwender N, Iocchi L, Kraetzschmar GK, Lima PU, Matteucci M, Miraldo M, Nardi D, Schiaffonati V (2015) Competitions for benchmarking: task and functionality scoring complete performance assessment. IEEE Robot Autom Mag 22(3):53–61CrossRef
2.
Lima PU (2017) RoCKIn: benchmarking through robot competitions. InTechOpen, Rijeka
3.
Dias J, Althoefer K, Lima PU (2016) Robot competitions: what did we learn? IEEE Robot Autom Mag 23(1):16–18CrossRef
4.
Anderson M, Jenkins OC, Osentoski S (2011) Recasting robotics challenges as experiments. IEEE Robot Autom Mag 18(2):10–11CrossRef
5.
Prassler E, Munich ME, Pirjanian P, Kosuge K (2016) Domestic robotics. Springer handbook of robotics. Springer, Cham, pp 1729–1758CrossRef
6.
Young JE, Hawkins R, Sharlin E, Igarashi T (2009) Toward acceptable domestic robots: applying insights from social psychology. Int J Soc Robot 1(1):95CrossRef
7.
Müller AC, Behnke S (2014) Learning depth-sensitive conditional random fields for semantic segmentation of rgb-d images. In: IEEE international conference on robotics and automation (ICRA), pp 6232-6237
8.
Messias J, Ventura R, Lima P, Sequeira J, Alvito P, Marques C, Carriço P (2014) A robotic platform for edutainment activities in a pediatric hospital. In: IEEE international conference on autonomous robot systems and competitions (ICARSC), pp 193-198
9.
Muszynski S, Stückler J, Behnke S (2012) Adjustable autonomy for mobile teleoperation of personal service robots. In: IEEE international symposium on robot and human interactive communication (Ro-MAN), pp 933–940
10.
Pineda LA, Salinas L, Meza IV, Rascon C, Fuentes G (2013) Sitlog: a programming language for service robot tasks. Int J Adv Rob Syst 10(10):358CrossRef
11.
12.
13.
14.
Metadata
Title
Benchmarking Functionalities of Domestic Service Robots Through Scientific Competitions
Authors
Meysam Basiri
Enrico Piazza
Matteo Matteucci
Pedro Lima
Publication date
12-09-2019
Publisher
Springer Berlin Heidelberg
Published in
KI - Künstliche Intelligenz / Issue 4/2019
Print ISSN: 0933-1875
Electronic ISSN: 1610-1987
DOI
https://doi.org/10.1007/s13218-019-00619-9

Other articles of this Issue 4/2019

KI - Künstliche Intelligenz 4/2019 Go to the issue

Technical Contribution

An Introduction to Hyperdimensional Computing for Robotics

AI Transfer

Volvo Group Collaborative Robot Systems Laboratory: A Collaborative Way for Academia and Industry to be at the Forefront of Artificial Intelligence

Community

News

Dissertation and Habilitation Abstracts

Efficient Supervision for Robot Learning Via Imitation, Simulation, and Adaptation

AI TRansfer

Weed Management of the Future

AI Transfer

Deskilling Robots in Logistics Environments

Premium Partner

    Image Credits