Skip to main content
Top
Published in: e & i Elektrotechnik und Informationstechnik 6/2020

Open Access 03-09-2020 | Originalarbeit

A review of the challenges in mobile manipulation: systems design and RoboCup challenges

Recent developments with a special focus on the RoboCup

Authors: Martin Sereinig, Wolfgang Werth, Lisa-Marie Faller

Published in: e+i Elektrotechnik und Informationstechnik | Issue 6/2020

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Mobile robotics is already well established in today’s production lines. Navigation, control and perception for mobile robots are vivid fields of research fostering advances in Industry 4.0. In order to increase the flexibility of such mobile platforms, it is also common practice to add serial manipulator arms to their yielding systems with nine degrees of freedom and more. These platforms are not limited to industry but are supportive in various field such as service, assistance, teleoperation and also rehabilitation. Due to the operation of such increasingly complex systems in less structured and dynamic environments - often in close contact with humans - more demanding challenges evolve in terms of systems design, control and sensors. These challenges are also reflected in the various RoboCup leagues. In this paper, we discuss state-of-the-art developments in mobile manipulation using developments and work done in the context of the RoboCup competition as design examples. Additionally, we elaborate on the recent challenges of the RoboCup Rescue League as well as on the RoboCup@Work League.
Notes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

1 Introduction

Historically, humans often tried to construct machines which would resemble living beings, either human-like or closer to certain animals. While these approaches have been rather artistic, later the upsurge of industrial robotics began with low Degree-Of-Freedom (DOF) manipulator arms such as the PUMA 560 by Unimation. The idea behind the development of these early machines was to alleviate certain fabrication tasks for human operators. Traditionally, these are dull, dirty and dangerous tasks. While the substitution of human workers in such production environments with the aforementioned context has already been achieved to a great extend, novel fields of robot usage arise. These fields are no longer easily covered by pre-programming routines into robot arms. These novel robot tasks include dynamic operation and movement in flexible production lines, human assistance in service and medical areas, in rehabilitation as well as elderly care and rescue (compare Fig. 1). These tasks require mobility as well as manipulation capabilities which former robotic systems would not provide. New approaches in path-planning and control of these high DOF systems are subject of current research in the same way as are human-robot-interaction concepts and new physical sensors which provide robots with sensing capabilties often more sophisticated than those of human beings. It is no longer possible to draw a line clearly distinguishing between the research areas involved, e.g., path-planning, motion control, manipulator and grasp control.
In the following, we give an insight into recent developments with respect to the hardware construction as well as motion, control and sensing concepts. First, we show construction concepts for mobile manipulator platforms. Then we outline the necessary physical capabilties (moving, manipulation and grasping, sensing, interfacing and interacting) of the same. Next, we discuss the systems’ intelligence enabling them to understand humans and the environment, move smartly and do the right thing.
Then we focus on the RoboCup, which is established to publicly promote robotics research by posing forefront challenges in the field, which, at the same time, should make significant social impact as well. As such, it is the optimal setting for active groups to present new ideas and recent developments. Consequently, we include this here with a special emphasis on rescue (RoboCup Rescue) and industrial employment (RoboCup@Work) of mobile manipulators.

2 Physical capabilities (hardware)

The combination of a mobile robot platform with a manipulator (in combination called mobile manipulator) quickly results in having a DOF equal or greater than nine and must therefore be described as robot system with kinematic redundancy. Modern mobile manipulators are often equipped with collaborative manipulation arms. This type of manipulation arms is specially designed to work with human workers in a collaborative manner. With some additional restrictions in terms of speed, force and torque of the mobile manipulator these robots can be gathered under the term collaborative mobile manipulators (see ISO 15066 and ISO 10218). Figure 5 shows an example of a collaborative mobile manipulator with a degree of freedom of nine which can be used in an industrial environment. In Fig. 1, a mobile rescue robot with a DOF of 12 is shown which will be further described in the following as a design example for the RoboCup Rescue League. In [10] an overview of mobile manipulators used in industrial environments is given. Different search and rescue robots are described in [21, 95] as well as in [11] (Part F, Sect. 50).

2.1 Moving

The method to move a mobile robot platform depends on the main purpose of use, mostly these mobile robots are classified into wheel type, track type and leg type. Here, two different driving methods (wheel type and tracked type) including their advantages and disadvantages are described.

2.1.1 Tracked vehicle with additional linkages

When it comes to tasks in difficult unstructured environments (e.g. damaged buildings or collapsed factories) where different obstacles prevent safe rapid movement, tracked vehicles have advantages in terms of stable movement and system robustness. Additional linkages with ground adaption (often called flipper or flipper tracks) are used to overcome obstacles and to handle uneven ground. The mobile rescue robot T.R.U.D.I. (Third Robot for Urban Disaster Intervention) developed and built at CUAS [38] (Fig. 1) uses four active flipper tracks to extend its movement capabilities. Also, a special gearbox was developed which includes all mechanical parts to move the main tracks, flipper tracks and to rotate the flipper tracks with three electric brushless DC (BLDC) motors for each flipper/track combination. The drive train is realized with four of these gearboxes, one on each corner of the chassis.
Figure 2 shows a schematic drawing of the mobile base including main tracks and flippers (\(f_{1} \dots f_{4}\)). This mobile platform is considered as non-holonomic system where the velocity in the plain is constrained while the position is not. The system can only move in body x-direction with velocity \(v_{R}\) and rotate around the body z-axis with angular velocity \(\dot{\phi }_{R}\).
Movement in the plane is achieved by the two main tracks and follows the rules of a differential drive mechanism where the forward velocity kinematics for a rotation with \(\dot{\phi _{R}}\) around the body fixed z-axis can be denoted as
$$ \dot{\phi _{R}}=\frac{v_{2}-v_{1}}{b} $$
(1)
where \(v_{i}\) are the wheel circumferential velocities calculated as \(v_{1}=\omega _{1} R\) and \(v_{2}=\omega _{2} R\), \(R\) is the wheel radius and \(\omega _{i}\) is the corresponding rotational velocity of the sprocket, \(b\) means the wheelbase. The linear speed along the body fixed x-axis \(v_{R}\) matches to the circumferential velocities of both main tracks if they are equal. The inverse kinematics to control the tracks’ movement regarding the desired body velocities \(v_{R}\) and \(\phi _{R}\), whereby \(v_{R}\) is the desired velocity in body x direction, can be described by
$$\begin{aligned} \omega _{1} =&\frac{1}{R}(v_{R}-\frac{\dot{\phi _{R}}b}{2}) \end{aligned}$$
(2)
$$\begin{aligned} \omega _{2} =&\frac{1}{R}(v_{R}+\frac{\dot{\phi _{R}}b}{2}). \end{aligned}$$
(3)
The speed of the flipper tracks for each side (flipper \(f_{1}\), \(f_{3}\) on the left and \(f_{2}\), \(f_{4}\) on the right hand side) is due to the mechanical construction directly linked to the speed of the corresponding main track. Due to the fact that the sprocket of the flipper tracks and the sprocket of the main tracks have the same diameter and both tracks are used with the same velocity it can be combined as one big track (pointed out in Fig. 2, market as red rectangle). Figure 3 shows a view of the backside of the mobile manipulator T.R.U.D.I. where this combined track can be seen in detail. The for simplicity the slip problem of tracked vehicles as described in [23] and [57] was neglected.
The angle of the flippers \(\phi _{fi}\) with \(i=1\dots 4\) of each flipper can be controlled individually. Due to those additional linkage structures, the mobile platform extends its DOF in position to five. With a certain combination of flipper rotations, the platform can be moved as shown in the kinematic chain of Fig. 1a.
The joints \(P_{1}\) and \(P_{2}\) can be assigned to the differential drive system, the joints \(P_{3}\) and \(P_{4}\) can swivel the whole platform around \(x_{R}\) and \(y_{R}\) axis. A movement of all four flippers downwards by the same angle can be used to fulfill an elevation of the whole system and this translational movement in \(z_{R}\) direction can be seen as joint \(P_{5}\) as also shown in Fig. 2.

2.1.2 Omnidirectional mecanum wheels

The requirements for the movement capabilities of an mobile robot used in industrial environment are totally different compared to the scenario described before. The floor in factories is commonly rather smooth, obstacle-free and free of steps. Consequently, these environments can be considered structured quasi well-known. This brings levitations to the construction of the drive train of mobile platforms and simplifications in autonomous navigation and path planing of mobile manipulators. Taking the advantage of the well-known environment into account, often holonomous mobile platforms which can move in all directions (omnidirectional) in the plane, are used.
The usage of four actuated Mecanum wheels ensures a linear velocity in \(x_{R}\) and \(y_{R}\) direction as well as an angular velocity around the \(z_{R}\) axis as shown in Fig. 4. That is why such mobile platforms with omnidirectional drive mechanism (Fig. 5) can be represented using three DOFs. In the kinematic chain of the mobile manipulator KAIROS (Fig. 5a), the joints \(P_{1}\), \(P_{2}\) and \(P_{3}\) represent these DOFs.
Detailed explanation of Mecanum wheels, as well as modeling and motion control algorithms of Mecanum wheel driven mobile manipulators, are given by Röhring et al. in [72], by Lin et al. in [51] and by Taheri et al. in [81]. The simplified inverse kinematics on velocity level is given by
$$ \begin{bmatrix} \omega _{1} \\ \omega _{2} \\ \omega _{3} \\ \omega _{4} \end{bmatrix} = \begin{bmatrix} 1& -1& -(l_{y}+l_{x}) \\ 1 & 1& (l_{y}+l_{x}) \\ 1 & 1 &-(l_{y}+l_{x}) \\ 1&-1&(l_{y}+l_{x})\end{bmatrix} \begin{bmatrix} \dot{x}_{R} \\ \dot{y}_{R} \\ \dot{\theta }_{R} \end{bmatrix} $$
(4)
with \(\omega _{i}\) the rotational wheel velocity of the i-th wheel, \(l_{x}\) and \(l_{y}\) are the half robot lengths and widths and \(R\) is the wheel radius. For an autonomous exploration, or path following, the velocities in the robot frame can be transformed into the world frame:
$$\begin{aligned} \dot{\mathbf{x}}_{W}=\mathbf{R}(\theta _{R})^{-1}\dot{\mathbf{x}}_{R} \end{aligned}$$
(5)
with \(\dot{\mathbf{x}}_{W}=[\dot{x}_{W},\;\dot{y}_{W},\;\dot{\theta }_{R}]^{T}\), \(\dot{\mathbf{x}}_{R}=[\dot{x}_{R},\;\dot{y}_{R},\;\dot{\theta }_{R}]^{T}\) and
$$ \mathbf{R}(\theta _{R})= \begin{bmatrix} \cos (\theta _{R})&\sin (\theta _{R})& 0 \\ -\sin (\theta _{R})& \cos (\theta _{R})& 0 \\ 0&0&1 \end{bmatrix} . $$
(6)

2.2 Manipulating and grasping

Manipulator arms to be mounted on moving robotic platforms need to exhibit a high ratio of payload compared to their own weight, this has been achieved in some of the recent manipulators such as KUKA LWR IIWA [8], the TM-series by Techman [82], or the Universal Robots Cobot-series [71]. Research approaches in this context show unified design for lightweight robot arms [96] and also more specific work in the fields of medicine, e.g. the da Vinci system (compare [44]), for the employment in space, e.g. the NASA ROBONAUT [6] or JPL arms (compare, e.g., [12]), or anti-terror missions such as the devices developed by the Forrest Miller and iRobot company (see also, e.g. [58]).
With respect to industry, manipulation and grasping employed in robotic devices, exploits a rather low degree of dexterity, still most of the systems present in production are used for monotonous tasks which do not require much grasping and manipulation intelligence (compare also [30]). The more our industrial settings change, i.e. demanding more flexible production lines and highly agile processes, the higher the requirements regarding robot manipulators become. Such problems are addressed by commercially available robotic hands such as the shadow-hand [16], the DLR-hand [9] and in research where a recent focus is also on soft devices for human-robot-interaction [24]. Currently, specialized grippers are developed specifically for each application, e.g. [28], approaches based on biomemimetic, soft devices (e.g., [37]) which naturally conform to a large number of different objects could lead to a more efficient use of grippers. Modular, highly redundant manipulators, which can change their configuration with respect to the assigned task are presented by Pieber et al. [67]. Manipulation in a mobile setting (see Fig. 6) is even more complex and different methods have to be developed to address flexibility [88].

2.3 Sensing

Perceiving the environment is a crucial capability of manipulators in general and mobile manipulators especially, it is important in a variety of fields where robots physically interact with the environment as well as with human beings: in human care and assistance applications [30, 62], in industry settings as Cobots (e.g., which have names such as Walt [22]), in fields of service [59] and also novel public mobility applications [36].
In order to perceive their environment properly, mobile robots and especially also mobile manipulators need to be equipped with the corresponding sensors. These sensors may be placed on different parts of the platform depending on the purpose they fulfill:

2.3.1 Elevated sensors

Such a setup resembles a concept known from biology: eyes. In the case of humans who walk upright, the eyes are elevated sensors - at the top of the body – in order to get the best possible impression of the surroundings. In mobile robotics, such a concept can enable, e.g., strategic ahead-of-path-planning and obstacle avoidance [50]. Important aspects in this context are the choice of proper sensor hardware, placement of the sensors and intelligent task planning: e.g. while a manipulation tasks is ongoing, these sensors can be used for planning next actions after completing the current task. These elevated sensors are often optical systems such as, e.g. light detection and ranging (LIDAR) [20], stereo cameras and RGB-D cameras [61].

2.3.2 Touch sensors

Due to the limited capabilities of cameras (e.g., with respect to the field of view: occlusion, bad lighting conditions, mounting and integration issues, e.g., with respect to the object properties: temperature, texture, material) size in terms of highly dynamic processes, often physical sensors are preferred over vision-based systems. Additionally they are preferable in such tasks, where properties of the manipulated object (surface texture, temperature, fragility, stiffness, etc.) are of major importance. Research in terms of visuo-tactile object perception has been shown recently, however, purely physical approaches show promising results in terms of resolution and bandwidth. Based on electrical sensors (see also [55]), e.g., employing capacitive sensing electrodes [74], such approaches can be easily fabricated using rapid-prototyping technology [26] and can enable exteroceptive as well as proprioceptive sensing of robotic devices and been shown previously for walking of humanoid robotics [27].

2.3.3 Base sensors

For holonomic platforms, such sensors often have to cover the whole proximity region of the base platform. This can be achieved using, e.g., laser rangefinders, LIDAR, Time-of-Flight and Radar [5], as well as ultra-sonic-based principles are in use. These often times need to be mounted on strategic positions on the mobile platform in order to optimally cover a field of view of \(f_{V} = 360^{\circ}\). These sensors are often used for map building in an unknown environment (such as is necessary in a dynamic industrial context or in the RoboCup Rescue League). This is commonly known as Simultaneous Localization and Mapping (SLAM). The quality (accuracy of the trajectory followed) of the SLAM depends strongly on the hardware used [29]. Depth estimation (such as enbaled by, e.g., LIDAR) can significantly improve the quality of the SLAM [70], this, however, also comes with an increased computational complexity.

2.4 Interfacing and interacting

Another aspect is the interfacing of robots with their environment, this is especially important when teaching and controlling the robot system in a collaboration task. Such interfaces can either be established using touchpad technology [25, 86] or in contactless gesture-based approaches [78]. In the latter it is often mandatory to find a common language which is, on the one hand, intuitive for the human operator and on the other hand easily interpretable and manageable in terms of signal processing [85].
The terms human-robot interaction and human-robot collaboration describe all those application scenarios and the various methods used to implement these. In most cases, especially in industry, it is important to provide a safe environment for humans. In this respect, lately, strong research efforts have been put into qualifying and quantifying the resulting injury and level of pain caused by an impact with certain energy and location on the body [33, 34]. Apart from the application of ISO/TS 15066 [56], more effort is necessary in the definition of standard testing methods and standardized test setup and hardware. Currently available developments which enable safe human robot co-working are airbags systems [90], robotic skins [15, 53], but also control strategies for intuitive hand guidance [92] based on force/torque-sensing.

3 Intelligence (software)

The software implementation of mobile manipulators is the systems’ intelligence. It is connecting the hardware and corresponding sensor readings in a sense-plan-act-loop. It consequently is the brain of the whole system. Important tasks here are:
  • Interfacing: communicating with the sensors and actuators hardware.
  • Perception: human and object detection algorithms, mapping.
  • Knowledge-base: gather information about the robot, the environment, objects.
  • Planning: path and task planning components.
  • Control: actuate the system in order to follow the planned movement as accurately as possible.

3.1 Understanding humans and the environment

The authors of [77] claim already that common metrics are important in Human-Robot-Interaction and safety standards have been implemented since then. Vision-based distance monitoring has recently been presented in [80] and in [73], a strategy for human-robot collaboration is presented where the signals from 378 sensors of an artificial skin are used in a constraint-based optimization task to control the robot and avoid collisions. Delicate grasp force control, for manipulation, based on physical sensors for a high DOF robot hand (Fig. 7) has been shown in [18]. While in the previous approaches, human-robot physical contact is monitored, in [17], the authors establish an interaction scheme based on gaze recognition of the human co-operator. Even the role of robot-telepathy is evaluated in [93]. In this field of robot intelligence, common metrics and a standardized approach, however, are still missing. It is very likely that different strategies will have to be pursued depending on the field of robot application (elderly or child care, robot tele-operation, flexible industry with a lot of interaction, pure production lines, etc.).

3.2 Moving smartly (path and motion planning)

Path planning is generally defined as follows: A collision free and continuous path in the joint angle space is to be found to bring a robot from a start configuration (position and orientation) to a target configuration without violating the limitations of the system [89]. Redundant robots, as described before, are able to move while the position and orientation of the end effector are fixed. An advantage of such kinematically redundant systems is the capability of collision avoidance, while the end effector follows a specific path [60]. Therefore, such systems can be used for technically difficult dexterity tasks, for example grasping in a tube or between two walls. The workspace of a stationary industrial robot is also limited by the arm length and allowed joint torques. The initial placement of the base of a static industrial serial manipulator when installing it is often done by trial and error or by help of human experience. For mobile manipulators controlled by an operator (as often in rescue missions) this is also valid. For autonomous driven mobile manipulators the positioning task of the mobile platform which is equal to the base of the mounted serial manipulator is part of the path planning algorithm and there are many possibilities how to fulfill this planing task.
Mobile manipulator movement can be considered in three ways, movement of the mobile platform, movement of the manipulator or a combination of both. Depending on the system the separation of mobile platform and manipulator reduces the difficulty to solve the inverse kinematics problem of such kinematically redundant systems [35], e.g., Husty et al. [41] show an analytic solution of the inverse kinematic for a general serial link manipulator. The problem of path planning and collision avoidance in general of redundant configurations can be solved using different methods. In [100], the authors describe the solution, based on numerical optimization algorithms using the pseudo-inverse of the Jacobi matrix. In [14] neural networks are used to find a solution for a planar manipulator with three joints. Quendler [69] uses a combination of different concepts to solve the inverse kinematics problem for a 6-DOF manipulator used on the mobile rescue robot R.U.D.I. [42] which was later extended with an additional joint [68] and mounted on the rescue robot platform T.R.U.D.I. [38] (Fig. 1a). Here, the Cyclic Coordinate Descent and Broyden-Fletcher-Goldfarb-Shanno Quasi-Newton [87] methods are used. The manipulator is controlled by a human operator with the help of a joystick input in either of the following modes: Control of each joint individual (forward kinematics), control position and orientation of the end effector relative to the actual end effector coordinate system or to the robots body fixed coordinate system (inverse kinematics).
In [7] and [79] an approach is shown where not only the Cartesian working space of the robot is used for the solution but also the joint angle space. Both [49] and [31] give an overview of many possible solutions for path planning and collision avoidance in the Cartesian workspace or low dimensional joint angle space. A summary of methods for higher dimensional spaces is given in [66]. In particular, the three methods Net-based, Sampling-based and Trajectory-Optimizing Path Planning are discussed. Additional to collision avoidance while following a desired path with redundant robotic systems also the configuration regarding manipulability from different points of view can be considered. Thereby often manipulator Jacobian based methods as a measure of robot manipulability introduced by Yoshikawa in [98] are used. It is based on the idea to determine the capability of the end effector to move in an certain direction as well as how easy the end effector can generate forces. The detailed calculation of those measurements is based on the idea of manipulability and force ellipsoids [52]. Based on this idea also the dynamic manipulability measure was introduced [97] and reformulated for redundant systems by Chiacchio in [13]. The authors in [75] use a combination of different concepts such as manipulability, reachability [54] and stiffness [3] to define a so-called comfort zone for kinematically redundant mobile manipulators.
Additionally, non-traditional methods such as robot learning based on infant development theory has been presented in [94]. In this setting, the mobile manipulator is made to play games with varying difficulty as shown in Fig. 8. As soon as there is no more progress on one level of difficulty, it will automatically step forward in complexity.

3.3 Do the right thing (control)

Mobile Robots are a set of complex mechanical systems, sensors and computational processes. A control system architecture and its implementation solve the challenging task to transfer these components to a well performing working robot. A traditional control methodology decomposes the robot’s tasks into functional steps: sense – plan (control) – act. This is needed and often suitable for solving the problem of driving a mobile robot, i.e. to guarantee a smooth navigation of a mobile robot platform. Classical PD or PID controller are still used in terms of servo control of the robot’s individual drives. Many effective methods for the navigation and trajectory tracking have been proposed [46].
Robot control of mobile manipulator platforms in general deals with the central problem of finding appropriate forces or torques that are generated by the actuators, e.g. DC-motors, in order to move the robot arm or hand to a desired position or to track a desired reference-trajectory.
Cascade control structures of multiple linear and nonlinear controllers are widely used. The mobile rescue robot T.R.U.D.I. uses four brushless DC (BLDC) motors with a power of \(P_{M} = 200~\mbox{W}\) to drive the main tracks. Each main drive (left and right side of the robot) is powered by two motors to achieve a higher driving torque. The two motors on each side are permanently coupled via a chain connection (Fig. 9 marked in red). Here, a combination of closed loop an open loop controller together with the BLDC motor controller was implemented. Figure 9 shows the overall control structure, one can see the user input (robot velocities \(\dot{x}_{R}\) and \(\dot{\phi }_{R}\), the inverse kinematics block is used to calculate the desired angular velocities of the chain sprocket for each track (\(\omega _{1}\) and \(\omega _{2}\)). The green blocks represent linear (LEAD-compensator [39]) speed controllers which control the first motor (of each side) in an closed loop control structure. The control signal (controller output) is also sent to the second BLDC motor controller (\(M_{2L}\)/\(M_{2R}\)) to achieve the same speed.
In known or adaptable environments (e.g. in a factory), it is suitable to employ model-based dynamic control strategies including inverse kinematics approaches. They are based on mathematical descriptions of the manipulators in terms of nonlinear differential equations and their parameters. Computed torque control together with PD or PID control have successfully been employed for control in joint space [43, 45]. Such a combined control strategy was also used to control the 7-DOF manipulation arm on the mobile rescue robot T.R.U.D.I. (Fig. 1a) [68].
Depending on the used drive concept (e.g. wheeled robots), present (nonholonomic) constraints and the complexity (highly nonlinear systems) nonlinear control techniques like feedback linearization or Lyapunov based control turn out to be mathematically intense, but suitable methods [19, 83].
In uncertain (highly dynamic) and uncontrolled environments, the control algorithms must be more sophisticated involving some kind of (artificial) intelligence. One of the methodologies for treating such uncertain systems is the adaptive control methodology [40, 91]. Furthermore, the design of a robust control has been attracting great attention. The sliding mode control methodology is a robust control procedure often used in mobile robots’ control [2].
Recently, ANN-based control methods have been attracted much more attention. The authors in [99], for example, address the control problem for a class of mobile robot systems, where multi-layer feed forward ANNs and deep learning are both employed for the mobile robot system to achieve the trajectory tracing and obstacles avoidance.
Especially, when mobile rescue robots are used, the mobile manipulator is often teleoperated by a human operator. This can be supported by additional algorithms which may use additional sensor readings, be based on inverse kinematics (for example as described in Sect. 4.1) or semi-autonomous driving methods. Semi-autonomous here means assistant algorithms which help an operator to control a robot with higher DOFs. For Example the mobile manipulator T.R.U.D.I. described in Sect. 2.1 needs additional operator inputs to move the four flippers to support the mobile manipulator while overcoming difficult obstacles like stairs or steps. Additionally, in [32, 63, 64] different possibilities to control additional flipper tracks by sensor information about the environment or soil condition are described.
A comprehensive review of control strategies and their advantages and disadvantages can be found in [84].

4 RoboCup challenges

The first RoboCup competition was held at IJCAI-97, Nagoya. The idea was to push the developments of soccer playing robots up to a level to participate in a soccer game against human players in year 2050. At this time only soccer robots where in the view of the researchers by comparing real robots as well as robot simulation algorithms in the competition [47]. Step by step, different leagues where established each pursuing a different goal. With competitions in the Small-Size-, Soccer Simulation-, the Middle-Size-, the Standard Platform- as well as the Humanoid-League, soccer is still one main focus in the competition, with different aspects of soccer robots taken into account. Furthermore, more practice related tasks were included in the RoboCup competitions over the years. This results in a diversity of different disciplines of which the main ones are shown in Table 1 (including date of first event and main drive method).
Table 1.
Summary of main RoboCup leagues
League
Date
Drive method
Soccer Simulation
1996
depending on league
Soccer Small-Size
1996
omni directional
Soccer Middle-Size
1996
omni directional
Soccer Humanoid KidSize
2005
2 legs, human gait
Soccer Humanoid TeenSize
2007
2 legs, human gait
Soccer Humanoid AdultSize
2007
2 legs, human gait
Soccer Standard Platform
2004
2 legs, human gait
RoboCup Rescue
2000
differential drive
RoboCup Rescue Simulation
2000
depending on league
RoboCup@Home
2006
omni directional
RoboCup Logistics
2006
omni directional
RoboCup@Work
2007
omni directional
RoboCup junior
2000
depending on league
In the following, we discuss mobile manipulators in view of the RoboCup Rescue and RoboCup@Work competitions. Mobile manipulators in general, with different suitable drive methods as shown in Table 1, are used in RoboCup Rescue, RoboCup@Work, RoboCup Logistics, RoboCup@Home. Mobile robot platforms with omnidirectional drive system but without classical serial manipulators are used in Soccer Small-Size and Soccer Middle-Size leagues. Steinbauer et al. [76] give an overview of the development of the different RoboCup leagues from year 2000 to year 2016.

4.1 RoboCup rescue

After the Great Hanshin Earthquake (1995) in Kobe, the Japanese government decided to promote research related to urban disaster and rescue robots [4]. The RoboCup Rescue competition simulates the search for victims in a disaster scenario such as after an earthquake or flooding in an urban environment. Until 2015 the main focus of the competition was to find simulated victims in a big area with various obstacles like stairs, pipes, ramps and stones to overcome as shown in Fig. 10.
Finding those victims, scores points for the competition ranking, extra points are gained for mapping the area, marking various objects in the map or various audio and visual detections. Those simulated victims can be placed all over the competition area and consists of visual markers as QR codes, E or C charts, a heat pad to simulate body temperature and an audio player.
They can be located at a height of up to \(h_{o} = 1.6~\mbox{m}\) over ground, be hidden in holes or can be found in pipes and behind closed doors. The search for victims could be done by a swarm of robots, where only one of these migh be teleoperated and the others needed to operate in autonomous mode. Each year, the rules for the RoboCup Rescue competitions are extended to support the development of new features for the participating robots and to enhance their existing capabilities. The competition is manly based on the mobile robot test strategies developed by the American National Institute of Standards and Technology (NIST).
In the year 2016, a new rule set was introduced during the RoboCup World Championship in Leipzig (Germany) with the focus to test repeatability, functionality and operator proficiency, and all capabilities should be combined onto a single robot platform.
So-called individual test lanes (example shown in Fig. 12) where introduced. Each lane has another testing focus [65]. For each repetition of one lane, the team earns one point and by the help of basic sensor and dexterity tests at the begin of each test round this number can be multiplied by the number of successful fulfilled sensor/dexterity tasks. The best teams in this individual tests are qualified to participate in the final runs where the individual test lanes are used to build a large arena with the goal to find as many simulated victims as possible.
The basic sensor and dexterity tests at the beginning of each test lane ensures the reliability of the system. Especially, test lanes out of the so called mobility tests suits, include driving over terrain with high difficulty. This are for example driving over sand and gravel (with \(15^{\circ}\) slope) as well as stepfields (a diagonal hill terrain consisting of 20 cm square steps made from posts with flat tops and stairs (\(35^{\circ}\) and \(45^{\circ}\)) and obstacles partly blocked with debris, e.g. angled bars in defined locations). These tests require a high degree of stability and reliability in the mechanical as well as in the electronic and sensor system. The dexterity and sensor tests have to be done every time the mobile manipulator starts on a new test lane which is approximately 5 times a day. The schedule during one competition day is very tight therefore a problem in the sensor system or with the manipulation arm can lead to a loss of points.
Figure 11 shows the used test board which consists of two parts where the lower part is used to test the sensors of the mobile manipulator and the upper part is used to test the dexterity of the mobile manipulator. For the sensor test the robot system has to fulfill 6 identification tasks:
  • Video Image Resolution: Visual identification the third biggest concentric C gap by the competition judge.
  • Motion Detection: Highlight the moving target (1-4) automatically by any usage of any camera and integrated video processing. Additionally track the identified motions on the operator station textually or audibly.
  • Thermal Image Resolution: Visual identification of the concentric Landolt C with a 2 cm gap to evaluate thermal resolution by the competition judge.
  • Audio Acuity: Two way communication from mobile manipulator to operator station. Tested by judge and team members.
  • Color/Pattern Recognition: Automatically identification of two hazards labels out of 12 possibilities. Highlight and track the identified labels on the operator station textually or audibly.
  • Gas: Operator demonstrates active display of increase in \(\mathrm{CO}_{2}\) concentration when a team-mate breaths into the robot’s sensor or a \(\mathrm{CO}_{2}\) cartridge is opened near the sensor.
All identification tasks has to be done with a minimum distance of 40 cm to the sensor board. Furthermore 4 dexterity tasks has to be performed:
  • Touch: Touch a 1 cm diameter circular target on the end of a pipe with a pencil attached to the manipulator end effector.
  • Rotate: Grab a 5 cm octagonal pipe cap and rotate \(180^{\circ}\) with the end effector.
  • Extract: Grab a 5 cm octagonal pipe cap and pull out of the pipe after holding it 1 s it can be dropped to the floor.
  • Inspect: Visual identification the number of bars placed on the internal walls of a 5 cm pipe by the competition judge.
For the sensor and dexterity tests a precise movement of the manipulator without oscillations or vibrations as well as a stable positioning of the mobile platform (without tilting) is crucial. To unveil the mobile manipulator in rescue purpose often additional flipper tracks as described in Sect. 2 are used. Moreover it has been shown that a remote controlled movement of the end effector by using an inverse kinematics solution as described in 3.2 is a big advantage in terms of usability and time consumption to solve the task compared to a simple forward kinematic movement. Especially for the sensor and dexterity tests the operator uses the inverse kinematics mode which allows a movement of the end effector related to the end effector-camera coordinate system. In this right handed coordinate system the z-y plane is equal to the camera image plane and the x-axis is equal to the camera optical axis. Therefore a movement parallel to the sensor/dexterity board is done very intuitive in comparison to a movement with classical forward kinematics where every joint of the manipulator has to be moved individually.

4.2 RoboCup@Work

In 2012, the RoboCup Federation included the RoboCup @Work league to increase the development progress of mobile manipulators in a more industry-related setting. The mobile robotic systems used in RoboCup @Work are aimed to be used as flexible multipurpose systems also for smaller companies with changing product range. In the competition, different tasks like acquiring, pick and place as well as transportation of different machine parts and objects are to be performed. The contest procedure is separated into two parts. After some basic tests which must be completed, an extended, more difficult test scenario has to be fulfilled.
The basic tests include testing navigation, manipulation and transportation capabilities of the participating mobile manipulators with three different test tasks:
  • Basic navigation: The mobile manipulator will be send a string contains a series of triples, each of which specifies a location, an orientation and a pause duration. The challenge is to navigate autonomous robust and safe in the scenario environment. Additional to specific service areas, arena objects, wall markers and floor markers random obstacles my be placed in the environment.
  • Basic manipulation: The mobile manipulator will be send some task specifications consist of the objects source location, the objects destination location, a list of objects to manipulated from source to the destination area and the final place for the robot. As objects different obstacles like aluminum profiles of different size and color, screws, nuts and plastic tubes can be used. An object does not count as placed when it dropped from a height above 5 cm. The pose of the object at the destination location can be chosen freely by the robot.
  • Basic transportation: Here the ability of the robots to combine navigation and manipulation tasks as well as its task planning capabilities are tested. The task is to pic objects from the source location to the destination location. Two lists will be send to the robot. The first list contains a list of manipulation object descriptions, the second list contains for each destination area a configuration of manipulation objects the robot is supposed to achieve. A robot may carry up to three objects at the same time and it is not allowed to place objects anywhere except on the robot itself and the correct destination areas.
Figure 13a shows a KUKA youBot robot platform during the basic manipulation test [1]. Figure 13b shows the mobile manipulator of evocortex used by the RoboCup@Work team AutonOHM at the Nuremberg Institute of Technology during the precision placement test where the mobile manipulator has to pick up different obstacles like screws, nuts or aluminum profiles and has to place them into prepared cavities on a target desk after a short movement of the robot platform. Figure 14 shows the rotating table which is used in the competition for the so called rotating table test. The robot has to navigate autonomous to the table and has to grasp all objects from the moving table. Objects can pass multiple times by the robot end-effector until the maximum time is over. Target location of the objects is on the robot itself. The rotating table test assesses the ability to pick and place moving objects which are placed on a rotating turntable with unknown speed. In this context, the vision system as well as the physical movement of the end-effector (this is the robots’ hand-eye-coordination) have to meet very high requirements in terms of speed and precision [48].
The score calculation for each test is defined individually, it includes points for achieving certain sub tasks, for winning a run and also penalty points can be assigned each time an incident occurs (collisions, losing an object during manipulation or transportation). Additional to this tests, there are further technical challenges (e.g. cluttered pick test, human-robot collaboration, open challenge) to evaluate specific capabilities of the robotic system. These challenges are separately awarded and could be included into the major competition in future.

5 Conclusion

Mobile manipulation is a vivid research field with a variety of applications such as industry, rescue, service and health. Each subfield covered in the development of mobile manipulators, such as construction of the hardware (platform, manipulator, gripper), choice of suitable algorithms for path-planning, obstacle avoidance, control and perception is a huge field of research on its own. In this paper, we have tried to give a brief overview of recent developments in all those fields covered together with an insight into the development on the example of a tracked rescue robot developed at CUAS. Additionally, we have discussed mobile manipulation challenges in the context of the RoboCup and especially the RoboCup Rescue and RoboCup@Work leagues. We consider the RoboCup as an attractive platform to motivate young researchers and students to have a deeper look into the research challenges ahead in robotics in general and in this context especially in mobile manipulation.

Conflict of interest

The authors declare that they have no conflict of interest.
Open Access Dieser Artikel wird unter der Creative Commons Namensnennung 4.0 International Lizenz veröffentlicht, welche die Nutzung, Vervielfältigung, Bearbeitung, Verbreitung und Wiedergabe in jeglichem Medium und Format erlaubt, sofern Sie den/die ursprünglichen Autor(en) und die Quelle ordnungsgemäß nennen, einen Link zur Creative Commons Lizenz beifügen und angeben, ob Änderungen vorgenommen wurden. Die in diesem Artikel enthaltenen Bilder und sonstiges Drittmaterial unterliegen ebenfalls der genannten Creative Commons Lizenz, sofern sich aus der Abbildungslegende nichts anderes ergibt. Sofern das betreffende Material nicht unter der genannten Creative Commons Lizenz steht und die betreffende Handlung nicht nach gesetzlichen Vorschriften erlaubt ist, ist für die oben aufgeführten Weiterverwendungen des Materials die Einwilligung des jeweiligen Rechteinhabers einzuholen. Weitere Details zur Lizenz entnehmen Sie bitte der Lizenzinformation auf http://​creativecommons.​org/​licenses/​by/​4.​0/​deed.​de.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Literature
1.
go back to reference Ahmed, S., Jandt, T., Kulkarni, P., Lima Carrion, O., Mallick, A., Moriarty, A., Nair, D., Thoduka, S., Awaad, I., Dwiputra, R., Hegger, F., Hochgeschwender, N., Sanchez, J., Schneider, S., Kraetzschmar, G. (2016): b-it-bots RoboCup@Work team description paper. Ahmed, S., Jandt, T., Kulkarni, P., Lima Carrion, O., Mallick, A., Moriarty, A., Nair, D., Thoduka, S., Awaad, I., Dwiputra, R., Hegger, F., Hochgeschwender, N., Sanchez, J., Schneider, S., Kraetzschmar, G. (2016): b-it-bots RoboCup@Work team description paper.
2.
go back to reference Aienizi, T. O., Aienizi, N. S., Rouili, Z. A., Dhahri, S. (2019): Trajectory tracking of wheeled mobile robot using adaptive second order sliding mode controller. In 2019 6th international conference on control, decision and information technologies (CoDIT) (pp. 2039–2045). Aienizi, T. O., Aienizi, N. S., Rouili, Z. A., Dhahri, S. (2019): Trajectory tracking of wheeled mobile robot using adaptive second order sliding mode controller. In 2019 6th international conference on control, decision and information technologies (CoDIT) (pp. 2039–2045).
3.
go back to reference Ajoudani, A., Tsagarakis, N. G., Bicchi, A. (2017): Choosing poses for force and stiffness control. IEEE Trans. Robot., 33(6), 1483–1490. Ajoudani, A., Tsagarakis, N. G., Bicchi, A. (2017): Choosing poses for force and stiffness control. IEEE Trans. Robot., 33(6), 1483–1490.
5.
go back to reference Ali, F., Bauer, G., Vossiek, M. (2014): A rotating synthetic aperture radar imaging concept for robot navigation. IEEE Trans. Microw. Theory Tech., 62(7), 1545–1553. Ali, F., Bauer, G., Vossiek, M. (2014): A rotating synthetic aperture radar imaging concept for robot navigation. IEEE Trans. Microw. Theory Tech., 62(7), 1545–1553.
6.
go back to reference Ambrose, R. O., Aldridge, H., Askew, R. S., Burridge, R. R., Bluethmann, W., Diftler, M., Lovchik, C., Magruder, D., Rehnmark, F. (2000): Robonaut: NASA’s space humanoid. IEEE Intell. Syst. Appl., 15(4), 57–63. MATH Ambrose, R. O., Aldridge, H., Askew, R. S., Burridge, R. R., Bluethmann, W., Diftler, M., Lovchik, C., Magruder, D., Rehnmark, F. (2000): Robonaut: NASA’s space humanoid. IEEE Intell. Syst. Appl., 15(4), 57–63. MATH
7.
go back to reference Bhattacharya, S., Pivtoraiko, M. (2015): A classification of configuration spaces of planar robot arms for a continuous inverse kinematics problem. Acta Appl. Math., 139(1), 133–166. MathSciNetMATH Bhattacharya, S., Pivtoraiko, M. (2015): A classification of configuration spaces of planar robot arms for a continuous inverse kinematics problem. Acta Appl. Math., 139(1), 133–166. MathSciNetMATH
8.
go back to reference Bischoff, R., Kurth, J., Schreiber, G., Koeppe, R., Albu-Schaeffer, A., Beyer, A., Eiberger, O., Haddadin, S., Stemmer, A., Grunwald, G., Hirzinger, G. (2010): The KUKA-DLR lightweight robot arm - a new reference platform for robotics research and manufacturing. In ISR 2010, 41st international symposium on robotics, and ROBOTIK 2010, 6th German conference on robotics (pp. 1–8). Bischoff, R., Kurth, J., Schreiber, G., Koeppe, R., Albu-Schaeffer, A., Beyer, A., Eiberger, O., Haddadin, S., Stemmer, A., Grunwald, G., Hirzinger, G. (2010): The KUKA-DLR lightweight robot arm - a new reference platform for robotics research and manufacturing. In ISR 2010, 41st international symposium on robotics, and ROBOTIK 2010, 6th German conference on robotics (pp. 1–8).
9.
go back to reference Borst, C., Fischer, M., Haidacher, S., Liu, H., Hirzinger, G. (2003): DLR hand II: experiments and experience with an anthropomorphic hand. In 2003 IEEE international conference on robotics and automation (Cat. No. 03CH37422) (Vol. 1, pp. 702–707). Borst, C., Fischer, M., Haidacher, S., Liu, H., Hirzinger, G. (2003): DLR hand II: experiments and experience with an anthropomorphic hand. In 2003 IEEE international conference on robotics and automation (Cat. No. 03CH37422) (Vol. 1, pp. 702–707).
10.
go back to reference Brandstötter, M., Mirkovic, D., Hofbaur, M. (2017): Mobile Manipulation – eine altbekannte Technologie findet durch sensitive Robotertechnologie Einzug in die Industrie. In C-AR2017 – conference on automation and robotics (pp. 1–6). Brandstötter, M., Mirkovic, D., Hofbaur, M. (2017): Mobile Manipulation – eine altbekannte Technologie findet durch sensitive Robotertechnologie Einzug in die Industrie. In C-AR2017 – conference on automation and robotics (pp. 1–6).
11.
go back to reference Bruno Siciliano, O. K. (2008): Springer handbook of robotics (p. 2008). Berlin: Springer. MATH Bruno Siciliano, O. K. (2008): Springer handbook of robotics (p. 2008). Berlin: Springer. MATH
12.
go back to reference Burkhardt, M., Karumanchi, S., Edelberg, K., Burdick, J. W., Backes, P. (2018): Proprioceptive inference for dual-arm grasping of bulky objects using robosimian. In 2018 IEEE international conference on robotics and automation (ICRA) (pp. 4049–4056). Burkhardt, M., Karumanchi, S., Edelberg, K., Burdick, J. W., Backes, P. (2018): Proprioceptive inference for dual-arm grasping of bulky objects using robosimian. In 2018 IEEE international conference on robotics and automation (ICRA) (pp. 4049–4056).
13.
go back to reference Chiacchio, P., Concilio, M. (1998): The dynamic manipulability ellipsoid for redundant manipulators. In Proceedings. 1998 IEEE international conference on robotics and automation (Cat. No. 98CH36146) (Vol. 1, pp. 95–100). Chiacchio, P., Concilio, M. (1998): The dynamic manipulability ellipsoid for redundant manipulators. In Proceedings. 1998 IEEE international conference on robotics and automation (Cat. No. 98CH36146) (Vol. 1, pp. 95–100).
14.
15.
go back to reference Cirillo, A., Ficuciello, F., Natale, C., Pirozzi, S., Villani, L. (2016): A conformable force/tactile skin for physical human-robot interaction. IEEE Robot. Autom. Lett., 1(1), 41–48. Cirillo, A., Ficuciello, F., Natale, C., Pirozzi, S., Villani, L. (2016): A conformable force/tactile skin for physical human-robot interaction. IEEE Robot. Autom. Lett., 1(1), 41–48.
17.
go back to reference Das, D., Rashed, M. G., Kobayashi, Y., Kuno, Y. (2014): Recognizing gaze pattern for human robot interaction. In 2014 9th ACM/IEEE international conference on human-robot interaction (HRI) (pp. 142–143). Das, D., Rashed, M. G., Kobayashi, Y., Kuno, Y. (2014): Recognizing gaze pattern for human robot interaction. In 2014 9th ACM/IEEE international conference on human-robot interaction (HRI) (pp. 142–143).
20.
go back to reference Dietrich, R., Dörr, S. (2019): Deep learning-based mutual detection and collaborative localization for mobile robot fleets using solely 2D lidar sensors. In 2019 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 6706–6713). Dietrich, R., Dörr, S. (2019): Deep learning-based mutual detection and collaborative localization for mobile robot fleets using solely 2D lidar sensors. In 2019 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 6706–6713).
21.
go back to reference Dissanayake, G., Paxman, J., Miro, J. V., Thane, O., Thi, H. (2006): Robotics for urban search and rescue. In First international conference on industrial and information systems (pp. 294–298). Dissanayake, G., Paxman, J., Miro, J. V., Thane, O., Thi, H. (2006): Robotics for urban search and rescue. In First international conference on industrial and information systems (pp. 294–298).
22.
go back to reference El Makrini, I., Elprama, S. A., Van den Bergh, J., Vanderborght, B., Knevels, A., Jewell, C. I. C., Stals, F., De Coppel, G., Ravyse, I., Potargent, J., Berte, J., Diericx, B., Waegeman, T., Jacobs, A. (2018): Working with walt: how a cobot was developed and inserted on an auto assembly line. IEEE Robot. Autom. Mag., 25(2), 51–58. El Makrini, I., Elprama, S. A., Van den Bergh, J., Vanderborght, B., Knevels, A., Jewell, C. I. C., Stals, F., De Coppel, G., Ravyse, I., Potargent, J., Berte, J., Diericx, B., Waegeman, T., Jacobs, A. (2018): Working with walt: how a cobot was developed and inserted on an auto assembly line. IEEE Robot. Autom. Mag., 25(2), 51–58.
23.
go back to reference Endo, D., Okada, Y., Nagatani, K., Yoshida, K. (2007): Path following control for tracked vehicles based on slip-compensating odometry. In 2007 IEEE/RSJ international conference on intelligent robots and systems (pp. 2871–2876). Endo, D., Okada, Y., Nagatani, K., Yoshida, K. (2007): Path following control for tracked vehicles based on slip-compensating odometry. In 2007 IEEE/RSJ international conference on intelligent robots and systems (pp. 2871–2876).
24.
go back to reference Escaida Navarro, S., Nagels, S., Alagi, H., Faller, L. M., Goury, O., Morales-Bieze, T., Zangl, H., Hein, B., Ramakers, R., Deferme, W., Zheng, G., Duriez, C. (2020): A model-based sensor fusion approach for force and shape estimation in soft robotics. IEEE Robot. Autom. Lett., 5, 5621–5628. Escaida Navarro, S., Nagels, S., Alagi, H., Faller, L. M., Goury, O., Morales-Bieze, T., Zangl, H., Hein, B., Ramakers, R., Deferme, W., Zheng, G., Duriez, C. (2020): A model-based sensor fusion approach for force and shape estimation in soft robotics. IEEE Robot. Autom. Lett., 5, 5621–5628.
25.
go back to reference Faller, L. M., Mühlbacher-Karrer, S., Zangl, H. (2016): Inkjet-printing rapid prototyping of a robust and flexible capacitive touch panel. In IEEE sensors (Vol. 2016). Faller, L. M., Mühlbacher-Karrer, S., Zangl, H. (2016): Inkjet-printing rapid prototyping of a robust and flexible capacitive touch panel. In IEEE sensors (Vol. 2016).
27.
go back to reference Faller, L. M., Stetco, C., Mitterer, T., Zangl, H. (2019): An all-flexible sensing sole for legged robots. In 2019 IEEE international conference on flexible and printable sensors and systems (FLEPS). Faller, L. M., Stetco, C., Mitterer, T., Zangl, H. (2019): An all-flexible sensing sole for legged robots. In 2019 IEEE international conference on flexible and printable sensors and systems (FLEPS).
28.
go back to reference Faller, L. M., Stetco, C., Zangl, H. (2019): Design of a novel gripper system with 3D- and inkjet-printed multimodal sensors for automated grasping of a forestry robot. In 2019 IEEE/RSJ international conference on intelligent robots and systems (IROS). Faller, L. M., Stetco, C., Zangl, H. (2019): Design of a novel gripper system with 3D- and inkjet-printed multimodal sensors for automated grasping of a forestry robot. In 2019 IEEE/RSJ international conference on intelligent robots and systems (IROS).
29.
go back to reference Filipenko, M., Afanasyev, I. (2018): Comparison of various slam systems for mobile robot in an indoor environment. In 9th IEEE int. conf. on intelligent systems. Filipenko, M., Afanasyev, I. (2018): Comparison of various slam systems for mobile robot in an indoor environment. In 9th IEEE int. conf. on intelligent systems.
30.
go back to reference Garcia, I., Gonçalves, F., Ribeiro, T., Fernandes, P., Rocha, C., Boucinha, R., Lopes, G., Ribeiro, A. F. (2019): Autonomous 4DOF robotic manipulator prototype for industrial environment and human cooperation. In 2019 IEEE international conference on autonomous robot systems and competitions (ICARSC) (pp. 1–6). Garcia, I., Gonçalves, F., Ribeiro, T., Fernandes, P., Rocha, C., Boucinha, R., Lopes, G., Ribeiro, A. F. (2019): Autonomous 4DOF robotic manipulator prototype for industrial environment and human cooperation. In 2019 IEEE international conference on autonomous robot systems and competitions (ICARSC) (pp. 1–6).
31.
go back to reference Gasparetto, A., Boscariol, P., Lanzutti, A., Vidoni, R. (2015): Path planning and trajectory planning algorithms: a general overview. In Motion and operation planning of robotic systems (pp. 3–27). Gasparetto, A., Boscariol, P., Lanzutti, A., Vidoni, R. (2015): Path planning and trajectory planning algorithms: a general overview. In Motion and operation planning of robotic systems (pp. 3–27).
33.
go back to reference Haddadin, S., Albu-Schaffer, A., Haddadin, F., Rosmann, J., Hirzinger, G. (2011): Study on soft-tissue injury in robotics. IEEE Robot. Autom. Mag., 18(4), 20–34. Haddadin, S., Albu-Schaffer, A., Haddadin, F., Rosmann, J., Hirzinger, G. (2011): Study on soft-tissue injury in robotics. IEEE Robot. Autom. Mag., 18(4), 20–34.
34.
go back to reference Haddadin, S., Haddadin, S., Khoury, A., Rokahr, T., Parusel, S., Burgkart, R., Bicchi, A., Albu-Schäffer, A. (2012): A truly safely moving robot has to know what injury it may cause. In 2012 IEEE/RSJ international conference on intelligent robots and systems (pp. 5406–5413). Haddadin, S., Haddadin, S., Khoury, A., Rokahr, T., Parusel, S., Burgkart, R., Bicchi, A., Albu-Schäffer, A. (2012): A truly safely moving robot has to know what injury it may cause. In 2012 IEEE/RSJ international conference on intelligent robots and systems (pp. 5406–5413).
35.
go back to reference Hanafusa, H.T., Nakamura, Y. (1981): Analysis and control of articulated robot arms with redundancy. IFAC Proc. Vol., 14(2), 1927–1932. Hanafusa, H.T., Nakamura, Y. (1981): Analysis and control of articulated robot arms with redundancy. IFAC Proc. Vol., 14(2), 1927–1932.
36.
go back to reference Hashimoto, N., Tomita, K., Kamimura, A., Matsumoto, O. (2014): Technology evaluations of personal mobility vehicles in Tsukuba-city mobility robot designated zone — an experimental approach for personal mobility for sharing. In 2014 international conference on connected vehicles and expo (ICCVE) (pp. 773–774). Hashimoto, N., Tomita, K., Kamimura, A., Matsumoto, O. (2014): Technology evaluations of personal mobility vehicles in Tsukuba-city mobility robot designated zone — an experimental approach for personal mobility for sharing. In 2014 international conference on connected vehicles and expo (ICCVE) (pp. 773–774).
37.
go back to reference Hashizume, J., Huh, T. M., Suresh, S. A., Cutkosky, M. R. (2019): Capacitive sensing for a gripper with gecko-inspired adhesive film. IEEE Robot. Autom. Lett., 4(2), 677–683. Hashizume, J., Huh, T. M., Suresh, S. A., Cutkosky, M. R. (2019): Capacitive sensing for a gripper with gecko-inspired adhesive film. IEEE Robot. Autom. Lett., 4(2), 677–683.
38.
go back to reference Hofer, P., Sereinig, M., Quendler, S., Werth, W. (2016): RoboCup rescue 2017 team description paper CUAS RRR. Tech. rep., RoboCup Rescue 2016 TDP Collection. Hofer, P., Sereinig, M., Quendler, S., Werth, W. (2016): RoboCup rescue 2017 team description paper CUAS RRR. Tech. rep., RoboCup Rescue 2016 TDP Collection.
41.
go back to reference Husty, M. L., Pfurner, M., Schröcker, H. P. (2007): A new and efficient algorithm for the inverse kinematics of a general serial 6R manipulator. Mech. Mach. Theory, 42(1), 66–81. MathSciNetMATH Husty, M. L., Pfurner, M., Schröcker, H. P. (2007): A new and efficient algorithm for the inverse kinematics of a general serial 6R manipulator. Mech. Mach. Theory, 42(1), 66–81. MathSciNetMATH
42.
go back to reference Isop, W., Sereinig, M., Quendler, S., Werth, W. (2013): Robot league team CUAS RRR-Team (Austria). Tech. rep., RoboCup Rescue 2016 TDP Collection. Isop, W., Sereinig, M., Quendler, S., Werth, W. (2013): Robot league team CUAS RRR-Team (Austria). Tech. rep., RoboCup Rescue 2016 TDP Collection.
44.
go back to reference Kazanzides, P., Chen, Z., Deguet, A., Fischer, G. S., Taylor, R. H., DiMaio, S. P. (2014): An open-source research kit for the da Vinci® Surgical System. In 2014 IEEE international conference on robotics and automation (ICRA) (pp. 6434–6439). Kazanzides, P., Chen, Z., Deguet, A., Fischer, G. S., Taylor, R. H., DiMaio, S. P. (2014): An open-source research kit for the da Vinci® Surgical System. In 2014 IEEE international conference on robotics and automation (ICRA) (pp. 6434–6439).
45.
go back to reference Kelly, R., Santibáñez Davila, V., Loría Perez, J.A. (2005): Control of robot manipulators in joint space. Springer-Verlag London Limited. Kelly, R., Santibáñez Davila, V., Loría Perez, J.A. (2005): Control of robot manipulators in joint space. Springer-Verlag London Limited.
48.
go back to reference Kraetzschmar, G., Hochgeschwender, N., Nowak, W., Hegger, F., Schneider, S., Dwiputra, R., Berghofer, J., Bischoff, R. (2015): RoboCup@Work: competing for the factory of the future. In RoboCup 2014: Robot World Cup XVIII. Lecture notes in computer science (Vol. 8992, pp. 171–182). https://doi.org/10.1007/978-3-319-18615-3-14. CrossRef Kraetzschmar, G., Hochgeschwender, N., Nowak, W., Hegger, F., Schneider, S., Dwiputra, R., Berghofer, J., Bischoff, R. (2015): RoboCup@Work: competing for the factory of the future. In RoboCup 2014: Robot World Cup XVIII. Lecture notes in computer science (Vol. 8992, pp. 171–182). https://​doi.​org/​10.​1007/​978-3-319-18615-3-14. CrossRef
49.
go back to reference Latombe, J. C. (1991): Robot motion planning (Vol. 2). New York: Springer. MATH Latombe, J. C. (1991): Robot motion planning (Vol. 2). New York: Springer. MATH
50.
go back to reference Lee, D., Lu, Y., Kang, T., Choi, I., Lim, M. (2012): 3D vision based local obstacle avoidance method for humanoid robot. In 2012 12th international conference on control, automation and systems (pp. 473–475). Lee, D., Lu, Y., Kang, T., Choi, I., Lim, M. (2012): 3D vision based local obstacle avoidance method for humanoid robot. In 2012 12th international conference on control, automation and systems (pp. 473–475).
52.
go back to reference Lynch, K., Park, F. (2017): Modern robotics: mechanics, planning, and control. Cambridge: Cambridge University Press. Lynch, K., Park, F. (2017): Modern robotics: mechanics, planning, and control. Cambridge: Cambridge University Press.
53.
go back to reference Maiolino, P., Galantini, F., Mastrogiovanni, F., Gallone, G., Cannata, G., Carpi, F. (2015): Soft dieelectrics for capacitive sensing in robot skins: performance of different elastomer types. Sens. Actuators A, Phys., 226, 37–47. Maiolino, P., Galantini, F., Mastrogiovanni, F., Gallone, G., Cannata, G., Carpi, F. (2015): Soft dieelectrics for capacitive sensing in robot skins: performance of different elastomer types. Sens. Actuators A, Phys., 226, 37–47.
54.
go back to reference Makhal, A., Goins, A. K. (2017): Reuleaux: Robot Base Placement by Reachability Analysis. ArXiv e-prints. Makhal, A., Goins, A. K. (2017): Reuleaux: Robot Base Placement by Reachability Analysis. ArXiv e-prints.
55.
go back to reference Mastrogiovanni, F., Natale, L., Cannata, G., Metta, G. (2015): Editorial for the special issue on advances in tactile sensing and tactile-based human-robot interaction. Robot. Auton. Syst., 63, 227–308. Mastrogiovanni, F., Natale, L., Cannata, G., Metta, G. (2015): Editorial for the special issue on advances in tactile sensing and tactile-based human-robot interaction. Robot. Auton. Syst., 63, 227–308.
56.
go back to reference Matthias, B., Reisinger, T. (2016): Example application of iso/ts 15066 to a collaborative assembly scenario. In Proceedings of ISR 2016: 47st international symposium on robotics (pp. 1–5). Matthias, B., Reisinger, T. (2016): Example application of iso/ts 15066 to a collaborative assembly scenario. In Proceedings of ISR 2016: 47st international symposium on robotics (pp. 1–5).
57.
go back to reference Merhof, W. (2015): Fahrmechanik der Kettenfahrzeuge. Alsbach/Bergstr.: Leuchtturm-Verl. Merhof, W. (2015): Fahrmechanik der Kettenfahrzeuge. Alsbach/Bergstr.: Leuchtturm-Verl.
58.
go back to reference Michael, K., Michael, M. G. (2014): The packbots are coming: boosting security at the 2014 FIFA World Cup. IEEE Consum. Electron. Mag., 3(3), 59–61. Michael, K., Michael, M. G. (2014): The packbots are coming: boosting security at the 2014 FIFA World Cup. IEEE Consum. Electron. Mag., 3(3), 59–61.
59.
go back to reference Moradi, H., Kawamura, K., Prassler, E., Muscato, G., Fiorini, P., Sato, T., Rusu, R. (2013): Service robotics (the rise and bloom of service robots) [tc spotlight]. IEEE Robot. Autom. Mag., 20(3), 22–24. Moradi, H., Kawamura, K., Prassler, E., Muscato, G., Fiorini, P., Sato, T., Rusu, R. (2013): Service robotics (the rise and bloom of service robots) [tc spotlight]. IEEE Robot. Autom. Mag., 20(3), 22–24.
61.
go back to reference Mur-Artal, R., Tardós, J. D. (2017): ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans. Robot., 33(5), 1255–1262. Mur-Artal, R., Tardós, J. D. (2017): ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans. Robot., 33(5), 1255–1262.
63.
go back to reference Ohno, K., Morimura, S., Tadokoro, S., Koyanagi, E., Yoshida, T. (2007): Semi-autonomous control of 6-dof crawler robot having flippers for getting over unknown-steps. In 2007 IEEE/RSJ international conference on intelligent robots and systems (pp. 2559–2560). Ohno, K., Morimura, S., Tadokoro, S., Koyanagi, E., Yoshida, T. (2007): Semi-autonomous control of 6-dof crawler robot having flippers for getting over unknown-steps. In 2007 IEEE/RSJ international conference on intelligent robots and systems (pp. 2559–2560).
64.
go back to reference Okada, Y., Nagatani, K., Yoshida, K. (2009): Semi-autonomous operation of tracked vehicles on rough terrain using autonomous control of active flippers. In 2009 IEEE/RSJ international conference on intelligent robots and systems (pp. 2815–2820). Okada, Y., Nagatani, K., Yoshida, K. (2009): Semi-autonomous operation of tracked vehicles on rough terrain using autonomous control of active flippers. In 2009 IEEE/RSJ international conference on intelligent robots and systems (pp. 2815–2820).
65.
go back to reference Pellenz, J., Dillenberger, D., Steinbauer, G. (2016): Novel rule set for the robocup rescue robot league. In 2016 IEEE international symposium on safety, security, and rescue robotics (SSRR) (pp. 282–283). Pellenz, J., Dillenberger, D., Steinbauer, G. (2016): Novel rule set for the robocup rescue robot league. In 2016 IEEE international symposium on safety, security, and rescue robotics (SSRR) (pp. 282–283).
68.
go back to reference Quender, S., Sereinig, M., Werth, W. (2015): Entwicklung eines Greifarms für eine mobile Roboterplattform. Tech. rep., Konferenz der Mechatronik-Plattform. Quender, S., Sereinig, M., Werth, W. (2015): Entwicklung eines Greifarms für eine mobile Roboterplattform. Tech. rep., Konferenz der Mechatronik-Plattform.
69.
go back to reference Quendler, S. (2015): Methods for calculating the inverse kinematics of a 6-dof robot manipulation arm. Master thesis, Carinthia University of Applied Sciences. Quendler, S. (2015): Methods for calculating the inverse kinematics of a 6-dof robot manipulation arm. Master thesis, Carinthia University of Applied Sciences.
70.
go back to reference Quigley, M., Batra, S., Gould, S., Klingbeil, E., Le, Q., Wellman, A., Ng, A. Y. (2009): High-accuracy 3d sensing for mobile manipulation: improving object detection and door opening. In 2009 IEEE international conference on robotics and automation (pp. 2816–2822). Quigley, M., Batra, S., Gould, S., Klingbeil, E., Le, Q., Wellman, A., Ng, A. Y. (2009): High-accuracy 3d sensing for mobile manipulation: improving object detection and door opening. In 2009 IEEE international conference on robotics and automation (pp. 2816–2822).
78.
go back to reference Stetco, C., Mühlbacher-Karrer, S., Lucchi, M., Weyrer, M., Faller, L. M., Zangl, H. (2020): Gesture-based contactless control of mobile manipulators using capacitive sensing. In 2020 IEEE international conference on instrumentation and measurement (I2MTC). Stetco, C., Mühlbacher-Karrer, S., Lucchi, M., Weyrer, M., Faller, L. M., Zangl, H. (2020): Gesture-based contactless control of mobile manipulators using capacitive sensing. In 2020 IEEE international conference on instrumentation and measurement (I2MTC).
80.
go back to reference Svarny, P., Straka, Z., Hoffmann, M. (2018): Toward safe separation distance monitoring from RGB-D sensors in human-robot interaction. arXiv:1810.04953 [cs]. Svarny, P., Straka, Z., Hoffmann, M. (2018): Toward safe separation distance monitoring from RGB-D sensors in human-robot interaction. arXiv:​1810.​04953 [cs].
83.
go back to reference Tzafestas, S. (2014): Introduction to mobile robot control. Amsterdam: Elsevier. Tzafestas, S. (2014): Introduction to mobile robot control. Amsterdam: Elsevier.
84.
go back to reference Tzafestas, S. (2018): Mobile robot control and navigation: a global overview. J. Intell. Robot. Syst., 91, 35–58. Tzafestas, S. (2018): Mobile robot control and navigation: a global overview. J. Intell. Robot. Syst., 91, 35–58.
85.
go back to reference Vergara, C., Borghesan, G., Aertbelien, E., De Schutter, J. (2018): Incorporating artificial skin signals in the constraint-based reactive control of human-robot collaborative manipulation tasks. In 2018 3rd international conference on advanced robotics and mechatronics (ICARM) (pp. 280–287). https://doi.org/10.1109/ICARM.2018.8610697. CrossRef Vergara, C., Borghesan, G., Aertbelien, E., De Schutter, J. (2018): Incorporating artificial skin signals in the constraint-based reactive control of human-robot collaborative manipulation tasks. In 2018 3rd international conference on advanced robotics and mechatronics (ICARM) (pp. 280–287). https://​doi.​org/​10.​1109/​ICARM.​2018.​8610697. CrossRef
87.
go back to reference Wang, L. T., Chen, C. C. (1991): A combined optimization method for solving the inverse kinematics problems of mechanical manipulators. IEEE Trans. Robot. Autom., 7(4), 489–499. Wang, L. T., Chen, C. C. (1991): A combined optimization method for solving the inverse kinematics problems of mechanical manipulators. IEEE Trans. Robot. Autom., 7(4), 489–499.
90.
go back to reference Weitschat, R., Vogel, J., Lantermann, S., Höppner, H. (2017): End-effector airbags to accelerate human-robot collaboration. In 2017 IEEE international conference on robotics and automation (ICRA) (pp. 2279–2284). Weitschat, R., Vogel, J., Lantermann, S., Höppner, H. (2017): End-effector airbags to accelerate human-robot collaboration. In 2017 IEEE international conference on robotics and automation (ICRA) (pp. 2279–2284).
91.
go back to reference Wen-Hong Zhu, Z. B., Schutter, J. D. (1998): Adaptive motion/force control of multiple manipulators with joint flexibility based on virtual decomposition. IEEE Trans. Autom. Control, 43(1), 46–60. MathSciNetMATH Wen-Hong Zhu, Z. B., Schutter, J. D. (1998): Adaptive motion/force control of multiple manipulators with joint flexibility based on virtual decomposition. IEEE Trans. Autom. Control, 43(1), 46–60. MathSciNetMATH
93.
go back to reference Williams, T., Briggs, P., Pelz, N., Scheutz, M. (2014): Is robot telepathy acceptable? Investigating effects of nonverbal robot-robot communication on human-robot interaction. In The 23rd IEEE international symposium on robot and human interactive communication (pp. 886–891). Williams, T., Briggs, P., Pelz, N., Scheutz, M. (2014): Is robot telepathy acceptable? Investigating effects of nonverbal robot-robot communication on human-robot interaction. In The 23rd IEEE international symposium on robot and human interactive communication (pp. 886–891).
94.
go back to reference Wu, R., Zhou, C., Chao, F., Zhu, Z., Lin, C. M., Yang, L. (2017): A developmental learning approach of mobile manipulator via playing. Front Neurorobot., 11, 53. Wu, R., Zhou, C., Chao, F., Zhu, Z., Lin, C. M., Yang, L. (2017): A developmental learning approach of mobile manipulator via playing. Front Neurorobot., 11, 53.
95.
go back to reference Xuexi, Z., Yuming, A., Genping, F., Guokun, L., Shiliu, L. (2019): Survey on key technology of robocup rescue robot. In 2019 Chinese control conference (CCC) (pp. 4746–4750). Xuexi, Z., Yuming, A., Genping, F., Guokun, L., Shiliu, L. (2019): Survey on key technology of robocup rescue robot. In 2019 Chinese control conference (CCC) (pp. 4746–4750).
98.
go back to reference Yoshikawa, T. (1985): Manipulability of robotic mechanisms. Int. J. Robot. Res., 4(2), 3–9. MathSciNet Yoshikawa, T. (1985): Manipulability of robotic mechanisms. Int. J. Robot. Res., 4(2), 3–9. MathSciNet
99.
100.
go back to reference Zlajpah, L., Petric, T. (2012): Obstacle avoidance for redundant manipulators as control problem. In Serial and parallel robot manipulators – kinematics, dynamics, control and optimization (pp. 203–230). Zlajpah, L., Petric, T. (2012): Obstacle avoidance for redundant manipulators as control problem. In Serial and parallel robot manipulators – kinematics, dynamics, control and optimization (pp. 203–230).
Metadata
Title
A review of the challenges in mobile manipulation: systems design and RoboCup challenges
Recent developments with a special focus on the RoboCup
Authors
Martin Sereinig
Wolfgang Werth
Lisa-Marie Faller
Publication date
03-09-2020
Publisher
Springer Vienna
Published in
e+i Elektrotechnik und Informationstechnik / Issue 6/2020
Print ISSN: 0932-383X
Electronic ISSN: 1613-7620
DOI
https://doi.org/10.1007/s00502-020-00823-8

Other articles of this Issue 6/2020

e & i Elektrotechnik und Informationstechnik 6/2020 Go to the issue