Situated Learning of Visual Robot Behaviors

This paper proposes a new robot learning framework to acquire scenario specific autonomous behaviors by demonstration. We extract visual features from the demonstrated behavior examples in an indoor environment and transfer it onto an underlying set of scenario aware robot behaviors. Demonstrations are performed using an omnidirectional camera as training instances in different indoor scenarios are registered.The features that distinguish the environment are identified and are used to classify the traversing scenarios. Once the scenario is identified, a behavior model trained by means of artificial neural network pertaining to the specific scenario is learned. The generalization ability of the behavior model is evaluated for seen and unseen data. As a comparison, the behaviors attained using a monolithic general purpose model and its generalization ability against the former is evaluated. The experimental results on the mobile robot indicate the acquired behavior is robust and generalizes meaningful actions beyond the specifics presented during training.