|
|
|
|
|
• By Date • By Publication Type • By Research Category • By Author (Currently at CMU) • By Author (Past and Current CORAL Contributors) •
Manuela Veloso, Nicholas Armstrong-Crews, Sonia Chernova, Elisabeth Crawford, Colin McMillen, Maayan Roth and Douglas Vail. A Team of Humanoid Game Commentators. In International Conference on Humanoid Robots, Genoa, Italy, December 2006.
We contribute an approach for interactive policy learning through expert demonstration that allows an agent to actively request and effectively represent demonstration examples. In order to address the inherent uncertainty of human demonstration, we represent the policy as a set of Gaussian mixture models (GMMs), where each model, with multiple Gaussian components, corresponds to a single action. Incrementally received demonstration examples are used as training data for the GMM set. We then introduce our confident execution approach, which focuses learning on relevant parts of the domain by enabling the agent to identify the need for and request demonstrations for specific parts of the state space. The agent selects between demonstration and autonomous execution based on statistical analysis of the uncertainty of the learned Gaussian mixture set. As it achieves proficiency at its task and gains confidence in its actions, the agent operates with increasing autonomy, eliminating the need for unnecessary demonstrations of already acquired behavior, and reducing both the training time and the demonstration workload of the expert. We validate our approach with experiments in simulated and real robot domains.
@inproceedings{Veloso06humanoids,
title="A Team of Humanoid Game Commentators",
author="Manuela Veloso, Nicholas Armstrong-Crews, Sonia Chernova, Elisabeth Crawford, Colin McMillen, Maayan Roth and Douglas Vail",
booktitle="International Conference on Humanoid Robots",
place="Genova, Italy", month="December",
year="2006",
abstract={We contribute an approach for interactive policy learning through expert demonstration that allows an agent to actively request
and effectively represent demonstration examples. In order to address the inherent uncertainty of human demonstration, we represent the
policy as {\it a set of Gaussian mixture models} (GMMs), where each model, with multiple Gaussian components, corresponds to a single action.
Incrementally received demonstration examples are used as training data for the GMM set. We then introduce our {\it confident execution}
approach, which focuses learning on relevant parts of the domain by enabling the agent to identify the need for and request demonstrations for
specific parts of the state space. The agent selects between demonstration and autonomous execution based on statistical analysis of the
uncertainty of the learned Gaussian mixture set. As it achieves proficiency at its task and gains confidence in its actions, the agent
operates with increasing autonomy, eliminating the need for unnecessary demonstrations of already acquired behavior, and reducing both the
training time and the demonstration workload of the expert. We validate our approach with experiments in simulated and real robot domains.},
bib2html_pubtype = {Refereed Conference},
bib2html_rescat = {Robot Perception, Multi-Robot Systems, RoboCup, RoboCup Legged Soccer},
bib2html_dl_pdf = {http://www.cs.cmu.edu/~soniac/files/CMCast.pdf},
}
Generated by bib2html.pl (written by Patrick Riley ) on Tue Oct 09, 2007 00:00:13
|
|
 | |||
| [home] [news] [people] [robosoccer] [projects] [multimedia] [download] [publications] [contact us] | |||