RL Competition 2009

News

Slides from the workshop presentations are now available.

Results are now available. Congratulations to our winners.

Testing round closed. Thank you to all of our competitors!

Updated Testing application (R15) is now available HERE.

Proving application is now available HERE.

The rules, schedule, and prizes have been announced.

GAME ON! The software is now available.

Stay Informed

Sign up for our mailing list to receive important announcements about the competition.

Organizers

The senior organizing committee of the 2009 RL Competition is composed of experienced researchers in the field of reinforcement learning. The organizers also have experience organizing previous workshops (for example, the 2006 NIPS Workshop on Grounding Perception, Knowledge and Cognition in Sensori-Motor Experience, the ALA workshop at AAMAS-09 and the 2008 RL Competition Workshop at ICML 2008). The general chair is David Wingate, a postdoc at MIT.

The technical committee is a seasoned group of capable programmers, composed of previous competitors and compe- tition chairs. Each technical committee member owns one of the six domains, and is charged with development of the domain (parameterizations), integration of the domain with the RL-Glue 3.0 framework, and maintenance / debugging of the domain.

The competition organizers are:

  • General chair: David Wingate (MIT)
    David Wingate is a postdoctoral research associate in the Computational Cognitive Science Group at MIT working with Josh Tenenbaum. His research interests lie at the intersection of perception, control and cog- nition, how all three have synergistic effects on learning. Specific interests include reinforcement learning, unsupervised learning of useful knowledge representations (including predictive representations of state and structured nonparametric Bayesian distributions), information theory, manifold learning, kernel meth- ods, massively parallel processing, visual perception, and optimal control. David holds a Ph.D. from the University Michigan and M.S. and B.S. degrees in Computer Science from BYU.
  • Technical chair: Carlos Diuk (Rutgers)
    Carlos Diuk is a senior graduate student working with Michael Littman at the Rutgers Laboratory for Real- Life Reinforcement Learning (RL)3, after obtaining his MSc degree from the University of Buenos Aires. His interests include transfer learning (how can an agent "transfer" knowledge obtained while performing a previous task into a new and -somewhat- similar task?) and efficient reinforcement learning (explor- ing how factored state spaces, hierarchies, object-oriented representations and model-based frameworks can be combined to achieve efficient learning). He is an active participant in the reinforcement learning community, having reviewed for numerous conferences and journals.
  • Funding: Lihong Li (Rutgers)
    Lihong Li is a PhD candidate at the Rutgers University working with Prof. Michael Littman. Before that, he obtained a MSc degree from the University of Alberta in 2004, and BE from the Tsinghua Uni- versity in 2002. His main interests are in reinforcement learning and machine learning, including: ex- ploration/exploitation tradeoff, value function approximation, feature selection and discovery in reinforce- ment learning, online learning, computational learning theory, and decision-theoretic planning. He is a co-winner of an ICML’08 Best Student Paper Award, and has reviewed (or will review) for several leading conferences (AAAI, ECML, ICML, IJCAI, and NIPS) and journals (DMKD, JAIR, JMLR, and MLJ).
  • Website: Jordan Frank (McGill)
    Jordan Frank is a PhD student at McGill University in Montreal, Canada. Jordan works with Profs. Doina Precup and Shie Mannor in the Reasoning and Learning Lab, and his research area is human behavior modeling and reinforcement learning.
  • Publicity: Matt Taylor (USC)
    Matthew E. Taylor is a postdoctoral research associate at the University of Southern California, funded by Milind Tambe. He graduated magna cum laude with a double major in computer science and physics from Amherst College in 2001. After working for two years as a software developer, he began his Ph.D. after being awarded the College of Natural Sciences’ MCD fellowship. He received his doctorate from the Department of Computer Sciences at the University of Texas at Austin in the summer of 2008. Current research interests include multi-agent systems, reinforcement learning, and transfer learning.
  • Senior technical advisor: Brian Tanner (University of Alberta)
    Brian Tanner is a provisional Ph.D candidate at the University of Alberta. His research focuses on empirical evaluation and comparison of reinforcement learning algorithms. He served as the chair of the technical committee for the 2008 Reinforcement Learning Competition.
  • Senior advisor: Doina Precup (McGill)

Each member of the technical committee is responsible for a domain. The members of the technical committee are:

  • Brian Tanner - University of Alberta (Polyathlon)
  • Adam White - University of Alberta (Polyathlon)
  • Marc Lanctot - University of Alberta
  • Chris Rayner - University of Alberta (Helicopter)
  • Monica Dinculescu - McGill University (Octopus)
  • Istvan Szita - Rutgers (Tetris)
  • John Asmuth - Rutgers (Mario)
  • José Antonio Martín H. - Universidad Complutense de Madrid (Acrobot)