TY - JFULL AU - Carlos V. Regueiro and Jose E. Domenech and Roberto Iglesias and Jose L. Correa PY - 2008/11/ TI - Acquiring Contour Following Behaviour in Robotics through Q-Learning and Image-based States T2 - International Journal of Mechanical and Materials Engineering SP - 3451 EP - 3457 VL - 2 SN - 1307-6892 UR - https://publications.waset.org/pdf/10811 PU - World Academy of Science, Engineering and Technology NX - Open Science Index 22, 2008 N2 - In this work a visual and reactive contour following behaviour is learned by reinforcement. With artificial vision the environment is perceived in 3D, and it is possible to avoid obstacles that are invisible to other sensors that are more common in mobile robotics. Reinforcement learning reduces the need for intervention in behaviour design, and simplifies its adjustment to the environment, the robot and the task. In order to facilitate its generalisation to other behaviours and to reduce the role of the designer, we propose a regular image-based codification of states. Even though this is much more difficult, our implementation converges and is robust. Results are presented with a Pioneer 2 AT on a Gazebo 3D simulator. ER -