%0 Journal Article %A Carlos V. Regueiro and Jose E. Domenech and Roberto Iglesias and Jose L. Correa %D 2008 %J International Journal of Mechanical and Materials Engineering %B World Academy of Science, Engineering and Technology %I Open Science Index 22, 2008 %T Acquiring Contour Following Behaviour in Robotics through Q-Learning and Image-based States %U https://publications.waset.org/pdf/10811 %V 22 %X In this work a visual and reactive contour following behaviour is learned by reinforcement. With artificial vision the environment is perceived in 3D, and it is possible to avoid obstacles that are invisible to other sensors that are more common in mobile robotics. Reinforcement learning reduces the need for intervention in behaviour design, and simplifies its adjustment to the environment, the robot and the task. In order to facilitate its generalisation to other behaviours and to reduce the role of the designer, we propose a regular image-based codification of states. Even though this is much more difficult, our implementation converges and is robust. Results are presented with a Pioneer 2 AT on a Gazebo 3D simulator. %P 3452 - 3457