Using Emotional Learning in Rescue Simulation Environment

Authors: Maziar Ahmad Sharbafi, Caro Lucas, Abolfazel Toroghi Haghighat, Omid AmirGhiasvand, Omid Aghazade

Abstract:

RoboCup Rescue simulation as a large-scale Multi agent system (MAS) is one of the challenging environments for keeping coordination between agents to achieve the objectives despite sensing and communication limitations. The dynamicity of the environment and intensive dependency between actions of different kinds of agents make the problem more complex. This point encouraged us to use learning-based methods to adapt our decision making to different situations. Our approach is utilizing reinforcement leaning. Using learning in rescue simulation is one of the current ways which has been the subject of several researches in recent years. In this paper we present an innovative learning method implemented for Police Force (PF) Agent. This method can cope with the main difficulties that exist in other learning approaches. Different methods used in the literature have been examined. Their drawbacks and possible improvements have led us to the method proposed in this paper which is fast and accurate. The Brain Emotional Learning Based Intelligent Controller (BELBIC) is our solution for learning in this environment. BELBIC is a physiologically motivated approach based on a computational model of amygdale and limbic system. The paper presents the results obtained by the proposed approach, showing the power of BELBIC as a decision making tool in complex and dynamic situation.

Keywords: Emotional learning, rescue, simulation environment, RoboCup, multi-agent system.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1073213

References:

[1] J.Habibi, M.Ahmadi, A.Nouri, M.Sayyadian, M.Nevisi, Utilizing Defferent Multiagent Methods in RobocupRescue Simulation, Robocup2003, 2003.
[2] Kitano, et al.: RoboCup-Rescue: Search and Rescue in Large Scale Disasters as a Domain for Autonomous Agents Research, IEEE Conf on Man, Systems, and Cybernetics (1999).
[3] Robocup-Rescue Simulation Manual, The Robocup Rescue Technical Committee, 2000.
[4] Michael Wooldridge, Nicholas R. Jennings, "Intelligent Agents: Theory and Practice", The Knowledge Engineering Review, 10:115-152 1995.
[5] Alan H. Bond and Les Gasser. An analysis of problems and research in DAI. In Alan H. Bond and Les Gasser, editors, Readings in Distributed Artificial Intelligence, pages 3-35.Morgan Kaufmann Publishers, San Mateo, CA, 1988.
[6] Peter Stone_ Manuela Veloso, "Multiagent Systems: A Survey from a Machine Learning Perspective", In Autonomous Robotics volume 8, number 3. July, 2000.
[7] R. M. Milasi, C. Lucas, and B. N. Araabi. Speed Control of an Interior Permanent Magnet Synchronous Motor Using BELBIC (Brain Emotional Learning Based Intelligent Controller). In M. Jamshidi, L. Foulloy, A. Elkamel, and J. S. Jamshidi (eds.), Intelligent Automations and Control- Trends, Principles, and Applications. Albuquerque, NM, USA: TSI Press Series: Proceedings of WAC, 16, M. Jamshidi (series editor), 2004. 280- 286.
[8] R. Mohammadi Milasi, C. Lucas, and B. N. Araabi. A Novel Controller for a Power System Based BELBIC (Brain Emotional Learning Based Intelligent Controller). In M. Jamshidi, L. Foulloy, A. Elkamel, and J. S. Jamshidi (eds.), Intelligent Automations and Control- Trends, Principles, and Applications. Albuquerque, NM, USA: TSI Press Series: Proceedings of WAC, 16, M. Jamshidi (series editor), 2004. 409- 420.
[9] G. Zandesh, J. Moghani, C. Lucas, D. Shahmirzadi, B.N. Araabi O. Namaki, H. Kord. Speed Control of a Switched Reluctance Motor Using BELBIC. WSEAS Transactions on Systems, 3(1), January 2004, 1-7.
[10] J. Moren, C. Balkenius. A Computational Model of Emotional Learning in The Amygdala: From animals to animals. in Proc. 6th International conference on the simulation of adaptive behavior, Cambridge, Mass., The MIT Press, 2000.
[11] C. Lucas, D. Shahmirzadi, N. Sheikholeslami. Introducing BELBIC: Brain Emotional Learning Based Intelligent Controller. International Journal of Intelligent Automation and Soft Computing, Vol. 10, No. 1, 2004, pp. 11-22.
[12] M. Fatourechi, C. Lucas, A. Khaki Sedigh. Emotional Learning as a New Tool for Development of Agent based System. Informatica, 27(2), June 2003, 137-144.