Implementation of modified Q learning technique in EMCAP control architecture

  • Authors

    • D. Ganesha
    • Vijayakumar Maragal Venkatamuni
    2017-12-31
    https://doi.org/10.14419/ijet.v7i1.5.9160
  • Self learning, Cognitive Control, Q Learning.
  • This research introduces a self learning modified (Q-Learning) techniques in a EMCAP (Enhanced Mind Cognitive Architecture of pupils). Q-learning is a modelless reinforcement learning (RL) methodology technique. In Specific, Q-learning can be applied to establish an optimal action-selection strategy for any respective Markov decision process. In this research introduces the modified Q-learning in a EMCAP (Enhanced Mind Cognitive Architecture of pupils). EMCAP architecture [1] enables and presents various agent control strategies for static and dynamic environment.  Experiment are conducted to evaluate the performace for each agent individually. For result comparison among different agent, the same statistics were collected. This work considered varied kind of agents in different level of architecture for experiment analysis. The Fungus world testbed has been considered for experiment which is has been implemented using SwI-Prolog 5.4.6. The fixed obstructs tend to be more versatile, to make a location that is specific to Fungus world testbed environment. The various parameters are introduced in an environment to test a agent’s performance.his modified q learning algorithm can be more suitable in EMCAP architecture.  The experiments are conducted the modified Q-Learning system gets more rewards compare to existing Q-learning.

  • References

    1. [1] D. Ganesha , Vijayakumar Maragal Venkatamuni “Design and development of hybrid Architecture model named Enhanced Mind Cognitive Architecture of pupils for implementing the learning concepts in Society of Agents†* Indian Journal of Science and Technology, Vol 10

      [2] A. Sánchez Boza, R. H. Guerra, and A. Gajate, "Artificial cognitive control system based on the shared circuits model of sociocognitive capacities. A first approach," Engineering Applications of Artificial Intelligence, vol. 24, pp. 209-219, 2011.

      [3] Q. Hu, Sh. Jie, and D. Yu, "Application of Fuzzy Self-learning Sliding Mode Variable Structure Control in Linear AC Servo System," IEEE Power Electronics and Motion Control Conference (IPEMC 2006), vol.3, pp.1-5, 14-16 August 2006.

      [4] Tamayo-Torres, L. Gutierrez-Gutierrez, and A. Ruiz-Moreno, "The relationship between exploration and exploitation strategies, manufacturing flexibility and organizational learning: An empirical comparison between Non-ISO and ISO certified firms," European Journal of Operational Research, vol. 232, pp. 72-86, 2014.

      [5] L. M. Hercog, "Better manufacturing process organization using multi-agent self-organization and co-evolutionary classifier systems: The multibar problem," Applied Soft Computing, vol. 13, pp. 1407-1418, 2013.

      [6] Z.-P. Su, J.-G. Jiang, C.-Y. Liang, and G.-F. Zhang, "Path selection in disaster response management based on Q-learning," Int. J. Autom. Comput., vol. 8, pp. 100-106, 2011.

      [7] K. Lakshmanan and S. Bhatnagar, "A novel Q-learning algorithm with function approximation for constrained Markov decision processes," Communication, Control, and Computing (Allerton), pp.400-405, 1-5 October 2012.

      [8] A. Hariri and O. P. Malik, "22 - Self-Learning Knowledge Systems and Fuzzy Systems and Their Applications," in Knowledge-Based Systems, C. T. Leondes, Ed., ed San Diego: Academic Press, 2000, pp. 675-707.

      [9] Ganesha D*,Dr. Vijayakumar Maragal Venkatamuniâ€Application Of Reinforcement Learning Methodologies In Society Of Mind Cogntive Architecture†International Journal of Advances in Engineering & Scientific Research (IJAESR) ISSN: 2349 –3607 (Online) , ISSN: 2349 –4824

      [10] T. Padmapriya and V. Saminadan, “Distributed Load Balancing for Multiuser Multi-class Traffic in MIMO LTE-Advanced Networksâ€, Research Journal of Applied Sciences, Engineering and Technology (RJASET) - Maxwell Scientific Organization , ISSN: 2040-7459; e-ISSN: 2040-7467, vol.12, no.8, pp:813-822, April 2016.

      [11] S.V.Manikanthan and D.Sugandhi “ Interference Alignment Techniques For Mimo Multicell Based On Relay Interference Broadcast Channel †International Journal of Emerging Technology in Computer Science & Electronics (IJETCSE) ISSN: 0976-1353 Volume- 7 ,Issue 1 –MARCH 2014.

      Rajesh, M., and J. M. Gnanasekar. "GCCover Heterogeneous Wireless Ad hoc Networks."Journal of Chemical and Pharmaceutical Sciences (2015): 195-200.
  • Downloads

  • How to Cite

    Ganesha, D., & Venkatamuni, V. M. (2017). Implementation of modified Q learning technique in EMCAP control architecture. International Journal of Engineering & Technology, 7(1.5), 269-273. https://doi.org/10.14419/ijet.v7i1.5.9160