Abstract
Case-based planning (CBP) systems are based on the idea of reusing past successful plans for solving new problems. Previous research has shown the ability of meta-reasoning approaches to improve the performance of CBP systems. In this paper we present a new meta-reasoning approach for autonomously improving the performance of CBP systems that operate in real-time domains. Our approach uses failure patterns to detect anomalous behaviors, and it can learn from experience which of the failures detected are important enough to be fixed. Finally, our meta-reasoning approach can exploit both successful and failed executions for meta-reasoning. We illustrate its benefits with experimental results from a system implementing our approach called Meta-Darmok in a real-time strategy game. The evaluation of Meta-Darmok shows that the system successfully adapts itself and its performance improves through appropriate revision of the case base.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Anderson, M.L., Oates, T.: A review of recent research in metareasoning and metalearning. AI Magazine 28, 7–16 (2007)
Arcos, J.L.: T-air: A case-based reasoning system for designing chemical absorption plants. In: Aha, D.W., Watson, I. (eds.) ICCBR 2001. LNCS, vol. 2080, pp. 576–588. Springer, Heidelberg (2001)
Carbonell, J.G., Knoblock, A.C., Minton, S.: Prodigy: An Integrated Architecture for Planning and Learning. Lawrence Erlbaum Associates, Mahwah
Cazenave, T.: Metarules to improve tactical go knowledge. Inf. Sci. Inf. Comput. Sci. 154(3-4), 173–188 (2003)
Cox, M.T., Ram, A.: Failure-driven learning as input bias. In: Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society, pp. 231–236 (1994)
Cox, M.T.: Metacognition in computation: a selected research review. Artif. Intell. 169(2), 104–141 (2005)
Cox, M.T., Ram, A.: Introspective multistrategy learning: On the construction of learning strategies. Technical report (1996)
Fox, S., Leake, D.: Introspective reasoning for index refinement in case-based reasoning. Journal of Experimental and Theoretical Artificial Intelligence 13, 63–88 (2001)
Hammond, K.J.: Learning to anticipate and avoid planning problems through the explanation of failures. In: Proceedings of the Fifth National Conference on Artificial Intelligence, pp. 556–560 (1986)
Kolodner, J.L.: Capitalizing on failure through case-based inference. In: Proceedings of the Ninth Annual Conference of the Cognitive Science Society, pp. 715–726 (1987)
Leake, D.B., Kinley, A., Wilson, D.: Learning to improve case adaptation by introspective reasoning and CBR. In: Aamodt, A., Veloso, M.M. (eds.) ICCBR 1995, vol. 1010, pp. 229–240. Springer, Heidelberg (1995)
Nau, D., Au, T.C., Ilghami, O., Kuter, U., Wu, D., Yaman, F., Muñoz-Avila, H., Murdock, J.W.: Applications of shop and shop2. Intelligent Systems 20(2), 34–41 (2005)
Ontañón, S., Mishra, K., Sugandh, N., Ram, A.: Case-based planning and execution for real-time strategy games. In: Weber, R.O., Richter, M.M. (eds.) ICCBR 2007. LNCS, vol. 4626, pp. 164–178. Springer, Heidelberg (2007)
Ontañón, S., Mishra, K., Sugandh, N., Ram, A.: On-line case-based planning. Computational Intelligence (to appear)
Schank, R.C.: Dynamic memory: A theory of reminding and learning in computers and people. Cambridge University Press, Cambridge (1982)
Stroulia, E., Goel, A.K.: Functional representation and reasoning in reflective systems. Journal of Applied Intelligence 9, 101–124 (1995)
Sussman, J.G.: A Computational Model of Skill Acquisition. American Elsevier, Amsterdam (1975)
Ulam, P., Jones, J., Goel, A.K.: Combining model-based meta-reasoning and reinforcement learning for adapting game-playing agents. In: AIIDE (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mehta, M., Ontañón, S., Ram, A. (2009). Using Meta-reasoning to Improve the Performance of Case-Based Planning. In: McGinty, L., Wilson, D.C. (eds) Case-Based Reasoning Research and Development. ICCBR 2009. Lecture Notes in Computer Science(), vol 5650. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02998-1_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-02998-1_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02997-4
Online ISBN: 978-3-642-02998-1
eBook Packages: Computer ScienceComputer Science (R0)