Abstract
One of the missions of the cognitive process of animals, including humans, is to make reasonable judgments and decisions in the presence of uncertainty. The balance between exploration and exploitation investigated in the reinforcement-learning paradigm is one of the key factors in this process. Recently, following the pioneering work in behavioral economics, growing attention has been directed to human behaviors exhibiting deviations from simple maximization of re-ward. Here we study the nature of human decision making under the existence of reward uncertainty, employing a condition where the reward expectancy is constant (flat reward condition). The characteristic behavioral patterns exhibited by subjects reveal the underlying reward-related neural mechanism. The relevance of this result to the functions of dopamine neurons is discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Graham, G., Neisser, J.: Probing for relevance: what metacognition tells us about the power of consciousness. Conscious Cogn. 9(2 Pt 1), 172–7 (2000)
Griffiths, D., Dickinson, A., Clayton, N.: Episodic memory: what can animals remember about their past? Trends Cogn Sci. 3(2), 74–80 (1999)
Hampton, R.: Resus monkeys know when they remember. PNAS 98(9), 5359–5362 (2001)
Koriat, A.: The feeling of knowing: some metatheoretical implications for consciousness and control. Conscious Cogn. 9(2 Pt 1), 149–71 (2000)
Sutton, R.S., Barto, A.: Reinforcement learning. MIT Press, Cambridge (1998)
Ainsworth, M.: Object relations, dependency, and attachment: a theoretical review of the infant-mother relationship. Child Dev. 40(4), 969–1025 (1969)
Bowlby, J.: Attachment. Perseus Books (1982)
Fiorillo, C.D., Tobler, P.N., Schultz, W.: Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299(5614), 1898–902 (2003)
Schultz, W.: Multiple reward signals in the brain. Nat Rev Neurosci. 1(3), 199–207 (2000)
Schultz, W., Dayan, P., Montague, P.: A neural substrate of prediction and reward. Science 275(5306), 1593–9 (1997)
Shizgal, P., Arvanitogiannis, A.: Neuroscience. Gambling on dopamine. Science 299(5614), 1856–8 (2003)
Kahneman, D., Slovic, P., Tversky, A.: Judgment under uncertainty. Cambridge University Press, Cambridge (1982)
Kahneman, D., Tversky, A.: Choices, Values, and Flames. Cambridge University Press, Cambridge (2000)
Sanfey, A.G., Rilling, J.K., Aronson, J.A., Nystrom, L.E., Cohen, J.D.: The neural basis of economic decision-making in the Ultimatum Game. Science 300(5626), 1755–8 (2003)
Milinski, M., Wedekind, C.: Working memory constraints human cooperation in the prisoner’s dilemma. Proc Natl Acad Sci U S A 95(23), 13755–8 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Onzo, A., Mogi, K. (2004). Cognitive Process of Emotion Under Uncertainty. In: Pal, N.R., Kasabov, N., Mudi, R.K., Pal, S., Parui, S.K. (eds) Neural Information Processing. ICONIP 2004. Lecture Notes in Computer Science, vol 3316. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30499-9_45
Download citation
DOI: https://doi.org/10.1007/978-3-540-30499-9_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23931-4
Online ISBN: 978-3-540-30499-9
eBook Packages: Springer Book Archive