We compared temporal and probability discounting of a nonconsumable reward (money) and three directly consumable rewards (candy, soda, and beer). When rewards were delayed, monetary rewards were discounted less steeply than directly consumable rewards, all three of which were discounted at equivalent rates. When rewards were probabilistic, however, there was no difference between the discountin...

Previous theoretical studies of animal and human behavioral learning have focused on the dichotomy of the value-based strategy using action value functions to predict rewards and the model-based strategy using internal models to predict environmental states. However, animals and humans often take simple procedural behaviors, such as the "win-stay, lose-switch" strategy without explicit predicti...