Making decisions in sequentially structured tasks requires integrating distally acquired information. The extensive computational cost of such integration challenges planning methods that integrate online, at decision time. Furthermore, it remains unclear whether “offline” integration during replay supports planning, and if so which memories should be replayed. Inspired by machine learning, we ...

Backward blocking, unovershadowing, and backward conditioned inhibition are examples of retrospective revaluation phenomena that have been suggested to involve more than simple associative learning. Models of these phenomena have thus used additional concepts, for example, appealing to attentional effects or more elaborate learning mechanisms. The author shows that a suitable representation of ...