¹¹For a review on applications of reinforcement learning to modelling animal and human behavior, see Niv (2009). On planning in animals, see Redshaw and Bulley (2018); Corballis (2019).