9See e.g. (Sutton and Barto, 2018, Ch. 2); for neuroscience results, (Costa and Averbeck, 2020). Similar randomness may even be useful in the motor system, where it is often, perhaps erroneously, considered unwanted noise (Dhawale et al., 2017).