Adaptive control in the face of uncertainty involves making online predictions about events in order to plan actions to reliably achieve desirable outcomes. However, we often face situations in which the effects of our actions are...
moreAdaptive control in the face of uncertainty involves making online predictions about events in order to plan actions to reliably achieve desirable outcomes. However, we often face situations in which the effects of our actions are probabilistic (e.g., returns on our investments), and the environment itself is dynamic, - it can change irrespective of any action we decide to take, and in a relatively stable or unstable way (e.g., economic climate). Therefore, the problem of control concerns learning to isolate the effects that are generated directly by our actions, from those that occur independently of them. We face this problem in a host of uncertain dynamic environments: ecological (using fertilizers to increase crop yield), economic (investing in real estate), industrial (operating nuclear power plants), mechanical (driving cars) and medical (stemming outbreaks of disease). Thus far there has been little attempt at a synthesis of the amassing research directed towards understanding control in the face of uncertainty. The aim of this book is to bring together theoretical and empirical research from disparate disciplines spanning Social, Cognitive and Clinical Psychology, Human Factors and Neuroscience to Engineering and Machine learning. It serves as a round up of the different techniques used to examine issues concerning control (prediction, agency, causality, uncertainty) and unifies a substantial amount of disparate research. The general framework (Monitoring and control- MC framework) used to achieve this proposes two central ideas (agency, uncertainty) that have important ramifications across disciplines. In sum, control processes involve self-regulatory mechanisms that enable us to make subjective estimates of success, which helps to anchor our interpretation of uncertain events. In addition, these estimates are integrated with estimations of rates of change of the events in the environment which helps us track the outcomes we aim to control.