State value function (V-function)

expected \gls{DEF_return} when starting from state $\mathbf{x}$ at time $t$, and then following policy \gls{policy}