Consider the shown (3x2) game world that has 6 states A, B, C, D, E, F and four actions (right, left, up, down). In every new episode, the game starts by choosing a random state and ends when state F is reached, for which the player receives a reward of +10. For all other actions that do not lead to state F, the reward is -1. Shown below, Q0 is the Q function after initial training using the Q-learning algorithm.
Q21. Using Q0 as a starting point, what is the updated Q value after taking the action (B, right)?
(a) 3.75
(b) 3.5
(c) 2.75
(d) 2.5
(e) None of the above
Board
$Q_0$ function
right left up down