Markov Decision Processes

CSC 261 - Artificial Intelligence - Weinman



Answer the following questions. Record your answers in your Reading Journal.
  1. In your own words, briefly describe the difference between R(s) and U(s).
  2. In your own words, describe both the meaning and motivation of Equation (17.5). Be sure to refer to individual terms in the equation.
  3. Select the sentence from today's reading that you find best distinguishes value iteration and policy iteration. Briefly (3-5 sentences) explain your selection.