Markov Decision Processes

CSC 261 - Artificial Intelligence - Weinman



Answer the following questions. Record your answers in your Reading Journal.
  1. In your own words, briefly describe the difference between R(s) and U(s).
  2. In your own words, describe the
    1. meaning, and
    2. motivation
    of Equation (17.5). Be sure to refer to individual terms in the equation.
  3. Select the sentence from today's reading that you feel best distinguishes between value iteration and policy iteration. Briefly (3-5 sentences) explain your selection.