A Version of the Euler Equation in Discounted Markov Decision Processes

This paper deals with Markov decision processes (MDPs) on Euclidean spaces with an infinite horizon. An approach to study this kind of MDPs is using the dynamic programming technique (DP). Then the optimal value function is characterized through the value iteration functions. The paper provides cond...

Full description

Bibliographic Details
Main Authors: H. Cruz-Suárez, G. Zacarías-Espinoza, V. Vázquez-Guevara
Format: Article
Language:English
Published: Hindawi Limited 2012-01-01
Series:Journal of Applied Mathematics
Online Access:http://dx.doi.org/10.1155/2012/103698