Extension of the Class of Markov Models

Arkin VI (1984). Extension of the Class of Markov Models. IIASA Collaborative Paper. IIASA, Laxenburg, Austria: CP-84-008

[img]
Preview
Text
CP-84-008.pdf

Download (276kB) | Preview

Abstract

In a recent book, the author proposed a new method of solving stochastic control problems, which, unlike the traditional approach, is not based on dynamic programming techniques. The main features of the new method are the extension of the Markov controls and the use of non-Markov controls which depend on the complete history of the process.

In this extended control domain the optimal control problem becomes a mathematical programming problem in the space of functions and can be studied using convex analysis. The author first generalizes the Markov control extension theorem for problems with constraints which depend on future time, and then obtains a method for finding the optimal control in convex problems through the solution of the auxiliary mathematical programming problem.

Item Type: Monograph (IIASA Collaborative Paper)
Research Programs: System and Decision Sciences - Core (SDS)
Depositing User: IIASA Import
Date Deposited: 15 Jan 2016 01:55
Last Modified: 22 Jul 2016 18:32
URI: http://pure.iiasa.ac.at/2569

Actions (login required)

View Item View Item

International Institute for Applied Systems Analysis (IIASA)
Schlossplatz 1, A-2361 Laxenburg, Austria
Phone: (+43 2236) 807 0 Fax:(+43 2236) 71 313