Near Optimization of Stochastic Dynamic Systems by Decomposition and Aggregation

Abstract:  The paper is concerned with the reduction of a class of stochastic optimal control problems to simpler problems by using decomposition and aggregation.  Decomposition is shown to provide a good approximation when the system dynamics involve a nearly decomposable matrices or variables with strong and weak interactions.  Aggregation provides a good approximation if each of the decomposed matrix has one or more dominant eigenvalues.  It is shown how one can construct nearly optimal controls for the given system from the optimal solutions of the simpler reduced problems.  The results extend the corresponding results obtained (Sethi and Zhang, Journal of optimization theory and applications 1998: 99:1-22) in a deterministic environment.  The results hold a significant promise in dealing with large dynamic stochastic macroeconomic problems.