International Federation of Automatic Control
3rd IFAC SYMPOSIUM on SYSTEM, STRUCTURE and CONTROL

Foz do Iguassu, Brazil October 17th - 19th, 2007


Wednesday Evening

Session WE2: Switched and Jump Systems


Chair: José C. Geromel - Brazil
Co-chair: Elena de Santis - Italy
Room: Montevideo
2007-10-17
From 16:00 to 18:00
Control of Markov Jump Linear Systems with State and Input Constraints: a Necessary Optimality Condition
Alessandro N. Vargas; Walter Furloni; João B. R. do Val
Contact: Alessandro do N. Vargas - Brazil
17:20-17:40
Abstract:
This paper presents necessary optimality conditions for the control problem of discrete-time Markov jump linear systems MJLS) with linear feedback gains, subject to constraints on the system state and input control variables. Instead of hard, deterministic constraints, the constraints considered here are given in terms of the first and second moments of the state and input variables, thus adequate to in the stochastic setting. The jumping state of the Markov chain and the continuous part of the MJLS are assumed to be accessible to the controller. The necessary conditions are derived and they are attained numerically by means of a method that iteratively performs a variational search using a set of LMI's. It searches through monotonically decreasing costs and converges to a sequence of feedback gains that satisfies the optimality conditions. The usefulness of the method is illustrated by a numerical example. Copyright © 2007 IFAC.