The transition probabilities of jumps between operational modes of discrete-time Markov(ian) jump linear systems (dtMJLSs) are generally considered to be time-invariant, certain, and often completely known in the majority of dedicated studies. Still, in most real cases the transition probability matrix (TPM) cannot be computed exactly and is time-varying. In this article, we take into account the uncertainty and time-variance of the jump parameters by considering the underlying Markov chain as polytopic and time-inhomogeneous, i.e., its TPM is varying over time with variations that are arbitrary within a polytopic set of stochastic matrices. We show that the conditions used for time-homogeneous dtMJLSs are not enough to ensure the stability of the time-inhomogeneous system, and that perturbations on values of the TPM can make a stable system unstable. We present necessary and sufficient conditions for mean square stability (MSS) of polytopic time-inhomogeneous dtMJLSs, prove that deciding MSS on such systems is NP-hard and that MSS is equivalent to exponential MSS and to stochastic stability. We also derive necessary and sufficient conditions for robust MSS of dtMJLSs affected by polytopic uncertainties on transition probabilities and bounded disturbances.

Robust stability of polytopic time-inhomogeneous Markov jump linear systems

Zacchia Lun, Yuriy
;
2019-01-01

Abstract

The transition probabilities of jumps between operational modes of discrete-time Markov(ian) jump linear systems (dtMJLSs) are generally considered to be time-invariant, certain, and often completely known in the majority of dedicated studies. Still, in most real cases the transition probability matrix (TPM) cannot be computed exactly and is time-varying. In this article, we take into account the uncertainty and time-variance of the jump parameters by considering the underlying Markov chain as polytopic and time-inhomogeneous, i.e., its TPM is varying over time with variations that are arbitrary within a polytopic set of stochastic matrices. We show that the conditions used for time-homogeneous dtMJLSs are not enough to ensure the stability of the time-inhomogeneous system, and that perturbations on values of the TPM can make a stable system unstable. We present necessary and sufficient conditions for mean square stability (MSS) of polytopic time-inhomogeneous dtMJLSs, prove that deciding MSS on such systems is NP-hard and that MSS is equivalent to exponential MSS and to stochastic stability. We also derive necessary and sufficient conditions for robust MSS of dtMJLSs affected by polytopic uncertainties on transition probabilities and bounded disturbances.
2019
Time-inhomogeneous Markov chains, Markov models, stochastic jump processes, robust stability
File in questo prodotto:
File Dimensione Formato  
Automatica_2019_105_286-297_post-print.pdf

accesso aperto

Tipologia: Documento in Post-print
Licenza: Creative commons
Dimensione 840.99 kB
Formato Adobe PDF
840.99 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11771/12237
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
social impact