In this work, we focus on developing analysis tools related to stability theory for
certain classes of stochastic dynamical systems that permit non-unique solutions. The
non-unique nature of solutions arise primarily due to the system dynamics that are
modeled by set-valued mappings. There are two main motivations for studying such
classes of systems. Firstly, understanding such systems is crucial to developing a robust
stability theory. Secondly, such system models allow flexibility in control design problems.
We begin by developing analysis tools for a simple class of discrete-time stochastic
system modeled by set-valued maps and then extend the results to a larger class of
stochastic hybrid systems. Stochastic hybrid systems are a class of dynamical systems
that combine continuous-time dynamics, discrete-time dynamics and randomness. The
analysis tools are established for properties like global asymptotic stability in probability
and global recurrence. We focus on establishing results related to sufficient conditions for stability, weak sufficient conditions for stability, robust stability conditions and converse Lyapunov theorems. In this work a primary assumption is that the stochastic system satisfies some mild regularity properties with respect to the state variable and random input. The regularity properties are needed to establish the existence of random solutions and results on sequential compactness for the solution set of the stochastic system.
We now explain briefly the four main types of analysis tools studied in this work.
Sufficient conditions for stability establish conditions involving Lyapunov-like functions
satisfying strict decrease properties along solutions that are needed to verify stability
properties. Weak sufficient conditions relax the strict decrease nature of the Lyapunov like function along solutions and rely on either knowledge about the behavior of the
solutions on certain level sets of the Lyapunov-like function or use multiple nested non-strict Lyapunov-like functions to conclude stability properties. The invariance principle
and Matrosov function theory fall in to this category. Robust stability conditions determine
when stability properties are robust to sufficiently small perturbations of the
nominal system data. Robustness of stability is an important concept in the presence
of measurement errors, disturbances and parametric uncertainty for the nominal system.
We study two approaches to verify robustness. The first approach to establish robustness
relies on the regularity properties of the system data and the second approach is
through the use of Lyapunov functions. Robustness analysis is an area where the notion
of set-valued dynamical systems arise naturally and it emphasizes the reason for our
study of such systems. Finally, we focus on developing converse Lyapunov theorems for
stochastic systems. Converse Lyapunov theorems are used to illustrate the equivalence
between asymptotic properties of a system and the existence of a function that satisfies
a decrease condition along the solutions. Strong forms of the converse theorem imply
the existence of smooth Lyapunov functions. A fundamental way in which our results
differ from the results in the literature on converse theorems for stochastic systems is
that we exploit robustness of the stability property to establish the existence of a smooth