While widely used, generative models pose the challenging task of deriving and analyzing their underlying distribution. In this thesis, we focus on two classes of transparent genera- tive models and present new methods to tackle this task. Markov Population Processes use Continuous Time Markov Chains to describe the evolution of populations over time. Their analysis is often hindered by state-space explosion, tack- led with deterministic approximation or truncation techniques. We propose a method, Dynamic Boundary Projection, that couples an exact stochastic description of a subset of states and a deterministic approximation that dynamically shifts the subset across the state space. The resulting finite set of ODEs is asymptotically exact. We show that our method performs well in terms of accuracy and runtimes on challenging sys- tems. We also propose an extension that further reduces the number of equations while maintaining good accuracy. Probabilistic Programs leverage the power of programming languages to define probabilistic models; however, no one- fit-for-all solution exists to derive the posterior distribution. We define a family of approximating semantics, Gaussian Se- mantics, that leverages moment-matching and the approxi- mation power of Gaussian Mixtures to approximate the joint probability distribution over program variables. As the num- ber of the moments matched increases, Gaussian Semantics tends to the exact semantics. We implement an instance of Gaussian Semantics that matches the first two order moments and show that our implementation performs competitively with respect to other state-of-the-art inference methods and excellently on two classes of models taken from the literature.

Efficient and Accurate Analysis of Two Classes of Transparent Generative Models / Randone, F.. - (2024 Feb 05). [10.13118/francesca-randone_phd2024-02-05]

Efficient and Accurate Analysis of Two Classes of Transparent Generative Models

Francesca Randone
2024

Abstract

While widely used, generative models pose the challenging task of deriving and analyzing their underlying distribution. In this thesis, we focus on two classes of transparent genera- tive models and present new methods to tackle this task. Markov Population Processes use Continuous Time Markov Chains to describe the evolution of populations over time. Their analysis is often hindered by state-space explosion, tack- led with deterministic approximation or truncation techniques. We propose a method, Dynamic Boundary Projection, that couples an exact stochastic description of a subset of states and a deterministic approximation that dynamically shifts the subset across the state space. The resulting finite set of ODEs is asymptotically exact. We show that our method performs well in terms of accuracy and runtimes on challenging sys- tems. We also propose an extension that further reduces the number of equations while maintaining good accuracy. Probabilistic Programs leverage the power of programming languages to define probabilistic models; however, no one- fit-for-all solution exists to derive the posterior distribution. We define a family of approximating semantics, Gaussian Se- mantics, that leverages moment-matching and the approxi- mation power of Gaussian Mixtures to approximate the joint probability distribution over program variables. As the num- ber of the moments matched increases, Gaussian Semantics tends to the exact semantics. We implement an instance of Gaussian Semantics that matches the first two order moments and show that our implementation performs competitively with respect to other state-of-the-art inference methods and excellently on two classes of models taken from the literature.
5-feb-2024
35
CSSE
TRIBASTONE, MIRCO
File in questo prodotto:
File Dimensione Formato  
Randone Francesca_Final_Efficient_and_Accurate_Analysis_of_Two_Classes_of_Transparent_Generative_Models.pdf

accesso aperto

Tipologia: Tesi di dottorato
Licenza: Creative commons
Dimensione 2.39 MB
Formato Adobe PDF
2.39 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11771/42458
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • OpenAlex ND
social impact