Several dynamical processes can be modeled as Markov jump processes among a finite number N of sites (the distinct physical states). Here we consider strongly connected networks with time-independent site-to-site jump rate constants, and focus on the steady-state occupation probabilities of the sites. We provide a physically framed expression of the steady-state distribution in terms of arrival probabilities, here defined as the probabilities of going from starting sites to target sites with a given number of jumps (regardless of the time required). In particular, the full set of return probabilities (for all the sites of the network) up to N-1 jumps is necessary and sufficient. A few examples illustrate the outcomes, including the case of stochastic chemical kinetics.

Steady-state solution of Markov jump processes in terms of arrival probabilities

Frezzato, Diego
2025

Abstract

Several dynamical processes can be modeled as Markov jump processes among a finite number N of sites (the distinct physical states). Here we consider strongly connected networks with time-independent site-to-site jump rate constants, and focus on the steady-state occupation probabilities of the sites. We provide a physically framed expression of the steady-state distribution in terms of arrival probabilities, here defined as the probabilities of going from starting sites to target sites with a given number of jumps (regardless of the time required). In particular, the full set of return probabilities (for all the sites of the network) up to N-1 jumps is necessary and sufficient. A few examples illustrate the outcomes, including the case of stochastic chemical kinetics.
2025
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3546377
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
  • OpenAlex 0
social impact