Several types of dynamics at stationarity can be described in terms of a Markov jump process among a finite number N of representative sites. Before dealing with the dynamical aspects, one basic problem consists in expressing the a priori steady-state occupation probabilities of the sites. In particular, one wishes to go beyond the mere black-box computational tools and find expressions in which the jump rate constants appear explicitly, therefore allowing for a potential design/control of the network. For strongly connected networks admitting a unique stationary state with all sites populated, here we express the occupation probabilities in terms of a formula that involves powers of the transition rate matrix up to order N - 1. We also provide an expression of the derivatives with respect to the jump rate constants, possibly useful in sensitivity analysis frameworks. Although we refer to dynamics in (bio)chemical networks at thermal equilibrium or under nonequilibrium steady-state conditions, the results are valid for any Markov jump process under the same assumptions.

Steady-state probabilities for Markov jump processes in terms of powers of the transition rate matrix

Frezzato, Diego
2024

Abstract

Several types of dynamics at stationarity can be described in terms of a Markov jump process among a finite number N of representative sites. Before dealing with the dynamical aspects, one basic problem consists in expressing the a priori steady-state occupation probabilities of the sites. In particular, one wishes to go beyond the mere black-box computational tools and find expressions in which the jump rate constants appear explicitly, therefore allowing for a potential design/control of the network. For strongly connected networks admitting a unique stationary state with all sites populated, here we express the occupation probabilities in terms of a formula that involves powers of the transition rate matrix up to order N - 1. We also provide an expression of the derivatives with respect to the jump rate constants, possibly useful in sensitivity analysis frameworks. Although we refer to dynamics in (bio)chemical networks at thermal equilibrium or under nonequilibrium steady-state conditions, the results are valid for any Markov jump process under the same assumptions.
File in questo prodotto:
File Dimensione Formato  
234111_1_5.0217202.pdf

accesso aperto

Descrizione: Articolo pubblicato
Tipologia: Published (publisher's version)
Licenza: Creative commons
Dimensione 5.56 MB
Formato Adobe PDF
5.56 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3518991
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
  • OpenAlex ND
social impact