• PRISM

  • Referenced in 390 articles [sw01186]
  • probabilistic models: discrete-time Markov chains, Markov decision processes and continuous-time Markov chains. Analysis...
  • pomp

  • Referenced in 33 articles [sw10664]
  • pomp: Statistical Inference for Partially Observed Markov Processes. Tools for working with partially observed Markov...
  • MRMC

  • Referenced in 66 articles [sw04129]
  • bounded reachability analysis for continuous-time Markov decision processes (CTMDPs) and CSL model checking...
  • msm

  • Referenced in 40 articles [sw08096]
  • fitting general continuous-time Markov and hidden Markov multi-state models to longitudinal data ... variety of observation schemes are supported, including processes observed at arbitrary times (panel data), continuously ... Markov transition rates and the hidden Markov output process can be modelled in terms...
  • MesoRD

  • Referenced in 28 articles [sw18202]
  • exact method to simulate the Markov process corresponding to the reaction-diffusion master equation. Availability...
  • Möbius

  • Referenced in 23 articles [sw04098]
  • solution, based on compact MDD-based Markov processes, are both supported...
  • SMART_

  • Referenced in 33 articles [sw04097]
  • available when the underlying process is a Markov chain. In addition, discrete-event simulation ... stochastic nature of the process, but certain classes of non-Markov models can still...
  • POMDPS

  • Referenced in 34 articles [sw03055]
  • planning algorithms for POMDPS. Partially Observable Markov Decision Processes (POMDPs) provide a rich framework...
  • POMDP

  • Referenced in 18 articles [sw03204]
  • Partially Observable Markov Decision Process (POMDP). The ’pomdp-solve’ program solves problems that are formulated ... partially observable Markov decision processes, a.k.a. POMDPs. It uses the basic dynamic programming approach...
  • LiQuor

  • Referenced in 18 articles [sw04136]
  • operational semantics based on (finite) Markov decision processes. LiQuor provides the facility to perform...
  • spBayes

  • Referenced in 283 articles [sw10160]
  • Unfortunately, fitting such models involves computationally intensive Markov chain Monte Carlo (MCMC) methods whose efficiency ... encompassing a wide variety of Gaussian spatial process models for univariate as well as multivariate...
  • BGPhazard

  • Referenced in 24 articles [sw11014]
  • BGPhazard: Markov beta and gamma processes for modeling hazard rates. Computes the hazard rate estimate...
  • moveHMM

  • Referenced in 12 articles [sw16166]
  • animal movement modelling using hidden Markov models. These include processing of tracking data, fitting hidden ... Markov models to movement data, visualization of data and fitted model, decoding of the state ... process...
  • Expokit

  • Referenced in 164 articles [sw00258]
  • Krylov subspace projection methods (Arnoldi and Lanczos processes), and that is why the toolkit ... critical importance in the area of Markov chains and furthermore, the computed solution is subject...
  • PEPA

  • Referenced in 113 articles [sw10692]
  • Evaluation Process Algebra. PEPA tools: The PEPA process algebra is supported by the PEPA Eclipse ... PEPA editor and performance analysers which use Markov chain or ODE methods or simulation. Performance...
  • FAUST2

  • Referenced in 5 articles [sw23682]
  • possibly non-deterministic) discrete-time Markov processes (dtMP) defined over uncountable (continuous) state spaces ... finite-state Markov chain or Markov decision processes. The abstraction procedure runs in MATLAB...
  • FluCaP

  • Referenced in 10 articles [sw07748]
  • search algorithm for solving First-Order Markov Decision Processes (FOMDPs). Our approach combines first-order...
  • IPC-4

  • Referenced in 10 articles [sw03495]
  • approaches. One community consists of Markov decision process (MDP) researchers interested in developing algorithms that...
  • Rapture

  • Referenced in 5 articles [sw13409]
  • Rapture: a tool for verifying Markov decision processes. We present a tool that performs verification ... quantified reachability properties over Markov decision processes (or probabilistic transition system). The originality...
  • Bio-PEPAd

  • Referenced in 5 articles [sw10690]
  • actions, yielding a new non-Markovian stochastic process algebra: Bio-PEPAd. This is a conservative ... PEPAd systems in generalized semi-Markov processes (GSMPs), as input for a delay stochastic simulation...