MDP2: Markov Decision Processes (MDPs)

Create and optimize (semi) MDPs with discrete time steps and state space. Both hierarchical and ordinary-traditional MDPs can be modeled.

Version: 2.2.2.0
Depends: R (≥ 4.1.0)
Imports: diagram, dplyr, stringr, tidyr, magrittr, methods, purrr, rlang, tibble, Rcpp (≥ 0.11.5)
LinkingTo: Rcpp, RcppArmadillo
Suggests: knitr, Matrix, rmarkdown, testthat (≥ 3.0.0), readr, xml2, covr, roxygen2
Published: 2026-06-12
DOI: 10.32614/CRAN.package.MDP2
Author: Lars Relund Nielsen ORCID iD [aut, cre]
Maintainer: Lars Relund Nielsen <lars at relund.dk>
BugReports: https://github.com/relund/mdp/issues
License: GPL (≥ 3)
URL: https://relund.github.io/mdp/, https://github.com/relund/mdp/, http://relund.github.io/mdp/
NeedsCompilation: yes
Language: en-US
Materials: README, NEWS
CRAN checks: MDP2 results

Documentation:

Reference manual: MDP2.html , MDP2.pdf
Vignettes: building (source, R code)
finite-mdp (source, R code)
infinite-hmdp (source, R code)
infinite-mdp (source, R code)
MDP2 (source, R code)

Downloads:

Package source: MDP2_2.2.2.0.tar.gz
Windows binaries: r-devel: not available, r-release: not available, r-oldrel: not available
macOS binaries: r-release (arm64): MDP2_2.2.2.0.tgz, r-oldrel (arm64): MDP2_2.2.2.0.tgz, r-release (x86_64): not available, r-oldrel (x86_64): MDP2_2.2.2.0.tgz
Old sources: MDP2 archive

Linking:

Please use the canonical form https://CRAN.R-project.org/package=MDP2 to link to this page.