# mdp: Tools for solving Markov Decision Processes.

A library for formulating and solving Markov decision problems. We currently only solve infinite horizon problems. We handle discounted and undiscounted problems, and can solve continuous- and discrete-time problems.

## Modules

[Index]

## Downloads

- mdp-0.1.1.0.tar.gz [browse] (Cabal source package)
- Package description (as included in the package)

Versions [RSS] | 0.1.0.0, 0.1.1.0 |
---|---|

Dependencies | base (>=4.8 && <4.10), containers (>=0.5.8.1 && <0.6), mdp, vector (>=0.11 && <0.12) [details] |

License | MIT |

Author | Patrick Steele |

Maintainer | prs233@cornell.edu copyright: Copyright (c) 2015-2016 Patrick Steele |

Category | Algorithms, Math |

Source repo | head: git clone https://github.com/prsteele/mdp.git |

Uploaded | by prsteele at 2016-11-29T18:36:45Z |

Distributions | NixOS:0.1.1.0 |

Executables | mm1, ex-3-2, ex-3-1-relative, ex-3-1 |

Downloads | 1542 total (6 in the last 30 days) |

Rating | (no votes yet) [estimated by Bayesian average] |

Your Rating | |

Status | Docs uploaded by user Build status unknown [no reports yet] |