Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MDP #171

Merged
merged 5 commits into from
Sep 3, 2015
Merged

MDP #171

merged 5 commits into from
Sep 3, 2015

Commits on Sep 2, 2015

  1. Add mdp 

    - markov.MDP
- markov.random_mdp
    @oyamad
    oyamad committed Sep 2, 2015
    Configuration menu
    Copy the full SHA
    72dd98e View commit details
    Browse the repository at this point in the history

  2. For mpi: v^0 set to min_(s, a) r(s, a) / (1-beta) to guarantee conver… 

    …gence
    @oyamad
    oyamad committed Sep 2, 2015
    Configuration menu
    Copy the full SHA
    48d79f7 View commit details
    Browse the repository at this point in the history

  3. Add _check_action_feasibility 

    Checks
- every state has at least one action with finite reward
- for the sa-pair formulation, every state has at least one available action
    @oyamad
    oyamad committed Sep 2, 2015
    Configuration menu
    Copy the full SHA
    8248d51 View commit details
    Browse the repository at this point in the history

  4. Remove conversion to dense matrix 

    following sparse matrix support in MarkovChain
    @oyamad
    oyamad committed Sep 2, 2015
    Configuration menu
    Copy the full SHA
    fe893d5 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2015

  1. Rename MDP to DiscreteDP

    @oyamad
    oyamad committed Sep 3, 2015
    Configuration menu
    Copy the full SHA
    1ba72c3 View commit details
    Browse the repository at this point in the history