mdp-0.1.1.0: Tools for solving Markov Decision Processes.

Safe HaskellNone
LanguageHaskell98

Algorithms.MDP.Examples.MM1

Description

We model an MM1 queue, i.e. a single-server queue with Poisson arrivals and service times.

See "Stochastic Dynamic Programming and the Control of Queueing Systems", Linn I. Sennot,, p. 242 for details.

Synopsis

Documentation

data Scenario Source #

A description of an MDP.

newtype State Source #

The state space is the count of customers in the queue.

Constructors

State Int 

Instances

Eq State Source # 

Methods

(==) :: State -> State -> Bool #

(/=) :: State -> State -> Bool #

Show State Source # 

Methods

showsPrec :: Int -> State -> ShowS #

show :: State -> String #

showList :: [State] -> ShowS #

data Action Source #

There are a number of services we can provide each customer, and if there are no customers we do nothing.

Constructors

NullAction 
Action Int 

Instances

mkInstance :: Scenario -> CTMDP State Action Double Source #

Generate an MDP from a Scenario.

scenario1 :: Scenario Source #

A specific scenario.

scenario2 :: Scenario Source #

A specific scenario.

scenario3 :: Scenario Source #

A specific scenario.

scenario4 :: Scenario Source #

A specific scenario.

scenario5 :: Scenario Source #

A specific scenario.

scenario6 :: Scenario Source #

A specific scenario.

scenario7 :: Scenario Source #

A specific scenario.

scenario8 :: Scenario Source #

A specific scenario.