MultiAgentDecisionProcess  Release 0.2.1
PerseusQFunctionPlanner Class Reference

PerseusQFunctionPlanner is a Perseus planner that uses QFunctions. More...

#include <PerseusQFunctionPlanner.h>

+ Inheritance diagram for PerseusQFunctionPlanner:
+ Collaboration diagram for PerseusQFunctionPlanner:

Public Member Functions

 PerseusQFunctionPlanner (const PlanningUnitDecPOMDPDiscrete &pu)
void Plan ()
virtual ~PerseusQFunctionPlanner ()
 Destructor.
- Public Member Functions inherited from PerseusStationary
void ExportBeliefSet (const std::string &filename) const
 Exports the belief set in a simple matrix format.
void ExportValueFunction (const std::string &filename) const
 Calls AlphaVectorPlanning::ExportValueFunction.
double GetQ (const JointBeliefInterface &b, Index jaI) const
double GetQ (const JointBeliefInterface &b, Index jaI, int &betaMaxI) const
double GetQ (const JointBeliefInterface &b, Index t, Index jaI) const
double GetQ (const JointBeliefInterface &b, Index t, Index jaI, int &betaMaxI) const
QFunctionsDiscrete GetQFunctions () const
ValueFunctionPOMDPDiscrete GetValueFunction () const
 PerseusStationary (const PlanningUnitDecPOMDPDiscrete &pu)
 (default) Constructor
void SetBeliefSet (const BeliefSet &S)
 Sets the belief set S that Perseus should use.
void SetValueFunction (const std::string &filename)
 Sets the value function.
virtual ~PerseusStationary ()
 Destructor.
- Public Member Functions inherited from Perseus
bool CheckConvergence (const std::vector< double > &VB, const std::vector< double > &VBnew, int iter) const
std::string GetIdentification () const
int GetVerbose () const
void Initialize ()
 Perseus (const PlanningUnitDecPOMDPDiscrete &pu)
 (default) Constructor
int SampleNotImprovedBeliefIndex (std::vector< bool > stillNeedToBeImproved, int nrNotImproved) const
 Sample an index of a belief in the set which has not been improved.
void SetComputeVectorForEachBelief (bool compute)
void SetDryrun (bool dryrun)
void SetIdentification (std::string identification)
void SetInitializeWithImmediateReward (bool initReward)
void SetInitializeWithZero (bool initZero)
void SetMaximumNumberOfIterations (int nr)
void SetMinimumNumberOfIterations (int nr)
void SetResultsFilename (std::string filename)
void SetSaveIntermediateValueFunctions (bool save)
void SetSaveTimings (bool save)
void SetVerbose (int verbose)
virtual ~Perseus ()
 Destructor.
- Public Member Functions inherited from AlphaVectorPlanning
 AlphaVectorPlanning (const PlanningUnitDecPOMDPDiscrete &pu)
 (default) Constructor
GaoVectorSet BackProject (const ValueFunctionPOMDPDiscrete &v) const
 Back projects a value function.
GaoVectorSet BackProject (const VectorSet &v) const
 Back projects a value function, represented as a VectorSet.
GaoVectorSet BackProjectMonahan (const QFunctionsDiscrete &Qs) const
GaoVectorSet BackProjectMonahan (const ValueFunctionPOMDPDiscrete &V) const
VectorSet CrossSum (const VectorSet &A, const VectorSet &B) const
 Compute the cross-sum of two vector sets.
void ExportPOMDPFile (const std::string &filename) const
 Exports the POMDP to file named filename.
ValueFunctionPOMDPDiscrete GetImmediateRewardValueFunction () const
 Returns the value function induced by the reward model.
const
PlanningUnitDecPOMDPDiscrete
GetPU () const
 Returns a ref to the PlanningUnit.
void MonahanCrossSum (const GaoVectorSet &G, ValueFunctionPOMDPDiscrete &V, Index a, bool doIncPrune) const
ValueFunctionPOMDPDiscrete Prune (const ValueFunctionPOMDPDiscrete &V) const
 Prune a valuefunction.
VectorSet Prune (const VectorSet &V) const
 Prune a VectorSet.
BeliefSet SampleBeliefs (ArgumentHandlers::Arguments args) const
 Sample a belief set according to the arguments.
QFunctionsDiscrete ValueFunctionToQ (const ValueFunctionPOMDPDiscrete &V) const
virtual ~AlphaVectorPlanning ()
 Destructor.
- Public Member Functions inherited from TimedAlgorithm
void AddTimedEvent (const std::string &id, clock_t duration)
 Adds event of certain duration, e.g., an external program call.
std::vector< double > GetTimedEventDurations (const std::string &id)
 Returns all stored durations (in s) for a particular event.
void LoadTimers (const std::string &filename)
 Load timing info from file filename.
void PrintTimers () const
 Print stored timing info.
void PrintTimersSummary () const
 Sums data and prints out a summary.
void SaveTimers (const std::string &filename) const
 Save collected timing info to file filename.
void SaveTimers (std::ofstream &of) const
 Save collected timing info to ofstream of.
void StartTimer (const std::string &id) const
 Start to time an event identified by id.
void StopTimer (const std::string &id) const
 Stop to time an event identified by id.
 TimedAlgorithm ()
 (default) Constructor
virtual ~TimedAlgorithm ()
 Destructor.

Private Member Functions

virtual QFunctionsDiscrete BackupStage (const BeliefSet &S, const QFunctionsDiscrete &V) const =0

Additional Inherited Members

- Static Public Member Functions inherited from Perseus
static std::string BackupTypeToString (const QAVParameters &params)
static QAVParameters ProcessArguments (const ArgumentHandlers::Arguments &args)
- Protected Member Functions inherited from PerseusStationary
std::vector< double > GetImmediateRewardBeliefSet () const
void InitializeBeliefs (int nrB, bool uniquify)
void StoreValueFunction (const ValueFunctionPOMDPDiscrete &V)
void StoreValueFunction (const QFunctionsDiscrete &Q)
- Protected Attributes inherited from PerseusStationary
BeliefSet_m_beliefs
 The belief set.
QFunctionsDiscrete _m_qFunction
 The resulting Q functions, derived from _m_valueFunction.
ValueFunctionPOMDPDiscrete _m_valueFunction
 The resulting value function.

Detailed Description

PerseusQFunctionPlanner is a Perseus planner that uses QFunctions.

Definition at line 40 of file PerseusQFunctionPlanner.h.

Constructor & Destructor Documentation

PerseusQFunctionPlanner::PerseusQFunctionPlanner ( const PlanningUnitDecPOMDPDiscrete pu)

Definition at line 34 of file PerseusQFunctionPlanner.cpp.

PerseusQFunctionPlanner::~PerseusQFunctionPlanner ( )
virtual

Destructor.

Definition at line 41 of file PerseusQFunctionPlanner.cpp.

Member Function Documentation

virtual QFunctionsDiscrete PerseusQFunctionPlanner::BackupStage ( const BeliefSet S,
const QFunctionsDiscrete V 
) const
privatepure virtual

Referenced by Plan().


The documentation for this class was generated from the following files: