ai.libs.jaicore.search.algorithms.standard.mcts

Class MCTS<N,A,V extends java.lang.Comparable<V>>

java.lang.Object

ai.libs.jaicore.basic.algorithm.AAlgorithm<I,O>

ai.libs.jaicore.basic.algorithm.ASolutionCandidateIterator<I,O>

ai.libs.jaicore.basic.algorithm.AOptimizer<I,EvaluatedSearchGraphPath<N,A,V>,V>

ai.libs.jaicore.search.core.interfaces.AOptimalPathInORGraphSearch<GraphSearchWithPathEvaluationsInput<N,A,V>,N,A,V>

ai.libs.jaicore.search.algorithms.standard.mcts.MCTS<N,A,V>

All Implemented Interfaces:

ai.libs.jaicore.basic.algorithm.IAlgorithm<GraphSearchWithPathEvaluationsInput<N,A,V>,EvaluatedSearchGraphPath<N,A,V>>, ai.libs.jaicore.basic.algorithm.IOptimizationAlgorithm<GraphSearchWithPathEvaluationsInput<N,A,V>,EvaluatedSearchGraphPath<N,A,V>,V>, ai.libs.jaicore.basic.algorithm.ISolutionCandidateIterator<GraphSearchWithPathEvaluationsInput<N,A,V>,EvaluatedSearchGraphPath<N,A,V>>, ai.libs.jaicore.basic.Cancelable, ai.libs.jaicore.basic.ILoggingCustomizable, IPolicy<N,A,V>, IGraphSearch<GraphSearchWithPathEvaluationsInput<N,A,V>,EvaluatedSearchGraphPath<N,A,V>,N,A>, IOptimalPathInORGraphSearch<GraphSearchWithPathEvaluationsInput<N,A,V>,N,A,V>, IPathInORGraphSearch<GraphSearchWithPathEvaluationsInput<N,A,V>,EvaluatedSearchGraphPath<N,A,V>,N,A>, java.lang.Iterable<ai.libs.jaicore.basic.algorithm.events.AlgorithmEvent>, java.util.concurrent.Callable<EvaluatedSearchGraphPath<N,A,V>>, java.util.Iterator<ai.libs.jaicore.basic.algorithm.events.AlgorithmEvent>

Direct Known Subclasses:

UCT

public class MCTS<N,A,V extends java.lang.Comparable<V>>
extends AOptimalPathInORGraphSearch<GraphSearchWithPathEvaluationsInput<N,A,V>,N,A,V>
implements IPolicy<N,A,V>

MCTS algorithm implementation. This implementation follows the description in Browne, Cb AND Powley, Edward - A survey of monte carlo tree search methods (2012)

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	checkGoalPropertyOnEntirePath
protected IPolicy<N,A,V>	defaultPolicy
protected ai.libs.jaicore.graph.LabeledGraph<N,A>	exploredGraph
protected java.util.Map<N,Node<N,V>>	ext2int
protected GraphGenerator<N,A>	graphGenerator
protected NodeGoalTester<N>	nodeGoalTester
protected PathGoalTester<N>	pathGoalTester
protected ai.libs.jaicore.basic.IObjectEvaluator<SearchGraphPath<N,A>,V>	playoutSimulator
protected RootGenerator<N>	rootGenerator
protected SuccessorGenerator<N,A>	successorGenerator
protected IPathUpdatablePolicy<N,A,V>	treePolicy

Constructor Summary

Constructors

Constructor and Description
MCTS(GraphSearchWithPathEvaluationsInput<N,A,V> problem, IPathUpdatablePolicy<N,A,V> treePolicy, IPolicy<N,A,V> defaultPolicy, V penaltyForFailedEvaluation, boolean forbidDoublePaths)

Method Summary

Modifier and Type	Method and Description
A	getAction(N node, java.util.Map<A,N> actionsWithSuccessors)
java.lang.String	getLoggerName()
ai.libs.jaicore.basic.algorithm.events.AlgorithmEvent	nextWithException()
void	setLoggerName(java.lang.String name)

Methods inherited from class ai.libs.jaicore.search.core.interfaces.AOptimalPathInORGraphSearch

getGraphGenerator, nextSolutionCandidateEvent, registerSolution

Methods inherited from class ai.libs.jaicore.basic.algorithm.AOptimizer

call, getBestSeenSolution, nextSolutionCandidate, setBestSeenSolution, updateBestSeenSolution

Methods inherited from class ai.libs.jaicore.basic.algorithm.ASolutionCandidateIterator

collectAllSolutions

Methods inherited from class ai.libs.jaicore.basic.algorithm.AAlgorithm

activate, announceTimeoutDetected, avoidReinterruptionOnShutdownOnCurrentThread, cancel, checkAndConductTermination, checkTermination, computeTimeoutAware, getActivationTime, getConfig, getId, getInput, getNumCPUs, getRemainingTimeToDeadline, getState, getTimeout, getTimeoutPrecautionOffset, hasNext, hasThreadBeenInterruptedDuringShutdown, interruptThreadAsPartOfShutdown, isCanceled, isShutdownInitialized, isStopCriterionSatisfied, isTimeouted, iterator, next, post, registerActiveThread, registerListener, resolveShutdownInterruptOnCurrentThread, setConfig, setMaxNumThreads, setNumCPUs, setState, setTimeout, setTimeout, setTimeoutPrecautionOffset, shutdown, terminate, unregisterActiveThread, unregisterThreadAndShutdown

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.libs.jaicore.basic.algorithm.ISolutionCandidateIterator

nextSolutionCandidate

Methods inherited from interface ai.libs.jaicore.basic.algorithm.IAlgorithm

call, getConfig, getId, getInput, getNumCPUs, getTimeout, registerListener, setMaxNumThreads, setNumCPUs, setTimeout, setTimeout

Methods inherited from interface java.lang.Iterable

forEach, iterator, spliterator

Methods inherited from interface java.util.Iterator

forEachRemaining, hasNext, next, remove

Methods inherited from interface ai.libs.jaicore.basic.Cancelable

cancel

Field Detail

ext2int

protected final java.util.Map<N,Node<N,V extends java.lang.Comparable<V>>> ext2int

graphGenerator

protected final GraphGenerator<N,A> graphGenerator

rootGenerator

protected final RootGenerator<N> rootGenerator

successorGenerator

protected final SuccessorGenerator<N,A> successorGenerator

checkGoalPropertyOnEntirePath

protected final boolean checkGoalPropertyOnEntirePath

pathGoalTester

protected final PathGoalTester<N> pathGoalTester

nodeGoalTester

protected final NodeGoalTester<N> nodeGoalTester

treePolicy

protected final IPathUpdatablePolicy<N,A,V extends java.lang.Comparable<V>> treePolicy

defaultPolicy

protected final IPolicy<N,A,V extends java.lang.Comparable<V>> defaultPolicy

playoutSimulator

protected final ai.libs.jaicore.basic.IObjectEvaluator<SearchGraphPath<N,A>,V extends java.lang.Comparable<V>> playoutSimulator

exploredGraph

protected final ai.libs.jaicore.graph.LabeledGraph<N,A> exploredGraph

Constructor Detail

MCTS

public MCTS(GraphSearchWithPathEvaluationsInput<N,A,V> problem,
            IPathUpdatablePolicy<N,A,V> treePolicy,
            IPolicy<N,A,V> defaultPolicy,
            V penaltyForFailedEvaluation,
            boolean forbidDoublePaths)

Method Detail

getAction

public A getAction(N node,
                   java.util.Map<A,N> actionsWithSuccessors)
            throws ActionPredictionFailedException

Specified by:

getAction in interface IPolicy<N,A,V extends java.lang.Comparable<V>>

Throws:

ActionPredictionFailedException

nextWithException

public ai.libs.jaicore.basic.algorithm.events.AlgorithmEvent nextWithException()
                                                                        throws java.lang.InterruptedException,
                                                                               ai.libs.jaicore.basic.algorithm.AlgorithmExecutionCanceledException,
                                                                               ai.libs.jaicore.basic.algorithm.exceptions.AlgorithmException,
                                                                               ai.libs.jaicore.basic.algorithm.exceptions.AlgorithmTimeoutedException

Specified by:

nextWithException in interface ai.libs.jaicore.basic.algorithm.IAlgorithm<GraphSearchWithPathEvaluationsInput<N,A,V extends java.lang.Comparable<V>>,EvaluatedSearchGraphPath<N,A,V extends java.lang.Comparable<V>>>

Throws:

java.lang.InterruptedException

ai.libs.jaicore.basic.algorithm.AlgorithmExecutionCanceledException

ai.libs.jaicore.basic.algorithm.exceptions.AlgorithmException

ai.libs.jaicore.basic.algorithm.exceptions.AlgorithmTimeoutedException

getLoggerName

public java.lang.String getLoggerName()

Specified by:

getLoggerName in interface ai.libs.jaicore.basic.ILoggingCustomizable

Overrides:

getLoggerName in class AOptimalPathInORGraphSearch<GraphSearchWithPathEvaluationsInput<N,A,V extends java.lang.Comparable<V>>,N,A,V extends java.lang.Comparable<V>>

setLoggerName

public void setLoggerName(java.lang.String name)

Specified by:

setLoggerName in interface ai.libs.jaicore.basic.ILoggingCustomizable

Overrides:

setLoggerName in class AOptimalPathInORGraphSearch<GraphSearchWithPathEvaluationsInput<N,A,V extends java.lang.Comparable<V>>,N,A,V extends java.lang.Comparable<V>>