org.deeplearning4j.spark.earlystopping

Class BaseSparkEarlyStoppingTrainer<T extends Model>

java.lang.Object

org.deeplearning4j.spark.earlystopping.BaseSparkEarlyStoppingTrainer<T>

All Implemented Interfaces:

IEarlyStoppingTrainer<T>

Direct Known Subclasses:

SparkEarlyStoppingGraphTrainer, SparkEarlyStoppingTrainer

public abstract class BaseSparkEarlyStoppingTrainer<T extends Model>
extends Object
implements IEarlyStoppingTrainer<T>

Base/abstract class for conducting early stopping training via Spark, on a MultiLayerNetwork or a ComputationGraph

Author:

Alex Black

Field Summary

Fields

Modifier and Type	Field and Description
protected int	examplesPerFit
protected int	numPartitions
protected int	totalExamples

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BaseSparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<T> esConfig, T net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> trainMulti, int examplesPerFit, int totalExamples, int numPartitions, EarlyStoppingListener<T> listener)

Method Summary

Modifier and Type	Method and Description
EarlyStoppingResult<T>	fit()
protected abstract void	fit(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> data)
protected abstract void	fitMulti(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> data)
protected abstract double	getScore()
void	setListener(EarlyStoppingListener<T> listener)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

examplesPerFit

protected final int examplesPerFit

totalExamples

protected final int totalExamples

numPartitions

protected final int numPartitions

Constructor Detail

BaseSparkEarlyStoppingTrainer

protected BaseSparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc,
                                        EarlyStoppingConfiguration<T> esConfig,
                                        T net,
                                        org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train,
                                        org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> trainMulti,
                                        int examplesPerFit,
                                        int totalExamples,
                                        int numPartitions,
                                        EarlyStoppingListener<T> listener)

Method Detail

fit

protected abstract void fit(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> data)

fitMulti

protected abstract void fitMulti(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> data)

getScore

protected abstract double getScore()

fit

public EarlyStoppingResult<T> fit()

Specified by:

fit in interface IEarlyStoppingTrainer<T extends Model>

setListener

public void setListener(EarlyStoppingListener<T> listener)

Specified by:

setListener in interface IEarlyStoppingTrainer<T extends Model>