org.deeplearning4j.spark.earlystopping

Class SparkEarlyStoppingTrainer

java.lang.Object

org.deeplearning4j.spark.earlystopping.BaseSparkEarlyStoppingTrainer<MultiLayerNetwork>

org.deeplearning4j.spark.earlystopping.SparkEarlyStoppingTrainer

All Implemented Interfaces:

IEarlyStoppingTrainer<MultiLayerNetwork>

public class SparkEarlyStoppingTrainer
extends BaseSparkEarlyStoppingTrainer<MultiLayerNetwork>

Class for conducting early stopping training via Spark on a MultiLayerNetwork

Author:

Alex Black

Field Summary

Fields inherited from class org.deeplearning4j.spark.earlystopping.BaseSparkEarlyStoppingTrainer

examplesPerFit, numPartitions, totalExamples

Constructor Summary

Constructors

Constructor and Description
SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<MultiLayerNetwork> esConfig, MultiLayerNetwork net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train, int examplesPerFit, int totalExamples)
SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<MultiLayerNetwork> esConfig, MultiLayerNetwork net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train, int examplesPerFit, int totalExamples, EarlyStoppingListener<MultiLayerNetwork> listener)
SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<MultiLayerNetwork> esConfig, MultiLayerNetwork net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train, int examplesPerFit, int totalExamples, int numPartitions)
SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<MultiLayerNetwork> esConfig, MultiLayerNetwork net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train, int examplesPerFit, int totalExamples, int numPartitions, EarlyStoppingListener<MultiLayerNetwork> listener)

Method Summary

Modifier and Type	Method and Description
protected void	fit(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> data)
protected void	fitMulti(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> data)
protected double	getScore()

Methods inherited from class org.deeplearning4j.spark.earlystopping.BaseSparkEarlyStoppingTrainer

fit, setListener

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkEarlyStoppingTrainer

public SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc,
                                 EarlyStoppingConfiguration<MultiLayerNetwork> esConfig,
                                 MultiLayerNetwork net,
                                 org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train,
                                 int examplesPerFit,
                                 int totalExamples)

SparkEarlyStoppingTrainer

public SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc,
                                 EarlyStoppingConfiguration<MultiLayerNetwork> esConfig,
                                 MultiLayerNetwork net,
                                 org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train,
                                 int examplesPerFit,
                                 int totalExamples,
                                 EarlyStoppingListener<MultiLayerNetwork> listener)

SparkEarlyStoppingTrainer

public SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc,
                                 EarlyStoppingConfiguration<MultiLayerNetwork> esConfig,
                                 MultiLayerNetwork net,
                                 org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train,
                                 int examplesPerFit,
                                 int totalExamples,
                                 int numPartitions)

SparkEarlyStoppingTrainer

public SparkEarlyStoppingTrainer(org.apache.spark.SparkContext sc,
                                 EarlyStoppingConfiguration<MultiLayerNetwork> esConfig,
                                 MultiLayerNetwork net,
                                 org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> train,
                                 int examplesPerFit,
                                 int totalExamples,
                                 int numPartitions,
                                 EarlyStoppingListener<MultiLayerNetwork> listener)

Method Detail

fit

protected void fit(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> data)

Specified by:

fit in class BaseSparkEarlyStoppingTrainer<MultiLayerNetwork>

fitMulti

protected void fitMulti(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> data)

Specified by:

fitMulti in class BaseSparkEarlyStoppingTrainer<MultiLayerNetwork>

getScore

protected double getScore()

Specified by:

getScore in class BaseSparkEarlyStoppingTrainer<MultiLayerNetwork>