org.deeplearning4j.spark.earlystopping

Class SparkEarlyStoppingGraphTrainer

java.lang.Object

org.deeplearning4j.spark.earlystopping.BaseSparkEarlyStoppingTrainer<ComputationGraph>

org.deeplearning4j.spark.earlystopping.SparkEarlyStoppingGraphTrainer

All Implemented Interfaces:

IEarlyStoppingTrainer<ComputationGraph>

public class SparkEarlyStoppingGraphTrainer
extends BaseSparkEarlyStoppingTrainer<ComputationGraph>

Class for conducting early stopping training via Spark on a ComputationGraph

Author:

Alex Black

Field Summary

Fields inherited from class org.deeplearning4j.spark.earlystopping.BaseSparkEarlyStoppingTrainer

examplesPerFit, numPartitions, totalExamples

Constructor Summary

Constructors

Constructor and Description
SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<ComputationGraph> esConfig, ComputationGraph net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train, int examplesPerFit, int totalExamples)
SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<ComputationGraph> esConfig, ComputationGraph net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train, int examplesPerFit, int totalExamples, EarlyStoppingListener<ComputationGraph> listener)
SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<ComputationGraph> esConfig, ComputationGraph net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train, int examplesPerFit, int totalExamples, int numPartitions)
SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc, EarlyStoppingConfiguration<ComputationGraph> esConfig, ComputationGraph net, org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train, int examplesPerFit, int totalExamples, int numPartitions, EarlyStoppingListener<ComputationGraph> listener)

Method Summary

Modifier and Type	Method and Description
protected void	fit(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> data)
protected void	fitMulti(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> data)
protected double	getScore()

Methods inherited from class org.deeplearning4j.spark.earlystopping.BaseSparkEarlyStoppingTrainer

fit, setListener

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkEarlyStoppingGraphTrainer

public SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc,
                                      EarlyStoppingConfiguration<ComputationGraph> esConfig,
                                      ComputationGraph net,
                                      org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train,
                                      int examplesPerFit,
                                      int totalExamples)

SparkEarlyStoppingGraphTrainer

public SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc,
                                      EarlyStoppingConfiguration<ComputationGraph> esConfig,
                                      ComputationGraph net,
                                      org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train,
                                      int examplesPerFit,
                                      int totalExamples,
                                      int numPartitions)

SparkEarlyStoppingGraphTrainer

public SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc,
                                      EarlyStoppingConfiguration<ComputationGraph> esConfig,
                                      ComputationGraph net,
                                      org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train,
                                      int examplesPerFit,
                                      int totalExamples,
                                      EarlyStoppingListener<ComputationGraph> listener)

SparkEarlyStoppingGraphTrainer

public SparkEarlyStoppingGraphTrainer(org.apache.spark.SparkContext sc,
                                      EarlyStoppingConfiguration<ComputationGraph> esConfig,
                                      ComputationGraph net,
                                      org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> train,
                                      int examplesPerFit,
                                      int totalExamples,
                                      int numPartitions,
                                      EarlyStoppingListener<ComputationGraph> listener)

Method Detail

fit

protected void fit(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.DataSet> data)

Specified by:

fit in class BaseSparkEarlyStoppingTrainer<ComputationGraph>

fitMulti

protected void fitMulti(org.apache.spark.api.java.JavaRDD<org.nd4j.linalg.dataset.api.MultiDataSet> data)

Specified by:

fitMulti in class BaseSparkEarlyStoppingTrainer<ComputationGraph>

getScore

protected double getScore()

Specified by:

getScore in class BaseSparkEarlyStoppingTrainer<ComputationGraph>