org.deeplearning4j.spark.impl.multilayer.gradientaccum

Class GradientAccumFlatMap

java.lang.Object

org.deeplearning4j.spark.impl.multilayer.gradientaccum.GradientAccumFlatMap

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.FlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>,scala.Tuple3<Gradient,Updater,ScoreReport>>

public class GradientAccumFlatMap
extends Object
implements org.apache.spark.api.java.function.FlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>,scala.Tuple3<Gradient,Updater,ScoreReport>>

Iterative reduce with flat map using map partitions

Author:

Adam Gibson

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
GradientAccumFlatMap(String json, org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> params, org.apache.spark.broadcast.Broadcast<Updater> updater) Pass in json configuration and baseline parameters

Method Summary

Modifier and Type	Method and Description
Iterable<scala.Tuple3<Gradient,Updater,ScoreReport>>	call(Iterator<org.nd4j.linalg.dataset.DataSet> dataSetIterator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GradientAccumFlatMap

public GradientAccumFlatMap(String json,
                            org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> params,
                            org.apache.spark.broadcast.Broadcast<Updater> updater)

Pass in json configuration and baseline parameters

Parameters:

json - json configuration for the network

params - the parameters to use for the network

Method Detail

call

public Iterable<scala.Tuple3<Gradient,Updater,ScoreReport>> call(Iterator<org.nd4j.linalg.dataset.DataSet> dataSetIterator)
                                                          throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.FlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>,scala.Tuple3<Gradient,Updater,ScoreReport>>

Throws:

Exception