org.deeplearning4j.spark.impl.multilayer.scoring

Class ScoreExamplesFunction

java.lang.Object

org.deeplearning4j.spark.impl.multilayer.scoring.ScoreExamplesFunction

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.DoubleFlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>>

public class ScoreExamplesFunction
extends Object
implements org.apache.spark.api.java.function.DoubleFlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>>

Function to score examples individually. Note that scoring is batched for computational efficiency.
This is essentially a Spark implementation of the MultiLayerNetwork.scoreExamples(DataSet, boolean) method
Note: This method returns a score for each example, but the association between examples and scores is lost. In cases where we need to know the score for particular examples, use ScoreExamplesWithKeyFunction

Author:

Alex Black

See Also:

ScoreExamplesWithKeyFunction, Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.slf4j.Logger	log

Constructor Summary

Constructors

Constructor and Description
ScoreExamplesFunction(org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> params, org.apache.spark.broadcast.Broadcast<String> jsonConfig, boolean addRegularizationTerms, int batchSize)

Method Summary

Modifier and Type	Method and Description
Iterable<Double>	call(Iterator<org.nd4j.linalg.dataset.DataSet> iterator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected static org.slf4j.Logger log

Constructor Detail

ScoreExamplesFunction

public ScoreExamplesFunction(org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> params,
                             org.apache.spark.broadcast.Broadcast<String> jsonConfig,
                             boolean addRegularizationTerms,
                             int batchSize)

Method Detail

call

public Iterable<Double> call(Iterator<org.nd4j.linalg.dataset.DataSet> iterator)
                      throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.DoubleFlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>>

Throws:

Exception