public class EvaluateFlatMapFunction extends Object implements org.apache.spark.api.java.function.FlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>,Evaluation>
| Modifier and Type | Field and Description |
|---|---|
protected int |
evalBatchSize |
protected org.apache.spark.broadcast.Broadcast<String> |
json |
protected org.apache.spark.broadcast.Broadcast<List<String>> |
labels |
protected static org.slf4j.Logger |
log |
protected org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> |
params |
| Constructor and Description |
|---|
EvaluateFlatMapFunction(org.apache.spark.broadcast.Broadcast<String> json,
org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> params,
int evalBatchSize,
org.apache.spark.broadcast.Broadcast<List<String>> labels) |
| Modifier and Type | Method and Description |
|---|---|
Iterable<Evaluation> |
call(Iterator<org.nd4j.linalg.dataset.DataSet> dataSetIterator) |
protected static org.slf4j.Logger log
protected org.apache.spark.broadcast.Broadcast<String> json
protected org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> params
protected int evalBatchSize
public EvaluateFlatMapFunction(org.apache.spark.broadcast.Broadcast<String> json, org.apache.spark.broadcast.Broadcast<org.nd4j.linalg.api.ndarray.INDArray> params, int evalBatchSize, org.apache.spark.broadcast.Broadcast<List<String>> labels)
json - Network configuration (json format)params - Network parametersevalBatchSize - Max examples per evaluation. Do multiple separate forward passes if data exceeds
this. Used to avoid doing too many at once (and hence memory issues)labels - list of string labelspublic Iterable<Evaluation> call(Iterator<org.nd4j.linalg.dataset.DataSet> dataSetIterator) throws Exception
call in interface org.apache.spark.api.java.function.FlatMapFunction<Iterator<org.nd4j.linalg.dataset.DataSet>,Evaluation>ExceptionCopyright © 2016. All Rights Reserved.