org.deeplearning4j.nn.layers.normalization

Class CudnnBatchNormalizationHelper

java.lang.Object

org.deeplearning4j.nn.layers.BaseCudnnHelper

org.deeplearning4j.nn.layers.normalization.CudnnBatchNormalizationHelper

All Implemented Interfaces:

org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

public class CudnnBatchNormalizationHelper
extends BaseCudnnHelper
implements org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

cuDNN-based helper for the batch normalization layer.

Author:

saudet

Nested Class Summary

Nested classes/interfaces inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

BaseCudnnHelper.CudnnContext, BaseCudnnHelper.DataCache, BaseCudnnHelper.TensorArray

Field Summary

Fields

Modifier and Type	Field and Description
protected int	batchNormMode

Fields inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

alpha, beta, dataType, dataTypeSize, sizeInBytes, tensorFormat

Constructor Summary

Constructors

Constructor and Description
CudnnBatchNormalizationHelper()

Method Summary

Modifier and Type	Method and Description
org.deeplearning4j.berkeley.Pair<org.deeplearning4j.nn.gradient.Gradient,org.nd4j.linalg.api.ndarray.INDArray>	backpropGradient(org.nd4j.linalg.api.ndarray.INDArray input, org.nd4j.linalg.api.ndarray.INDArray epsilon, int[] shape, org.nd4j.linalg.api.ndarray.INDArray gamma, org.nd4j.linalg.api.ndarray.INDArray dGammaView, org.nd4j.linalg.api.ndarray.INDArray dBetaView, double eps)
boolean	checkSupported(double eps)
org.nd4j.linalg.api.ndarray.INDArray	preOutput(org.nd4j.linalg.api.ndarray.INDArray x, boolean training, int[] shape, org.nd4j.linalg.api.ndarray.INDArray gamma, org.nd4j.linalg.api.ndarray.INDArray beta, org.nd4j.linalg.api.ndarray.INDArray mean, org.nd4j.linalg.api.ndarray.INDArray var, double decay, double eps)

Methods inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

checkCuda, checkCudnn, checkSupported

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

batchNormMode

protected final int batchNormMode

See Also:

Constant Field Values

Constructor Detail

CudnnBatchNormalizationHelper

public CudnnBatchNormalizationHelper()

Method Detail

checkSupported

public boolean checkSupported(double eps)

Specified by:

checkSupported in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

backpropGradient

public org.deeplearning4j.berkeley.Pair<org.deeplearning4j.nn.gradient.Gradient,org.nd4j.linalg.api.ndarray.INDArray> backpropGradient(org.nd4j.linalg.api.ndarray.INDArray input,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray epsilon,
                                                                                                                                       int[] shape,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray gamma,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray dGammaView,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray dBetaView,
                                                                                                                                       double eps)

Specified by:

backpropGradient in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper

preOutput

public org.nd4j.linalg.api.ndarray.INDArray preOutput(org.nd4j.linalg.api.ndarray.INDArray x,
                                                      boolean training,
                                                      int[] shape,
                                                      org.nd4j.linalg.api.ndarray.INDArray gamma,
                                                      org.nd4j.linalg.api.ndarray.INDArray beta,
                                                      org.nd4j.linalg.api.ndarray.INDArray mean,
                                                      org.nd4j.linalg.api.ndarray.INDArray var,
                                                      double decay,
                                                      double eps)

Specified by:

preOutput in interface org.deeplearning4j.nn.layers.normalization.BatchNormalizationHelper