org.deeplearning4j.nn.layers.recurrent

Class CudnnLSTMHelper

java.lang.Object

org.deeplearning4j.nn.layers.BaseCudnnHelper

org.deeplearning4j.nn.layers.recurrent.CudnnLSTMHelper

All Implemented Interfaces:

org.deeplearning4j.nn.layers.recurrent.LSTMHelper

public class CudnnLSTMHelper
extends BaseCudnnHelper
implements org.deeplearning4j.nn.layers.recurrent.LSTMHelper

cuDNN-based helper for the recurrent LSTM layer (no peephole connections).

Author:

saudet

Nested Class Summary

Nested classes/interfaces inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

BaseCudnnHelper.CudnnContext, BaseCudnnHelper.DataCache, BaseCudnnHelper.TensorArray

Field Summary

Fields

Modifier and Type	Field and Description
protected static boolean	bidirectional
protected static float	dropout
protected static int	numLayers
protected static int	numLinearLayers
protected static int	RNNMode

Fields inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

alpha, beta, dataType, dataTypeSize, sizeInBytes, tensorFormat

Constructor Summary

Constructors

Constructor and Description
CudnnLSTMHelper()

Method Summary

Modifier and Type	Method and Description
org.deeplearning4j.nn.layers.recurrent.FwdPassReturn	activate(org.deeplearning4j.nn.api.Layer layer, org.deeplearning4j.nn.conf.NeuralNetConfiguration conf, org.nd4j.linalg.activations.IActivation gateActivationFn, org.nd4j.linalg.api.ndarray.INDArray input, org.nd4j.linalg.api.ndarray.INDArray recurrentWeights, org.nd4j.linalg.api.ndarray.INDArray inputWeights, org.nd4j.linalg.api.ndarray.INDArray biases, boolean training, org.nd4j.linalg.api.ndarray.INDArray prevOutputActivations, org.nd4j.linalg.api.ndarray.INDArray prevMemCellState, boolean forBackprop, boolean forwards, String inputWeightKey, org.nd4j.linalg.api.ndarray.INDArray maskArray, boolean hasPeepholeConnections)
org.deeplearning4j.berkeley.Pair<org.deeplearning4j.nn.gradient.Gradient,org.nd4j.linalg.api.ndarray.INDArray>	backpropGradient(org.deeplearning4j.nn.conf.NeuralNetConfiguration conf, org.nd4j.linalg.activations.IActivation gateActivationFn, org.nd4j.linalg.api.ndarray.INDArray input, org.nd4j.linalg.api.ndarray.INDArray recurrentWeights, org.nd4j.linalg.api.ndarray.INDArray inputWeights, org.nd4j.linalg.api.ndarray.INDArray epsilon, boolean truncatedBPTT, int tbpttBackwardLength, org.deeplearning4j.nn.layers.recurrent.FwdPassReturn fwdPass, boolean forwards, String inputWeightKey, String recurrentWeightKey, String biasWeightKey, Map<String,org.nd4j.linalg.api.ndarray.INDArray> gradientViews, org.nd4j.linalg.api.ndarray.INDArray maskArray, boolean hasPeepholeConnections)
boolean	checkSupported(org.nd4j.linalg.activations.IActivation gateActivationFn, org.nd4j.linalg.activations.IActivation activationFn, boolean hasPeepholeConnections)

Methods inherited from class org.deeplearning4j.nn.layers.BaseCudnnHelper

checkCuda, checkCudnn, checkSupported

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

numLayers

protected static final int numLayers

See Also:

Constant Field Values

dropout

protected static final float dropout

See Also:

Constant Field Values

bidirectional

protected static final boolean bidirectional

See Also:

Constant Field Values

RNNMode

protected static final int RNNMode

See Also:

Constant Field Values

numLinearLayers

protected static final int numLinearLayers

See Also:

Constant Field Values

Constructor Detail

CudnnLSTMHelper

public CudnnLSTMHelper()

Method Detail

checkSupported

public boolean checkSupported(org.nd4j.linalg.activations.IActivation gateActivationFn,
                              org.nd4j.linalg.activations.IActivation activationFn,
                              boolean hasPeepholeConnections)

Specified by:

checkSupported in interface org.deeplearning4j.nn.layers.recurrent.LSTMHelper

backpropGradient

public org.deeplearning4j.berkeley.Pair<org.deeplearning4j.nn.gradient.Gradient,org.nd4j.linalg.api.ndarray.INDArray> backpropGradient(org.deeplearning4j.nn.conf.NeuralNetConfiguration conf,
                                                                                                                                       org.nd4j.linalg.activations.IActivation gateActivationFn,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray input,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray recurrentWeights,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray inputWeights,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray epsilon,
                                                                                                                                       boolean truncatedBPTT,
                                                                                                                                       int tbpttBackwardLength,
                                                                                                                                       org.deeplearning4j.nn.layers.recurrent.FwdPassReturn fwdPass,
                                                                                                                                       boolean forwards,
                                                                                                                                       String inputWeightKey,
                                                                                                                                       String recurrentWeightKey,
                                                                                                                                       String biasWeightKey,
                                                                                                                                       Map<String,org.nd4j.linalg.api.ndarray.INDArray> gradientViews,
                                                                                                                                       org.nd4j.linalg.api.ndarray.INDArray maskArray,
                                                                                                                                       boolean hasPeepholeConnections)

Specified by:

backpropGradient in interface org.deeplearning4j.nn.layers.recurrent.LSTMHelper

activate

public org.deeplearning4j.nn.layers.recurrent.FwdPassReturn activate(org.deeplearning4j.nn.api.Layer layer,
                                                                     org.deeplearning4j.nn.conf.NeuralNetConfiguration conf,
                                                                     org.nd4j.linalg.activations.IActivation gateActivationFn,
                                                                     org.nd4j.linalg.api.ndarray.INDArray input,
                                                                     org.nd4j.linalg.api.ndarray.INDArray recurrentWeights,
                                                                     org.nd4j.linalg.api.ndarray.INDArray inputWeights,
                                                                     org.nd4j.linalg.api.ndarray.INDArray biases,
                                                                     boolean training,
                                                                     org.nd4j.linalg.api.ndarray.INDArray prevOutputActivations,
                                                                     org.nd4j.linalg.api.ndarray.INDArray prevMemCellState,
                                                                     boolean forBackprop,
                                                                     boolean forwards,
                                                                     String inputWeightKey,
                                                                     org.nd4j.linalg.api.ndarray.INDArray maskArray,
                                                                     boolean hasPeepholeConnections)

Specified by:

activate in interface org.deeplearning4j.nn.layers.recurrent.LSTMHelper