Website Blog TensorPlay documentation

Automatic differentiation package - tensorplay.autograd Automatic Mixed Precision package - tensorplay.amp Distributed communication package - tensorplay.distributed Multiprocessing package - tensorplay.multiprocessing Quantization tensorplay tensorplay.audio tensorplay.compiler tensorplay.cuda tensorplay.fft tensorplay.futures tensorplay.hub tensorplay.library tensorplay.linalg tensorplay.nn tensorplay.nn.functional tensorplay.nn.init tensorplay.optim tensorplay.random tensorplay.sparse tensorplay.special tensorplay.stax tensorplay.utils.checkpoint tensorplay.utils.data tensorplay.vision Upstream anchor labels

AdaptiveAvgPool1d AdaptiveAvgPool2d AdaptiveAvgPool3d AdaptiveLogSoftmaxWithLoss AdaptiveMaxPool1d AdaptiveMaxPool2d AdaptiveMaxPool3d AlphaDropout AvgPool1d AvgPool2d AvgPool3d BatchNorm1d BatchNorm3d BCELoss BCEWithLogitsLoss Bilinear Buffer CELU ChannelShuffle CircularPad1d CircularPad2d CircularPad3d ConstantPad1d ConstantPad2d ConstantPad3d Conv1d Conv2d Conv3d ConvTranspose1d ConvTranspose2d ConvTranspose3d CosineEmbeddingLoss CosineSimilarity CrossEntropyLoss CTCLoss DataParallel DepthwiseConv2d DistributedDataParallel Dropout Dropout1d Dropout2d Dropout3d DType ELU Embedding EmbeddingBag FeatureAlphaDropout Flatten Fold FractionalMaxPool2d FractionalMaxPool3d GaussianNLLLoss GLU GroupNorm GRU GRUCell Hardshrink Hardsigmoid Hardswish Hardtanh HingeEmbeddingLoss HuberLoss Identity InstanceNorm1d InstanceNorm2d InstanceNorm3d KLDivLoss L1Loss LayerNorm LazyBatchNorm1d LazyBatchNorm2d LazyBatchNorm3d LazyConv1d LazyConv2d LazyConv3d LazyConvTranspose1d LazyConvTranspose2d LazyConvTranspose3d LazyInstanceNorm1d LazyInstanceNorm2d LazyInstanceNorm3d LazyLinear LazyModuleMixin LeakyReLU Linear LocalResponseNorm LogSigmoid LogSoftmax LPPool1d LPPool2d LPPool3d LSTM LSTMCell MarginRankingLoss MaxPool1d MaxPool2d MaxPool3d MaxUnpool1d MaxUnpool2d MaxUnpool3d Mish Module ModuleDict ModuleList MSELoss MultiheadAttention MultiLabelMarginLoss MultiLabelSoftMarginLoss MultiMarginLoss NLLLoss NonDynamicallyQuantizableLinear PackedSequence PairwiseDistance Parameter ParameterDict ParameterList PixelShuffle PixelUnshuffle PoissonNLLLoss PReLU ReflectionPad1d ReflectionPad2d ReflectionPad3d ReLU ReLU6 ReplicationPad1d ReplicationPad2d ReplicationPad3d RMSNorm RNN RNNBase RNNCell RNNCellBase RReLU SELU Sequential Sigmoid SiLU SmoothL1Loss SoftMarginLoss Softmax Softmin Softplus Softshrink Softsign SyncBatchNorm Tanh Tanhshrink Tensor tensorplay.nn.factory_kwargs tensorplay.nn.functional.adaptive_avg_pool1d tensorplay.nn.functional.adaptive_avg_pool2d tensorplay.nn.functional.adaptive_avg_pool3d tensorplay.nn.functional.adaptive_max_pool1d tensorplay.nn.functional.adaptive_max_pool1d_with_indices tensorplay.nn.functional.adaptive_max_pool2d tensorplay.nn.functional.adaptive_max_pool2d_with_indices tensorplay.nn.functional.adaptive_max_pool3d_with_indices tensorplay.nn.functional.affine_grid tensorplay.nn.functional.alpha_dropout tensorplay.nn.functional.avg_pool1d tensorplay.nn.functional.avg_pool2d tensorplay.nn.functional.avg_pool3d tensorplay.nn.functional.batch_norm tensorplay.nn.functional.bilinear tensorplay.nn.functional.binary_cross_entropy tensorplay.nn.functional.channel_shuffle tensorplay.nn.functional.conv_tbc tensorplay.nn.functional.conv_transpose1d tensorplay.nn.functional.conv_transpose2d tensorplay.nn.functional.conv_transpose3d tensorplay.nn.functional.conv1d tensorplay.nn.functional.conv2d tensorplay.nn.functional.conv3d tensorplay.nn.functional.cosine_embedding_loss tensorplay.nn.functional.cosine_similarity tensorplay.nn.functional.cross_entropy tensorplay.nn.functional.ctc_loss tensorplay.nn.functional.dropout tensorplay.nn.functional.dropout1d tensorplay.nn.functional.dropout2d tensorplay.nn.functional.dropout3d tensorplay.nn.functional.elu tensorplay.nn.functional.embedding tensorplay.nn.functional.embedding_bag tensorplay.nn.functional.feature_alpha_dropout tensorplay.nn.functional.flatten tensorplay.nn.functional.fold tensorplay.nn.functional.fractional_max_pool2d tensorplay.nn.functional.fractional_max_pool2d_with_indices tensorplay.nn.functional.fractional_max_pool3d tensorplay.nn.functional.fractional_max_pool3d_with_indices tensorplay.nn.functional.gaussian_nll_loss tensorplay.nn.functional.gelu tensorplay.nn.functional.glu tensorplay.nn.functional.grid_sample tensorplay.nn.functional.group_norm tensorplay.nn.functional.grouped_mm tensorplay.nn.functional.gumbel_softmax tensorplay.nn.functional.hardshrink tensorplay.nn.functional.hardsigmoid tensorplay.nn.functional.hardswish tensorplay.nn.functional.hardtanh tensorplay.nn.functional.hinge_embedding_loss tensorplay.nn.functional.huber_loss tensorplay.nn.functional.instance_norm tensorplay.nn.functional.interpolate tensorplay.nn.functional.kl_div tensorplay.nn.functional.l1_loss tensorplay.nn.functional.layer_norm tensorplay.nn.functional.leaky_relu tensorplay.nn.functional.linear tensorplay.nn.functional.linear_cross_entropy tensorplay.nn.functional.local_response_norm tensorplay.nn.functional.log_softmax tensorplay.nn.functional.logsigmoid tensorplay.nn.functional.lp_pool1d tensorplay.nn.functional.lp_pool2d tensorplay.nn.functional.lp_pool3d tensorplay.nn.functional.margin_ranking_loss tensorplay.nn.functional.max_pool1d tensorplay.nn.functional.max_pool1d_with_indices tensorplay.nn.functional.max_pool2d tensorplay.nn.functional.max_pool2d_with_indices tensorplay.nn.functional.max_pool3d tensorplay.nn.functional.max_pool3d_with_indices tensorplay.nn.functional.max_unpool1d tensorplay.nn.functional.max_unpool2d tensorplay.nn.functional.max_unpool3d tensorplay.nn.functional.mish tensorplay.nn.functional.mse_loss tensorplay.nn.functional.multi_head_attention_forward tensorplay.nn.functional.multi_margin_loss tensorplay.nn.functional.multilabel_margin_loss tensorplay.nn.functional.multilabel_soft_margin_loss tensorplay.nn.functional.native_channel_shuffle tensorplay.nn.functional.nll_loss tensorplay.nn.functional.normalize tensorplay.nn.functional.one_hot tensorplay.nn.functional.pad tensorplay.nn.functional.pairwise_distance tensorplay.nn.functional.pdist tensorplay.nn.functional.pixel_shuffle tensorplay.nn.functional.pixel_unshuffle tensorplay.nn.functional.poisson_nll_loss tensorplay.nn.functional.prelu tensorplay.nn.functional.relu tensorplay.nn.functional.relu6 tensorplay.nn.functional.rms_norm tensorplay.nn.functional.rrelu tensorplay.nn.functional.scaled_dot_product_attention tensorplay.nn.functional.scaled_grouped_mm tensorplay.nn.functional.scaled_mm tensorplay.nn.functional.selu tensorplay.nn.functional.sigmoid tensorplay.nn.functional.silu tensorplay.nn.functional.smooth_l1_loss tensorplay.nn.functional.soft_margin_loss tensorplay.nn.functional.softmax tensorplay.nn.functional.softmin tensorplay.nn.functional.softplus tensorplay.nn.functional.softshrink tensorplay.nn.functional.softsign tensorplay.nn.functional.tanh tensorplay.nn.functional.tanhshrink tensorplay.nn.functional.threshold tensorplay.nn.functional.triplet_margin_loss tensorplay.nn.functional.triplet_margin_with_distance_loss tensorplay.nn.functional.unfold tensorplay.nn.functional.upsample tensorplay.nn.functional.upsample_bilinear tensorplay.nn.functional.upsample_nearest tensorplay.nn.init.calculate_gain tensorplay.nn.init.constant_tensorplay.nn.init.dirac_tensorplay.nn.init.eye_tensorplay.nn.init.kaiming_normal_tensorplay.nn.init.kaiming_uniform_tensorplay.nn.init.normal_tensorplay.nn.init.ones_tensorplay.nn.init.orthogonal_tensorplay.nn.init.sparse_tensorplay.nn.init.trunc_normal_tensorplay.nn.init.uniform_tensorplay.nn.init.xavier_normal_tensorplay.nn.init.xavier_uniform_tensorplay.nn.init.zeros_tensorplay.nn.modules.module.register_module_backward_hook tensorplay.nn.modules.module.register_module_buffer_registration_hook tensorplay.nn.modules.module.register_module_forward_hook tensorplay.nn.modules.module.register_module_forward_pre_hook tensorplay.nn.modules.module.register_module_full_backward_hook tensorplay.nn.modules.module.register_module_full_backward_pre_hook tensorplay.nn.modules.module.register_module_module_registration_hook tensorplay.nn.modules.module.register_module_parameter_registration_hook tensorplay.nn.parameter.is_lazy tensorplay.nn.utils.rnn.invert_permutation tensorplay.nn.utils.rnn.pack_padded_sequence tensorplay.nn.utils.rnn.pack_sequence tensorplay.nn.utils.rnn.pad_packed_sequence tensorplay.nn.utils.rnn.pad_sequence tensorplay.nn.utils.rnn.unpack_sequence tensorplay.nn.utils.rnn.unpad_sequence Threshold Transformer TransformerDecoder TransformerDecoderLayer TransformerEncoder TransformerEncoderLayer TripletMarginLoss TripletMarginWithDistanceLoss Unflatten Unfold UninitializedBuffer UninitializedParameter Upsample UpsamplingBilinear2d UpsamplingNearest2d ZeroPad1d ZeroPad2d ZeroPad3d

API symbolsnn

Copy

View Markdown Download .md

tensorplay.nn.functional.tanhshrink

tensorplay.nn.functional.tanhshrink(input) → Tensor[source]

Applies element-wise, \(\text{Tanhshrink}(x) = x - \text{Tanh}(x)\)

See Tanhshrink for more details.

Help improve this page

Found an error, an unclear step, or a missing example?

Was this page helpful?

Suggest an edit Report an issue

tensorplay.nn.functional.tanh

Applies element-wise \(\text{Tanh}(x) = \frac{\exp(x) - \exp(-x)}{\exp(x) + \exp(-x)}\)

tensorplay.nn.functional.threshold

Apply a threshold to each element of the input Tensor.