TensorPlay
API symbolsnn
Copy
View MarkdownDownload .md

tensorplay.nn.functional.gelu

tensorplay.nn.functional.gelu(input, approximate='none') → Tensor[source]

When approximate is ‘none’, applies \(\text{GELU}(x) = x * \Phi(x)\); ‘tanh’ uses the tanh estimation.

tensorplay.nn.functional.gaussian_nll_loss

Compute the Gaussian negative log likelihood loss.

tensorplay.nn.functional.glu

Gated Linear Unit: \(a * \sigma(b)\) where the input is split in half along dim .

Ask DeepWiki