tensorplay.nn.functional.glu

tensorplay.nn.functional.glu(input, dim=-1) → Tensor[source]

Gated Linear Unit: \(a * \sigma(b)\) where the input is split in half along dim.