API symbolsnn
Copy
tensorplay.nn.functional.rrelu
- tensorplay.nn.functional.rrelu(input, lower=1. / 8, upper=1. / 3, training=False, inplace=False) Tensor[source]
Randomized leaky ReLU.
See
RReLUfor more details.
Help improve this page
Found an error, an unclear step, or a missing example?
Was this page helpful?
tensorplay.nn.functional.rms_norm
Apply Root Mean Square Layer Normalization — composed per the ATen rms_norm composite (fp32 compute for reduced dtypes).
tensorplay.nn.functional.scaled_dot_product_attention
scaled_dot_product_attention(query, key, value, attn_mask=None, dropout_p=0.0, is_causal=False, scale=None, backend=None) -> Tensor