Source: src/olm/nn/activations/silu.py:1
Classes
SiLU(inplace: bool = False, *, device=None, dtype=None) -> None
Bases: olm.nn.activations.base.ActivationBase
Source: src/olm/nn/activations/silu.py:7
SiLU (Swish) activation wrapper.
Methods
forward(self, x: torch.Tensor) -> torch.Tensor
Source: src/olm/nn/activations/silu.py:16
Swish(inplace: bool = False, *, device=None, dtype=None) -> None
Bases: olm.nn.activations.base.ActivationBase
Source: src/olm/nn/activations/silu.py:7
SiLU (Swish) activation wrapper.