olm.nn.activations.mish¶
Classes¶
Mish(*args, **kwargs) |
Mish activation wrapper. |
|---|---|
class olm.nn.activations.mish.ActivationBase(*args: Any, **kwargs: Any)¶
Bases: Module, ABC
Abstract base class for all activation functions.
Ensures a consistent interface for activation layers, handling device and dtype initialization. Subclasses must implement the forward method.
device¶
The device the module is on.
- Type: torch.device, optional
dtype¶
The data type of the module parameters.
- Type: torch.dtype
abstractmethod forward(x: torch.Tensor) → torch.Tensor¶
Apply activation to x.
class olm.nn.activations.mish.Mish(*args: Any, **kwargs: Any)¶
Bases: ActivationBase
Mish activation wrapper.
forward(x: torch.Tensor) → torch.Tensor¶
Apply activation to x.