`olm.nn.activations.glu`

Source: src/olm/nn/activations/glu.py:1

Classes

GLU(dim: int = -1, *, device=None, dtype=None) -> None

Bases: olm.nn.activations.base.ActivationBase

Source: src/olm/nn/activations/glu.py:7

GLU activation wrapper.

Methods

forward(self, x: torch.Tensor) -> torch.Tensor

Source: src/olm/nn/activations/glu.py:14