Trainers, callbacks, optimizers, schedules, and device selection.
Modules
| Module | Public API |
|---|---|
olm.train | AdamW, CheckpointCallback, CosineAnnealingLR, CrossEntropyLoss, DDPTrainer, DeviceConfig, EarlyStoppingCallback, FSDPTrainer, +25 more |
olm.train.callbacks | CheckpointCallback, EarlyStoppingCallback, LRMonitorCallback, MetricsLoggerCallback, ThroughputCallback, ValidationCallback |
olm.train.callbacks.checkpoint_cb | CheckpointCallback |
olm.train.callbacks.early_stopping_cb | EarlyStoppingCallback |
olm.train.callbacks.lr_monitor_cb | LRMonitorCallback |
olm.train.callbacks.metrics_logger_cb | MetricsLoggerCallback |
olm.train.callbacks.throughput_cb | ThroughputCallback |
olm.train.callbacks.validation_cb | ValidationCallback |
olm.train.device | DeviceConfig, TrainerStrategy, detect_devices, determine_strategy, estimate_model_size, parse_device_string, print_strategy_summary |
olm.train.losses | CrossEntropyLoss, KLLoss, LossBase, MaskedCELoss, ZLoss |
olm.train.losses.base | LossBase |
olm.train.losses.cross_entropy | CrossEntropyLoss |
olm.train.losses.kllloss | KLLoss |
olm.train.losses.mce | MaskedCELoss |
olm.train.losses.zloss | ZLoss |
olm.train.optim | AdamW, Lion, OptimizerBase, ZeROOptimizer |
olm.train.optim.adamw | AdamW |
olm.train.optim.base | OptimizerBase |
olm.train.optim.lion | Lion |
olm.train.optim.zero | ZeROOptimizer |
olm.train.schedulers | CosineAnnealingLR, LinearDecayLR, LinearLR, SchedulerBase, WarmupCosineScheduler, WarmupLR |
olm.train.schedulers.base | SchedulerBase |
olm.train.schedulers.cosine | CosineAnnealingLR |
olm.train.schedulers.linear | LinearDecayLR, LinearLR |
olm.train.schedulers.warmup | WarmupCosineScheduler, WarmupLR |
olm.train.trainer | CheckpointCallback, DDPTrainer, EarlyStoppingCallback, FSDPTrainer, LRMonitorCallback, MetricsLoggerCallback, ThroughputCallback, Trainer, +4 more |
olm.train.trainer.auto_trainer | AutoTrainer, auto_trainer |
olm.train.trainer.ddp_trainer | DDPTrainer |
olm.train.trainer.fsdp_trainer | FSDPTrainer |
olm.train.trainer.trainer | Trainer, TrainerCallback |