OLM API Reference

Models API

Implemented transformer model families and presets.

Modules

ModulePublic API
olm.modelsGPT2, GPT2Large, GPT2Medium, GPT2Model, GPT2XL, Gemma2Model, Gemma2_27B, Gemma2_2B, +28 more
olm.models.alibabaQwen2Model, Qwen2_5_0_5B, Qwen2_5_14B, Qwen2_5_1_5B, Qwen2_5_32B, Qwen2_5_3B, Qwen2_5_72B, Qwen2_5_7B
olm.models.alibaba.qwen2Qwen2Block, Qwen2Model, Qwen2_5_0_5B, Qwen2_5_14B, Qwen2_5_1_5B, Qwen2_5_32B, Qwen2_5_3B, Qwen2_5_72B, +1 more
olm.models.allenaiOLMoModel, OLMo_7B
olm.models.allenai.olmoOLMoBlock, OLMoModel, OLMo_7B
olm.models.facebookOPT125M, OPTModel
olm.models.facebook.optOPT125M, OPTBlock, OPTModel
olm.models.googleGemma2Model, Gemma2_27B, Gemma2_2B, Gemma2_9B
olm.models.google.gemma2Gemma2Block, Gemma2Embedding, Gemma2FinalLogitSoftcap, Gemma2Model, Gemma2_27B, Gemma2_2B, Gemma2_9B
olm.models.metaLlama2Model, Llama2_13B, Llama2_70B, Llama2_7B, Llama3Model, Llama3_1_405B, Llama3_1_70B, Llama3_1_8B, +2 more
olm.models.meta.llama2Llama2Block, Llama2Model, Llama2_13B, Llama2_70B, Llama2_7B
olm.models.meta.llama3Llama3Block, Llama3Model, Llama3_1_405B, Llama3_1_70B, Llama3_1_8B, Llama3_2_1B, Llama3_2_3B
olm.models.microsoftPhi3Model, Phi3_5_Mini, Phi3_Small, Phi4Model, Phi4_14B
olm.models.microsoft.phi3Phi3Block, Phi3Model, Phi3_5_Mini, Phi3_Small
olm.models.microsoft.phi4Phi4Block, Phi4Model, Phi4_14B
olm.models.openaiGPT2, GPT2Large, GPT2Medium, GPT2Model, GPT2XL
olm.models.openai.gpt2GPT2, GPT2Block, GPT2Large, GPT2Medium, GPT2Model, GPT2XL