OLM Models

Readable PyTorch Model Families

OLM model presets are not hidden runtimes. Each family links to the source file that assembles the architecture from public blocks.

GPT-2

GPT2 · GPT2Medium · GPT2Large · GPT2XL

View source ↗Llama 2

Llama2_7B · Llama2_13B · Llama2_70B

View source ↗Llama 3.x

Llama3_1_8B · Llama3_1_70B · Llama3_1_405B · Llama3_2_1B · Llama3_2_3B

View source ↗Qwen 2.5

0.5B · 1.5B · 3B · 7B · 14B · 32B · 72B

View source ↗Phi-3

Phi3_5_Mini · Phi3_Small

View source ↗Phi-4

Phi4_14B

View source ↗Gemma 2

Gemma2_2B · Gemma2_9B · Gemma2_27B

View source ↗OLMo

OLMo_7B

View source ↗OPT

OPT125M

View source ↗

For the concepts behind these implementations, read the Modern Language Modelling guide.