Axolotl

Key Features

What the engine gives you out of the box, in plain language.

• OpenAI-Compatible API
• NVIDIA GPU
• AMD GPU
• Apple Silicon
• CPU Inference
• Quantization
• Continuous Batching
• Multi-GPU
• Desktop GUI
• One-Line Install
• Structured Output
• Streaming

• Config-driven training

  Define the model, data, and method in one YAML file.

• Efficient methods

  Built-in support for LoRA, QLoRA, and full fine-tuning.

• Multi-GPU training

  Scale runs with FSDP and DeepSpeed when one GPU is not enough.

Where It Shines

The jobs this engine is best suited for.

• Custom model on your data

  Adapt an open model to your domain, tone, or task.

• Repeatable training

  Version a config so a run can be reproduced later.

• Trying fine-tuning methods

  Switch between LoRA, QLoRA, and full tuning by editing config.

Frequently Asked Questions