Unsloth

Key Features

What the engine gives you out of the box, in plain language.

• OpenAI-Compatible API
• NVIDIA GPU
• AMD GPU
• Apple Silicon
• CPU Inference
• Quantization
• Continuous Batching
• Multi-GPU
• Desktop GUI
• One-Line Install
• Structured Output
• Streaming

• Faster training

  Optimized kernels cut fine-tuning time without hurting quality.

• Lower memory use

  4-bit training fits larger models onto smaller GPUs.

• Ready-made notebooks

  Start fine-tuning from a free notebook in minutes.

Where It Shines

The jobs this engine is best suited for.

• Custom model on your data

  Teach an open model your domain, tone, or task on a single GPU.

• Budget fine-tuning

  Train without renting a large multi-GPU cluster.

• Rapid iteration

  Test fine-tuning ideas quickly thanks to shorter training runs.

Frequently Asked Questions