LLaMA-Factory

Key Features

What the engine gives you out of the box, in plain language.

• OpenAI-Compatible API
• NVIDIA GPU
• AMD GPU
• Apple Silicon
• CPU Inference
• Quantization
• Continuous Batching
• Multi-GPU
• Desktop GUI
• One-Line Install
• Structured Output
• Streaming

• Wide model coverage

  Fine-tune a large catalogue of open language and vision-language models.

• Training web UI

  Set up and run training from a browser, no code required.

• Many tuning methods

  LoRA, QLoRA, full fine-tuning, and preference methods in one tool.

Where It Shines

The jobs this engine is best suited for.

• No-code fine-tuning

  Train a model through a UI instead of a script.

• Custom model on your data

  Adapt an open model to your task or domain.

• Comparing methods

  Try different tuning methods on the same model and data.

Frequently Asked Questions