Hugging Face Transformers

Key Features

What the engine gives you out of the box, in plain language.

• OpenAI-Compatible API
• NVIDIA GPU
• AMD GPU
• Apple Silicon
• CPU Inference
• Quantization
• Continuous Batching
• Multi-GPU
• Desktop GUI
• One-Line Install
• Structured Output
• Streaming

• Pipelines

  A one-line helper to run common tasks like generation or classification.

• Huge model hub

  Load from hundreds of thousands of models on the Hugging Face hub.

• Broad hardware support

  Run on CPU, CUDA, ROCm, or Apple Silicon with the same API.

Where It Shines

The jobs this engine is best suited for.

• One-shot Python scripts

  Load a model and generate text in a notebook or short script.

• Research and experimentation

  Try new models the day they land on the hub.

• Custom inference code

  Build bespoke generation logic when packaged servers do not fit.

Frequently Asked Questions