Instructor

Key Features

What the engine gives you out of the box, in plain language.

• OpenAI-Compatible API
• NVIDIA GPU
• AMD GPU
• Apple Silicon
• CPU Inference
• Quantization
• Continuous Batching
• Multi-GPU
• Desktop GUI
• One-Line Install
• Structured Output
• Streaming

• Pydantic models

  Describe the output you want as a typed Python model.

• Validation and retries

  Re-asks the model automatically when output does not match.

• Many providers

  Use the same approach across OpenAI, Anthropic, and local models.

Where It Shines

The jobs this engine is best suited for.

• Reliable JSON output

  Extract structured data without writing parsing code.

• Tool and function calls

  Force arguments to match a defined schema.

• Data pipelines

  Feed downstream systems output that always fits the expected shape.

Frequently Asked Questions