DSPy

Key Features

What the engine gives you out of the box, in plain language.

• OpenAI-Compatible API
• NVIDIA GPU
• AMD GPU
• Apple Silicon
• CPU Inference
• Quantization
• Continuous Batching
• Multi-GPU
• Desktop GUI
• One-Line Install
• Structured Output
• Streaming

• Pipelines as code

  Define tasks as modules with clear inputs and outputs, not raw prompt strings.

• Automatic optimization

  Optimizers search for the prompts and few-shot examples that score best.

• Model-agnostic

  Run the same pipeline across different models and providers.

Where It Shines

The jobs this engine is best suited for.

• Improving agent quality

  Optimize the prompts behind an agent against a metric instead of guessing.

• Reproducible pipelines

  Treat prompt engineering as code you can test and version.

• Switching models cleanly

  Move a pipeline to a new model and re-optimize without a rewrite.

Frequently Asked Questions