- Services
The smallest Qwen-based Decision 1.0 model, built on Qwen3.5-0.8B with a decision head. It returns probability distributions for Choice, Noul and Score questions and can apply the same questions across a batch of inputs.
A situational 0.87B-parameter dense decision model from vLLM Semantic Router. Treat the modality benchmarks above as the leading indicator of fit — composite scoring across modalities is still maturing. Newly released, so production-readiness is still being shaken out.
Generated from this model’s benchmarks and ranking signals. Editor reviews refine it over time.
Access model weights, configuration files, and documentation.
The top devices for this model at 4-bit, ranked by fit and speed.
| Device | Grade | VRAM |
|---|---|---|
| ACEMAGIC M1A Pro (i9-13900HK + ARC A770)ACEMAGIC | SS | 1.1 GB |
| Acer Veriton GN100 AI MiniAcer | SS | 1.1 GB |
| AMD Instinct MI300XAMD | SS | 1.1 GB |
| AMD Instinct MI325XAMD | SS | 1.1 GB |
| AMD Instinct MI355XAMD | SS | 1.1 GB |
Cheapest current cloud rentals with at least 1 GB VRAM, refreshed hourly.
Advertising disclosure: we earn commissions when you shop through the links below.
| Option | Cost / GPU-hour |
|---|---|
NVIDIA Tesla V100 16GBVast.ai · Spot · 16 GB VRAM | $0.05 |
NVIDIA GeForce RTX 3090Vast.ai · Spot · 24 GB VRAM | $0.07 |
NVIDIA GeForce RTX 5060 TiVast.ai · Spot · 16 GB VRAM | $0.07 |
NVIDIA GeForce RTX 4060 TiVast.ai · Spot · 8 GB VRAM | $0.07 |
NVIDIA GeForce RTX 4070Vast.ai · Spot · 12 GB VRAM | $0.08 |
Per-GPU rate across RunPod, the Vast.ai marketplace, DigitalOcean, and Vultr.
Spot tier is interruptible. Plan for restarts when comparing against on-demand prices.
Explore the Provider
Aggregate stats, leaderboard, release timeline, and benchmark coverage across every vLLM Semantic Router model we track.
Check which of your devices can run this model and how fast.
Compare hosted per-token prices before you commit to local hardware.
Break-even math for self-hosting, renting a GPU, or paying per token.
Live status for the hosted APIs you might use instead of running this locally.
View on Hugging Face