- Services
The smallest Qwen-based Decision 1.0 model, built on Qwen3.5-0.8B with a decision head. It returns probability distributions for Choice, Noul and Score questions and can apply the same questions across a batch of inputs.
A situational 0.87B-parameter dense decision model from vLLM Semantic Router. Treat the modality benchmarks above as the leading indicator of fit — composite scoring across modalities is still maturing.
Generated from this model’s benchmarks and ranking signals. Editor reviews refine it over time.
Access model weights, configuration files, and documentation.
Benchmark data sourced from: Hugging Face, Arena.ai, Artificial Analysis.
The top devices for this model at 4-bit, ranked by fit and speed.
| Device | Grade | VRAM |
|---|---|---|
| ACEMAGIC M1A Pro (i9-13900HK + ARC A770)ACEMAGIC | SS | 1.1 GB |
| Acer Veriton GN100 AI MiniAcer | SS | 1.1 GB |
| AI TOP ATOM ATAGB10-9003Gigabyte | SS | 1.1 GB |
| AMD Instinct MI300XAMD | SS | 1.1 GB |
| AMD Instinct MI325XAMD | SS | 1.1 GB |
Explore the Provider
Aggregate stats, leaderboard, release timeline, and benchmark coverage across every vLLM Semantic Router model we track.
Cheapest current cloud rentals with at least 1 GB VRAM, refreshed hourly.
Advertising disclosure: we earn commissions when you shop through the links below.
| Option | Cost / GPU-hour |
|---|---|
NVIDIA GeForce RTX 3070RunPod · Community · 8 GB VRAM | $0.13 |
NVIDIA RTX A5000RunPod · Community · 24 GB VRAM | $0.16 |
NVIDIA GeForce RTX 3080RunPod · Community · 10 GB VRAM | $0.17 |
NVIDIA RTX A4000RunPod · Community · 16 GB VRAM | $0.17 |
NVIDIA GeForce RTX 3080 TiRunPod · Community · 12 GB VRAM | $0.18 |
Per-GPU rate across RunPod, the Vast.ai marketplace, DigitalOcean, and Vultr.
View on Hugging Face
