4B parameter highly distilled flow transformer optimized for interactive applications. Runs in <10GB VRAM with 4-step inference.
A workable 4B-parameter dense image generator from Black Forest Labs. Treat the modality benchmarks above as the leading indicator of fit — composite scoring across modalities is still maturing.
Generated from this model’s benchmarks and ranking signals. Editor reviews refine it over time.
No benchmark data available for this model yet.
See which devices can run this model and at what quality level.
FLUX.2 [klein] 4B is the highly efficient, distilled entry point into Black Forest Labs' second-generation image generation ecosystem. Unlike its larger predecessors, the 4B variant is purpose-built for low-latency, interactive applications where sub-second inference is required. By utilizing a rectified flow transformer architecture and a 4-step distillation process, it bridges the gap between high-fidelity diffusion models and real-time performance. For developers, the most significant shift is the license: FLUX.2 [klein] 4B ships under Apache 2.0, providing a fully open path for commercial deployment and fine-tuning without the restrictive terms found in earlier FLUX.1 non-commercial releases.
This model occupies a unique niche in the local AI hardware landscape. It is small enough to run on mid-range consumer GPUs while maintaining the structural coherence and prompt adherence that Black Forest Labs is known for. It competes directly with models like SDXL Turbo and the smaller AuraFlow variants, but offers a more modern unified architecture that handles text-to-image, image-to-image, and multi-reference editing within a single weight set.
The FLUX.2 [klein] 4B architecture is a dense rectified flow transformer consisting of 4 billion parameters. While it is significantly smaller than the 9B or 12B variants in the family, it retains the same core architectural logic, coupling the transformer with Mistral-3's 24B vision-language model (VLM) for advanced world knowledge and complex prompt comprehension.
FLUX.2 [klein] 4B is designed for speed and versatility. It excels in "human-in-the-loop" workflows where immediate feedback is necessary. Because it supports multi-reference editing and image-to-image tasks natively, it is not just a generator but a comprehensive tool for local asset pipelines.
The sub-second inference speed allows developers to build "generate-as-you-type" interfaces. This is particularly useful for rapid prototyping or creative brainstorming tools where the latency of a cloud API or a larger local model would break the user's flow.
With its Apache 2.0 license, this model is the primary candidate for local software integrations. Whether it is a photo editing plugin or a local game asset generator, the 4B parameter size ensures that the application remains responsive even when sharing VRAM with other processes.
The base version of the 4B model is specifically optimized for fine-tuning. Because of the smaller parameter count, practitioners can train LoRAs or perform full-parameter fine-tuning on consumer hardware (24GB VRAM) much faster and more cheaply than they could with the 9B or 12B versions.
To run FLUX.2 [klein] 4B locally, the primary constraint is VRAM. While the model is compact, the unified architecture—including the VLM and the T5 text encoder—requires careful memory management.
On an NVIDIA RTX 4090, you can expect the distilled 4-step version to produce images in approximately 1.5 to 2 seconds. On the Apple Silicon side, an M3 Max or M4 Max with 64GB of Unified Memory provides a seamless experience, handling the weights and the KV cache without aggressive swapping.
The quickest way to get started is via the diffusers library or ComfyUI. For those looking to maximize efficiency, Q4_K_M GGUF quantization is the recommended "sweet spot," reducing the VRAM footprint to roughly 6-7 GB for the weights alone with negligible loss in image quality. If you are using a card with 8GB VRAM, quantization is mandatory to avoid OOM (Out of Memory) errors.
When evaluating FLUX.2 [klein] 4B, it is most often compared to Stable Diffusion XL (SDXL) Turbo and SD3.5 Medium.
The choice to run FLUX.2 [klein] 4B locally usually comes down to the need for speed and the Apache 2.0 license. If you need a model that you can legally bake into a commercial product and run on a mid-range consumer GPU with sub-2-second latency, this is currently the industry standard.