GLM-5

Our Take

A workable 744B-parameter MoE language model from Z.ai. Pulls ahead on competition math (AIME 2026) (96/100), so reach for it when that's the dimension that matters.

Generated from this model’s benchmarks and ranking signals. Editor reviews refine it over time.

A standout technical feature is the integration of DeepSeek Sparse Attention (DSA). This mechanism is designed to reduce the computational overhead of the model’s 200,000-token context window. By optimizing how the model attends to distant tokens, DSA allows for more efficient processing of massive codebases or long technical documents without the exponential KV cache growth typically seen in standard dense transformers.

Z.ai utilized a custom asynchronous reinforcement learning infrastructure called "slime" to improve training throughput. This resulted in a model with high "intelligence efficiency," meaning it achieves better reasoning and coding performance per FLOP compared to its predecessors. The 200k context length is fully functional for retrieval and reasoning, making it a viable candidate for local RAG (Retrieval-Augmented Generation) over large private datasets.

GLM-5 is tuned for high-logic, low-fluff outputs. It excels in environments where the model must act as an autonomous agent rather than a simple chatbot.

• Agentic Engineering: Unlike models that plateau after a few turns, GLM-5 is optimized for long-horizon software development. This includes refactoring large modules, identifying architectural bottlenecks, and navigating complex dependencies in a codebase.
• Function Calling & Tool Use: With native support for structured JSON outputs and robust tool invocation, GLM-5 can be integrated into local agent loops to interact with file systems, APIs, and terminal environments.
• Complex Reasoning: The model’s reasoning benchmarks place it at the top of the open-source field, making it suitable for mathematical proofs, logical troubleshooting, and resource management simulations.
• Multilingual Proficiency: While the training data is vast, the model shows particular strength in English and Chinese, making it a preferred choice for global development teams.

Running a 744B parameter model locally is a significant engineering challenge that moves beyond standard consumer hardware. To run GLM-5 locally, you must account for the massive footprint of the weights.

The primary bottleneck is VRAM. Even with aggressive quantization, a 744B model is too large for a single or even dual RTX 4090 setup.

• FP16 (Original): ~1.5 TB of VRAM. Requires a multi-node H100/A100 cluster.
• Q4_K_M (Recommended): ~420 GB - 450 GB of VRAM. This is the "sweet spot" for maintaining intelligence while fitting on a single workstation. This typically requires a 8x A6000 (48GB) or 4x A100 (80GB) configuration.
• Q2_K (Minimum): ~240 GB - 260 GB of VRAM. Can potentially run on a Mac Studio with 192GB of Unified Memory (with heavy swapping) or a specialized multi-GPU head-less server.

For most practitioners, Q4_K_M (4-bit) is the target. Using anything lower than 3-bit quantization on an MoE model often leads to "expert collapse," where the routing logic degrades, and the model loses its reasoning edge. If you are constrained by VRAM, it is often better to run a smaller dense model (like Llama 3.1 70B) at high precision than GLM-5 at 2-bit.

• Ollama: The fastest way to pull the model is via ollama run glm-5. Note that Ollama will automatically attempt to offload layers to your GPU/System RAM, but performance will be sub-1 token/second if it spills into system DDR4/DDR5 memory.
• Tokens per Second: On a dedicated 8x A6000 setup using vLLM or GGUF (llama.cpp), expect between 5–15 tokens per second. The MoE architecture keeps the generation speed respectable despite the massive total parameter count.

GLM-5 sits in the "Ultra-Large" category. Its most direct competitors are DeepSeek-V3 and Llama 3.1 405B.

• GLM-5 vs. DeepSeek-V3: Both use MoE and Sparse Attention. GLM-5 generally shows a slight edge in "agentic" tasks—specifically those involving terminal-based interactions and multi-step planning—whereas DeepSeek-V3 is often cited for its raw coding speed and mathematical prowess.
• GLM-5 vs. Llama 3.1 405B: Llama 405B is a dense model, meaning every parameter is active during inference. While Llama may have more "crystallized" knowledge, GLM-5 is significantly faster to run once the VRAM hurdle is cleared, thanks to its 40B active parameter count.
• GLM-5 vs. GLM-4.5: GLM-5 is a substantial upgrade, scaling from 355B to 744B total parameters. The jump in active parameters (32B to 40B) and the 5.5T token increase in pre-training data results in noticeably fewer hallucinations in long-context windows.

For developers building local autonomous agents or private "Vibe Coding" environments, GLM-5 is currently the most capable MIT-licensed model available in the 700B+ parameter class.