zai-org/GLM-5.3-Flash · Hugging Face
Key Points
- 1GLM-5.3-Flash is a 320B-parameter natively multimodal model that introduces a hybrid sparse-linear attention architecture to achieve superior efficiency and intelligence.
- 2By utilizing Manifold-Constrained Hyper-Connections and a massive 30T-token pre-training corpus, the model significantly reduces long-context serving costs while maintaining high performance.
- 3Empirical results demonstrate that the model outperforms its predecessors and approaches Claude Opus 4.8 capabilities in coding and agentic tasks at only a fraction of the cost.
GLM-5.3-Flash, presented in the technical report *“GLM-5: from Vibe Coding to Agentic Engineering,”* is a natively multimodal model representing the latest evolution of the GLM-5 series. It is designed to balance high-level intelligence with operational efficiency, featuring 320B total parameters and 18B active parameters, allowing it to compete with frontier models like Claude Opus 4.8 while significantly reducing inference costs.
Core Methodology and Architecture
The model introduces several architectural innovations to optimize performance and efficiency:- Hybrid Attention Architecture: GLM-5.3-Flash shifts away from standard dense attention mechanisms by employing a hybrid approach that integrates sparse and linear attention. This design is specifically engineered to mitigate the quadratic scaling costs associated with long-context processing, enabling the model to manage inputs up to 164K–400K tokens while maintaining structural precision.
- Manifold-Constrained Hyper-Connections (mHC): To enhance scaling efficiency, the architecture utilizes mHC. This method introduces constraints on the hidden state space during feature transformation, allowing for more effective knowledge representation across the 18B active parameters. By constraining the manifold, the model achieves more stable gradients and faster convergence during training on its massive 30T-token multimodal corpus.
- Efficiency-Focused Design: By utilizing a sparse-active framework (18B/320B), the model minimizes computational overhead. It achieves a significantly lower price point—at one-tenth the cost of its predecessors—without sacrificing capabilities in coding, agentic reasoning, or multimodal interpretation.
Benchmarking and Evaluation
The model’s performance is validated across a rigorous suite of agentic and technical benchmarks:- DeepSWE: Assessed using the *mini-swe-agent* harness with 400K context, achieving a score of 63.4.
- Terminal-Bench 2.1: Evaluated within the *Claude Code 2.1.207* environment, the model reached a score of 84.3 under a 6-hour timeout, showcasing its proficiency in complex terminal-based software engineering tasks.
- HLE (Hard Literature Evaluation): When configured with a 300K-context management strategy and full tool usage, the model achieved a score of 55.3, with evaluation conducted by GPT-5.6-luna as a judge.
Technical Implementation
The model demonstrates high adaptability in agentic scenarios through its native multimodal training. It implements specialized handling for diverse input types, such as high-resolution images (resized to at least 1.5K pixels on the shorter side) and complex tool-use workflows. The training recipe incorporates safety protocols, such as rule-based and LLM-based filtering in benchmarks like NL2Repo, to prevent malicious code execution (e.g., unauthorizedpip or curl commands) while maintaining a focus on autonomous agentic engineering. The architecture is supported by an ecosystem of deployment frameworks, including SGLang, vLLM, and KTransformers, facilitating efficient serving of its 321B-parameter (quantized/sharded) footprint.