Qwen 3 Next 80b

Qwen 3 Next 80b is the first release in Alibaba's Qwen3-Next architecture line, an 80-billion-parameter Mixture-of-Experts model that activates roughly 3 billion parameters per token, drastically reducing FLOPs while preserving capacity. Its defining feature is a hybrid attention design combining Gated DeltaNet with Gated Attention, paired with a high-sparsity MoE and multi-token prediction for faster, cheaper inference on long inputs. Released under Apache 2.0, it ships with a native 256K context window and supports function calling and web search.

Compared with the broader Qwen3 generation, Alibaba reports meaningful efficiency gains. The team states the underlying base model reaches performance comparable to—or slightly better than—the dense Qwen3-32B while using less than 10% of its training GPU hours. On the long-context RULER benchmark, Alibaba reports that the Instruct version outperforms the earlier Qwen3 30B A3B across all tested lengths, and even surpasses the flagship Qwen 3 235B A22B Instruct 2507 within 256K context.

This positions Qwen 3 Next 80b as the efficiency-focused step in the family, trading the dense scaling of older Qwen3 models for a sparser, architecturally novel approach. Venice serves it at fp16, optimized for speed, with the weights also deployable through common engines such as vLLM and SGLang.

The model exists in two post-trained forms in Alibaba's release—an instruct variant for chat and agents and a separate thinking variant for complex reasoning—both sharing the same hybrid attention and MoE backbone. Within this catalog it is the newest entry in its architecture family, sitting alongside many other Qwen-derived text, image, and embedding siblings.

Sources

qwen / qwen3-next-80b-a3b-thinking· docs.api.nvidia.comqwen3-next-80b-a3b-instruct Model by Qwen· build.nvidia.comQwen3-Next-80B-A3B-Instruct· qwen.aiQwen/Qwen3-Next-80B-A3B-Instruct · Hugging Face· huggingface.co

This About section is AI-generated from public sources via VeniceStats + Venice inference, with no human editing. It may contain inaccuracies.