FW-Qwen3.5-122B-A10B

Models available for use with Fireworks on Foundry deliver optimized, best-in-class performance on the Fireworks Inference Cloud. Fireworks on Foundry is a Non-Microsoft Product. The following terms apply to a Customer's use of Fireworks on Foundry: When you use Fireworks on Foundry, data is shared between Microsoft and Fireworks AI, Customer Data will be sent outside of Microsoft systems, Customer Data will not be processed pursuant to any Foundry data residency documentation, and different compliance and data handling rules will apply. See Trust Center - Fireworks AI for details. Customers are responsible for evaluating whether data sharing between Microsoft and Fireworks is appropriate for their organization's compliance requirements.

About this model

Qwen3.5 122B A10B is Alibaba's mid-size Mixture-of-Experts vision-language model with 122 billion total parameters, activating 10 billion per token for efficient inference. It features the same hybrid architecture as Qwen3.5-397B-A17B, combining Gated Delta Networks with sparse MoE for high-throughput inference with minimal latency. Qwen3.5 is a unified vision-language foundation model — early fusion training on multimodal tokens achieves cross-generational parity with Qwen3 and outperforms Qwen3-VL models across reasoning, coding, agents, and visual understanding. It supports 201 languages and dialects, with a native context length of 262,144 tokens extensible up to 1,010,000 tokens via YaRN.

Key model capabilities

• Unified Vision-Language Foundation: text, image, and video understanding in a single model
• Mixture of Experts architecture: 122B total parameters with 10B activated per token (256 experts, 8 routed + 1 shared)
• Gated Delta Networks combined with sparse MoE for efficient inference
• Native 262K context, extensible to 1M+ tokens via YaRN
• Thinking mode with configurable enable/disable
• Multi-Token Prediction (MTP) support
• Multilingual support (201 languages and dialects)
• Function calling, tool use, and agentic workflows
• Streaming support