MicrosoftReleased April 15, 2024

WizardLM-2 8x22B

Open Source176B (39B active) parameters

Context

64K

Input

Free (open)

Key Specifications

🏆

Arena Rank

Not disclosed

📐

Context Window

64K

📥

Input Price

per 1M tokens

Free (open)

📤

Output Price

per 1M tokens

Free (open)

🧠

Parameters

176B (39B active)

🔓

Open Source

Yes

Best For

Complex instructionsreasoningcoding

About WizardLM-2 8x22B

WizardLM-2 8x22B is Microsoft's instruction-tuned mixture-of-experts model built on Mixtral 8x22B. It uses advanced training techniques to significantly boost instruction-following and reasoning capabilities beyond the base model. At launch, it was among the strongest open models for complex multi-step instructions and competitive coding tasks.

Built byMicrosoft

Pricing per 1M tokens

Input Tokens

Free (open)

Output Tokens

Free (open)

Frequently Asked Questions

What is WizardLM-2 8x22B?
WizardLM-2 8x22B is Microsoft's instruction-tuned mixture-of-experts model built on Mixtral 8x22B. It uses advanced training techniques to significantly boost instruction-following and reasoning capabilities beyond the base model. At launch, it was among the strongest open models for complex multi-step instructions and competitive coding tasks.
How much does WizardLM-2 8x22B cost?
WizardLM-2 8x22B costs Free (open) per 1 million input tokens and Free (open) per 1 million output tokens. Pricing is based on token usage, making it cost-effective for both small and large-scale applications.
What is WizardLM-2 8x22B's context window?
WizardLM-2 8x22B has a context window of 64K tokens. This determines how much text the model can process in a single request — larger context windows allow the model to handle longer documents, maintain more conversation history, and reason over bigger codebases.
Is WizardLM-2 8x22B open source?
Yes, WizardLM-2 8x22B is open source. This means the model weights are publicly available, allowing developers and organizations to download, fine-tune, and self-host the model on their own infrastructure. Open-source models offer greater flexibility and data privacy control.
What is WizardLM-2 8x22B best for?
WizardLM-2 8x22B is best suited for: Complex instructions, reasoning, coding. These use cases leverage the model's specific strengths in terms of capability, speed, and cost-effectiveness within Microsoft's model lineup.