Microsoft

WizardLM-2 8x22B

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...

Context window
66Ktokens
Max output
8Ktokens
Input
$0.62/ 1M
Output
$0.62/ 1M

Quick start

from openai import OpenAI

client = OpenAI(
    base_url="https://neurongate.net/v1",
    api_key="sk-ng-your-api-key",
)

completion = client.chat.completions.create(
    model="microsoft/wizardlm-2-8x22b",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(completion.choices[0].message.content)

Cost

Example requestTokensCost
Short prompt1K in$0.00062
Typical chat turn1K in · 500 out$0.00093
Document analysis10K in · 2K out$0.00744
Long context100K in · 10K out$0.0682
Estimated cost per request$0.00093

Prices in USD. Billed per token actually used, from a balance prepaid in USDT, USDC, ETH or BTC.

Frequently asked questions

What is WizardLM-2 8x22B?

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...

How much does WizardLM-2 8x22B cost?

WizardLM-2 8x22B is priced at $0.62 per 1 million input tokens and $0.62 per 1 million output tokens when accessed via NeuronGate. You pay per token — no subscriptions required. Top up with crypto (USDT, USDC, ETH, BTC).

Does WizardLM-2 8x22B support streaming?

Yes, WizardLM-2 8x22B supports streaming responses via NeuronGate's API. Use the standard "stream": true parameter in your request.

What is the context window of WizardLM-2 8x22B?

WizardLM-2 8x22B has a context window of 66K tokens (~49K words). Maximum output is 8K tokens.

Does WizardLM-2 8x22B support function calling (tools)?

WizardLM-2 8x22B does not currently support function calling / tool use.

How do I use WizardLM-2 8x22B with NeuronGate?

Create a NeuronGate account, top up your balance with crypto, generate an API key, and use the model id microsoft/wizardlm-2-8x22b in your requests. NeuronGate uses the OpenAI-compatible API format — set your base URL to https://neurongate.net/v1.