Meta

Meta Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Context window
131Ktokens
Max output
8Ktokens
Input
$0.72/ 1M
Output
$0.72/ 1M

Quick start

from openai import OpenAI

client = OpenAI(
    base_url="https://neurongate.net/v1",
    api_key="sk-ng-your-api-key",
)

completion = client.chat.completions.create(
    model="meta-llama/llama-3.1-70b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(completion.choices[0].message.content)

Cost

Example requestTokensCost
Short prompt1K in$0.00072
Typical chat turn1K in · 500 out$0.00108
Document analysis10K in · 2K out$0.00864
Long context100K in · 10K out$0.0792
Estimated cost per request$0.00108

Prices in USD. Billed per token actually used, from a balance prepaid in USDT, USDC, ETH or BTC.

Frequently asked questions

What is Meta Llama 3.1 70B Instruct?

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

How much does Meta Llama 3.1 70B Instruct cost?

Meta Llama 3.1 70B Instruct is priced at $0.72 per 1 million input tokens and $0.72 per 1 million output tokens when accessed via NeuronGate. You pay per token — no subscriptions required. Top up with crypto (USDT, USDC, ETH, BTC).

Does Meta Llama 3.1 70B Instruct support streaming?

Yes, Meta Llama 3.1 70B Instruct supports streaming responses via NeuronGate's API. Use the standard "stream": true parameter in your request.

What is the context window of Meta Llama 3.1 70B Instruct?

Meta Llama 3.1 70B Instruct has a context window of 131K tokens (~98K words). Maximum output is 8K tokens.

Does Meta Llama 3.1 70B Instruct support function calling (tools)?

Yes, Meta Llama 3.1 70B Instruct supports function calling / tool use via NeuronGate's standard API.

How do I use Meta Llama 3.1 70B Instruct with NeuronGate?

Create a NeuronGate account, top up your balance with crypto, generate an API key, and use the model id meta-llama/llama-3.1-70b-instruct in your requests. NeuronGate uses the OpenAI-compatible API format — set your base URL to https://neurongate.net/v1.