Meta

Meta Llama 3 70B Instruct

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...

Context window
8Ktokens
Max output
8Ktokens
Input
$0.51/ 1M
Output
$0.74/ 1M

Quick start

from openai import OpenAI

client = OpenAI(
    base_url="https://neurongate.net/v1",
    api_key="sk-ng-your-api-key",
)

completion = client.chat.completions.create(
    model="meta-llama/llama-3-70b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(completion.choices[0].message.content)

Cost

Example requestTokensCost
Short prompt1K in$0.00051
Typical chat turn1K in · 500 out$0.00088
Document analysis10K in · 2K out$0.00658
Long context100K in · 10K out$0.0584
Estimated cost per request$0.00088

Prices in USD. Billed per token actually used, from a balance prepaid in USDT, USDC, ETH or BTC.

Frequently asked questions

What is Meta Llama 3 70B Instruct?

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...

How much does Meta Llama 3 70B Instruct cost?

Meta Llama 3 70B Instruct is priced at $0.51 per 1 million input tokens and $0.74 per 1 million output tokens when accessed via NeuronGate. You pay per token — no subscriptions required. Top up with crypto (USDT, USDC, ETH, BTC).

Does Meta Llama 3 70B Instruct support streaming?

Yes, Meta Llama 3 70B Instruct supports streaming responses via NeuronGate's API. Use the standard "stream": true parameter in your request.

What is the context window of Meta Llama 3 70B Instruct?

Meta Llama 3 70B Instruct has a context window of 8K tokens (~6K words). Maximum output is 8K tokens.

Does Meta Llama 3 70B Instruct support function calling (tools)?

Meta Llama 3 70B Instruct does not currently support function calling / tool use.

How do I use Meta Llama 3 70B Instruct with NeuronGate?

Create a NeuronGate account, top up your balance with crypto, generate an API key, and use the model id meta-llama/llama-3-70b-instruct in your requests. NeuronGate uses the OpenAI-compatible API format — set your base URL to https://neurongate.net/v1.