Quick facts

Model ID llama-3.1-70b-instruct

Source LLM Gateway

Context Window 128000

Pricing $0.72 input / $0.72 output per 1M tokens

Capabilities temperature control, open weights

Model overview

Llama 3.1 70B Instruct is an AI model from LLM Gateway with 128000 token context window and text input support.

Published pricing is $0.72 input and $0.72 output per 1M tokens.

Model ID llama-3.1-70b-instruct

Provider LLM Gateway

Family llama

Status beta

Knowledge Cutoff -

Release Date 2024-07-23

Input Modalities text

Output Modalities text

Context Window 128000

Input Limit -

Output Limit 2048

Tool Calling No

Reasoning No

Structured Output No

Temperature Control Yes

Open Weights Yes

Input Cost / 1M tokens $0.72

Output Cost / 1M tokens $0.72

Reasoning Cost / 1M tokens -

Cache Read Cost / 1M tokens -

Cache Write Cost / 1M tokens -