GPT-4 Turbo

openai/gpt-4-turbo
VisionToolsJSON
by OpenAI · 2024-04-09

The latest GPT-4 Turbo model with vision capabilities. Vision requests can now use JSON mode and function calling. Training data: up to December 2023.

ctx128K tokens
Max output4.1K
Inputtext + image
Outputtext
p50 TTFT5.50 s
INPUT$10.00/ 1M tokens
OUTPUT$30.00/ 1M tokens
p50 TTFT5.50 s7d
p95 TTFT10.00 s7d
TRAFFIC710.7Ktokens / 7d

GPT-4 Turbo is a large language model released by OpenAI that processes both text and image inputs. It builds on the architecture of GPT-4 but increases the context window to 128,000 tokens — roughly…

What exactly is GPT-4 Turbo?

Who should use this model on OrcaRouter?

What distinguishes GPT-4 Turbo from earlier GPT-4 versions?

How does OrcaRouter provide access to GPT-4 Turbo?

Code samples

Call from any SDK

OpenAI-compatible — keep the SDK you already use

  • OpenAI SDKhttps://api.orcarouter.ai/v1
from openai import OpenAI

client = OpenAI(
    base_url="https://api.orcarouter.ai/v1",
    api_key="$ORCAROUTER_API_KEY",
)

response = client.chat.completions.create(
    model="openai/gpt-4-turbo",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Supported parameters

  • frequency_penalty
  • logit_bias
  • logprobs
  • max_tokens
  • presence_penalty
  • response_format
  • seed
  • stop
  • stream
  • temperature
  • tool_choice
  • tools
  • top_logprobs
  • top_p

Pricing

Input / 1M tokens$10.00
Output / 1M tokens$30.00
CurrencyUSD

Cost calculator

Tokens / month10MM
Input share70%%
Estimated / month $160

Estimate based on list price

Token & cost estimator

Input tokens: 20Cost per request: $0.0152

Estimate only — actual token counts depend on the provider's tokenizer.

Performance

p50 TTFT
5.50 s
Output speed
32.8 tok/s
p95 TTFT
10.00 s
Error rate
0%

Public benchmarks

21.5
AA Coding
Better than 21% of models compared
#83 of 106
13.7
AA Intelligence
Better than 10% of models compared
#98 of 110
AIME
15.0
Humanity's Last Exam
3.3
LiveCodeBench
29.1
MATH-500
73.7
MMLU-Pro
69.4
SciCode
31.9
Source: artificialanalysis.ai

How it compares

GPT-4 TurboGPT-5.2 ProGPT-5.4 ProGPT-5.5
Input $/M$10.00$21.00$60.00$5.00
Output $/M$30.00$168.00$270.00$30.00
Context128K400K1.1M
Quality2/1010/1010/1010/10
Compare side-by-sideCompare side-by-sideCompare side-by-sideCompare side-by-side

FAQ

What is the cost of GPT-4 Turbo through OrcaRouter?
The cost is $10.00 per 1 million input tokens and $30.00 per 1 million output tokens. OrcaRouter adds zero markup, so you pay the same as the provider rate.
How large is the context window for GPT-4 Turbo?
GPT-4 Turbo has a context window of 128,000 tokens, which can hold roughly 300 pages of text. The maximum output is limited to 4,096 tokens.
What are the main strengths of GPT-4 Turbo?
Its main strengths include mathematical reasoning (73.7 on MATH-500), handling very long contexts, generating and debugging code, and interpreting images through vision input.
How does GPT-4 Turbo compare to the original GPT-4?
GPT-4 Turbo offers a larger context window (128K vs up to 32K), lower pricing ($10/$30 vs $30/$60 per 1M tokens), and improved efficiency. Performance on benchmarks like MATH-500 is higher.
Does OrcaRouter cache responses or offer discounts?
No, OrcaRouter does not offer caching, discounts, or volume pricing for GPT-4 Turbo. Each request is billed at the per-token rate with zero markup.
How do I call GPT-4 Turbo via the API on OrcaRouter?
Set the base URL to https://api.orcarouter.ai/v1, use model name "openai/gpt-4-turbo", and include your OrcaRouter API key. The API is fully compatible with OpenAI's chat completions format.
Can I use image inputs with GPT-4 Turbo through OrcaRouter?
Yes, GPT-4 Turbo supports image inputs. You can provide images as URLs or base64-encoded data in the content array. The image token cost is added to the input token count.
What is the maximum output length for GPT-4 Turbo?
The maximum output length is 4,096 tokens. You can set max_tokens to any value up to that limit. Longer output requires multiple calls or chaining.
Is GPT-4 Turbo available for streaming?
Yes, you can enable streaming by setting the stream parameter to true. The API will return tokens incrementally, compatible with OpenAI's streaming format.

Embed this badge

OpenAI: GPT-4 Turbo$10.00/M in5500ms p50via OrcaRouter
HTML <a href="https://www.orcarouter.ai/models/openai/gpt-4-turbo" target="_blank"> <img src="https://www.orcarouter.ai/embed/openai/gpt-4-turbo.svg" alt="OpenAI: GPT-4 Turbo on OrcaRouter" /> </a>
Markdown [![OpenAI: GPT-4 Turbo](https://www.orcarouter.ai/embed/openai/gpt-4-turbo.svg)](https://www.orcarouter.ai/models/openai/gpt-4-turbo)

Model card as data

GET /api/public/models/openai/gpt-4-turboOpen
Machine-readable:/llms.txt/llms-full.txt