GPT-3.5 Turbo 16k

openai/gpt-3.5-turbo-16k
by OpenAI · text in · text out · 16.4K ctx · 2023-08-28

This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximate…

INPUT$3.00/ 1M tokens
OUTPUT$4.00/ 1M tokens
p50 TTFT1.49 s7d
p95 TTFT3.42 s7d
TRAFFIC10.7Ktokens / 7d
Code samples
from openai import OpenAI

client = OpenAI(
    base_url="https://orcarouter.ai/v1",
    api_key="$ORCAROUTER_API_KEY",
)

response = client.chat.completions.create(
    model="openai/gpt-3.5-turbo-16k",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)
Pricing
Input / 1M tokens$3.00
Output / 1M tokens$4.00
CurrencyUSD
Performance
TTFT p50
1.49 s
Output speed
5.7 tok/s
TTFT p95
3.42 s
Error rate
7.4%
Public benchmarks
AA Coding
10.7
AA Intelligence
9.0
GPQA Diamond
29.7
MATH-500
44.1
MMLU-Pro
46.2
Source: artificialanalysis.ai
FAQ
How much does OpenAI: GPT-3.5 Turbo 16k cost on OrcaRouter?
OpenAI: GPT-3.5 Turbo 16k is priced at $3.00 per 1M input tokens and $4.00 per 1M output tokens via OrcaRouter. Pricing is pulled live from the routing layer.
What is OpenAI: GPT-3.5 Turbo 16k's context window?
OpenAI: GPT-3.5 Turbo 16k supports a context window of 16K tokens. Use long-context features (RAG, summarisation) up to that limit.
How do I call OpenAI: GPT-3.5 Turbo 16k via the OpenAI SDK?
Set OpenAI base_url to https://orcarouter.ai/v1, supply your OrcaRouter API key, and pass model="openai/gpt-3.5-turbo-16k" in the chat.completions.create call.
Does OrcaRouter rate-limit OpenAI: GPT-3.5 Turbo 16k?
Per-model rate limits follow your OrcaRouter plan. Free tiers ship with conservative caps; paid tiers lift them. Check /pricing for current quotas.
Embed this badge
OpenAI: GPT-3.5 Turbo 16k$3.00/M in1485ms p50via OrcaRouter
HTML <a href="https://www.orcarouter.ai/models/openai/gpt-3.5-turbo-16k" target="_blank"> <img src="https://www.orcarouter.ai/embed/openai/gpt-3.5-turbo-16k.svg" alt="OpenAI: GPT-3.5 Turbo 16k on OrcaRouter" /> </a>
Markdown [![OpenAI: GPT-3.5 Turbo 16k](https://www.orcarouter.ai/embed/openai/gpt-3.5-turbo-16k.svg)](https://www.orcarouter.ai/models/openai/gpt-3.5-turbo-16k)