Qwen3-VL 8B Thinking — open-weight small vision-language reasoning model, 8B params, 128k context.
Qwen3 VL 8B Thinking is an 8-billion-parameter multimodal language model developed by the Qwen team at Alibaba Cloud, hosted on OrcaRouter under the provider qwen. It belongs to the Qwen3 family of…
Qwen3 VL 8B Thinking excels at visual question answering, especially when the question involves multiple objects, spatial relationships, or text embedded in images (e.g., street signs, receipts). It can also handle video understanding tasks, such as summarizing a short clip, identifying actions, or answering questions about specific timestamps. Document analysis is a strong use case: extracting information from PDFs that contain both text and charts, or from scanned forms. Its long context window makes it suitable for processing large documents (e.g., 100+ page PDFs) with occasional image inserts, as long as the total tokenized input stays under 131K.
If your use case is purely text-based and does not involve images or video, a dedicated text-only model (e.g., Qwen3-8B or a similar-sized Llama variant) will likely be more cost-effective. Multimodal models incur additional overhead for encoding visual inputs, and the per-token pricing for Qwen3 VL 8B Thinking ($0.18 input, $2.10 output per million tokens) may be higher than many text-only alternatives. Additionally, if your task is simple classification or extraction from very short images, a smaller vision-language model with lower latency and cost (e.g., Qwen2 VL 2B) could be sufficient without sacrificing performance.
Yes, the model can accept multiple images interleaved with text in a single API call, as long as the total token count (image tokens plus text tokens) stays within the 131,072 context window. Each image is encoded into a variable number of tokens depending on its resolution and complexity. OrcaRouter's OpenAI-compatible API allows you to send multiple image URLs or base64-encoded images in the content array. There is no hard limit on the number of images other than the context constraint. For video, you would typically extract key frames and send them as separate images along with a text prompt.
Like all multimodal models, Qwen3 VL 8B Thinking may hallucinate details in images or video, especially with low resolution or ambiguous content. It is not designed for real-time video streaming; it processes static sets of frames. The 8B parameter size means it may be less accurate on highly specialized domains (e.g., medical imaging, satellite imagery) than larger models (e.g., 70B-100B+ vision-language models). It does not support audio input. The thinking process can inflate output length, so budget for output tokens accordingly. Finally, it is optimized for English but can handle other languages with variable effectiveness.
The specific benchmark scores for Qwen3 VL 8B Thinking on standard multimodal evaluations (e.g., MMMU, MathVista, VideoMME) have not been provided in the available facts. Users should consult the official Qwen model card or research paper for eventual published results. In general, the Qwen3 VL series has shown competitive performance on vision-language tasks relative to other 7B-8B parameter models. The "Thinking" variant is expected to improve reasoning-heavy benchmarks like visual chain-of-thought. Without public scores, it is advisable to test the model on your own representative dataset to evaluate its fit.
Latency data for this specific model on OrcaRouter's infrastructure has not been disclosed. As a general rule, an 8B-parameter multimodal model will have higher latency than a pure text model of the same size due to vision encoding. Video input increases latency further because of additional frame processing. On high-performance GPU clusters (e.g., A100, H100), typical time-to-first-token for an 8B model is in the range of a few hundred milliseconds to a few seconds, depending on input length and batch size. Output token generation speed is usually measured in tens of tokens per second. These values are qualitative; actual performance depends on OrcaRouter's current provisioning and load.
Strengths: The model handles long multimodal contexts (131K tokens), allows large outputs (up to 40K tokens), and processes three input types. Its thinking capability improves reasoning on tasks that require step-by-step deduction. It is competitively priced for an 8B multimodal model. Limitations: It has not been benchmarked against the latest frontier models on many public leaderboards. Its maximum output throughput may be lower than smaller models. It is not optimized for creative image generation (it outputs text only). Users should not assume zero hallucination in visual tasks. Video processing is limited to frame-based extraction rather than continuous analysis.
Qwen3 VL 8B Thinking is billed per token at the provider's rate with zero markup. Input tokens cost $0.18 per 1 million tokens. Output tokens cost $2.10 per 1 million tokens. There is no additional infrastructure fee, no base cost per request, and no monthly subscription. Pricing applies equally to all input modalities (text, image, video); each modality is tokenized and charged at the input rate. OrcaRouter does not charge any premium over the quoted rate. For example, processing an image that tokenizes to 2,000 input tokens would cost 2,000 * ($0.18 / 1M) = $0.00036 in input cost. Output cost is calculated similarly.
Each image is encoded into a variable number of tokens based on its dimensions and compression level. High-resolution images may consume thousands of tokens. Video is handled by extracting frames (typically one frame per few seconds) and encoding each frame as an image; thus the token cost scales linearly with video duration and frame rate. Users can control cost by resizing images or reducing frame counts. There is no separate fee for encoding media beyond the token cost. The output cost depends only on the number of text tokens generated. For long videos, input tokens can quickly approach the 131K limit, increasing the per-request cost.
As of the information provided, there are no discounts for batch usage or prepaid commitments. OrcaRouter does not currently offer token caching that would reduce costs for repeated prompts or images. All requests are billed per token in real time at the standard rate. If the provider (qwen) introduces discounted tier pricing in the future, OrcaRouter will pass those savings through at zero markup. Users are encouraged to monitor the OrcaRouter pricing page for any updates. For high-volume use cases, consider working with OrcaRouter directly to discuss potential volume pricing.
Compared to larger multimodal models (e.g., GPT-4V, Gemini 1.5 Pro), Qwen3 VL 8B Thinking is significantly cheaper per token: those models often cost $2–$10+ per million input tokens. Among 7B-8B parameter vision-language models, it is in line with typical pricing (Qwen2 VL 7B is roughly $0.10–$0.20 input, $1–$2 output). The output token cost ($2.10 per million) is higher than some pure text 8B models (e.g., $0.20 per million output), reflecting the added reasoning overhead. If you can use a smaller model (e.g., 2B–4B parameters), costs can be 50–90% lower, but with reduced capability.
You call Qwen3 VL 8B Thinking by sending a POST request to OrcaRouter's OpenAI-compatible endpoint at https://api.orcarouter.ai/v1/chat/completions. Set the model parameter to "qwen/qwen3-vl-8b-thinking". Include your API key in the Authorization header as "Bearer <key>". The request body follows OpenAI's chat completions schema. For multimodal input, structure the message content as an array of objects: one with type "text" for the text prompt, and one with type "image_url" for each image (with either a URL or base64 data). Video can be sent as multiple image_url entries representing frames. The response follows the standard OpenAI structure with all generated text in the choices array.
All standard OpenAI chat completion parameters are supported: temperature (0–2, default 1.0), top_p (0–1, default 1.0), max_tokens (up to 40960), stop sequences, frequency_penalty, presence_penalty, logprobs, and n (number of completions). The model does not support streaming? OrcaRouter likely supports streaming when streaming=true is set; check the provider's documentation. The tools (function calling) parameter may be supported if the underlying provider enables it; currently it is not guaranteed. System prompt is allowed. User IDs can be passed for monitoring. Ensure you stay within the 131072 token context window by monitoring token counts before sending.
If you are currently using the same model from a different API provider (e.g., directly from Alibaba Cloud), migration to OrcaRouter is straightforward: change the base URL to https://api.orcarouter.ai/v1, update the model string to "qwen/qwen3-vl-8b-thinking", and replace the API key with an OrcaRouter API key. No other code changes are required because OrcaRouter uses the exact same OpenAI-compatible interface. Be aware that token usage and pricing will be based on OrcaRouter's rates (which are passed through without markup). You may need to adjust your cost monitoring tools to reflect the new pricing.
Streaming is available through OrcaRouter's API. Set the stream parameter to true in your request. The response will be a Server-Sent Events (SSE) stream with deltas of the generated tokens. This is useful for real-time display. Note that for the "Thinking" variant, the thinking process may introduce longer delays before the first token, but streaming will still send incremental tokens as they are produced. The stream format follows OpenAI's streaming specification, with events of type "chat.completion.chunk". Each chunk contains a delta with the token's content or role.
Qwen3 VL 8B Thinking is the successor to Qwen2 VL 7B, with roughly the same parameter count (8B vs 7B) but improved architecture for longer context (131K vs 32K for Qwen2 VL 7B). It also adds the "Thinking" capability for step-by-step reasoning, which was not present in Qwen2 VL. The maximum output length has increased from 2048 tokens (Qwen2 VL 7B) to 40960 tokens. Pricing for Qwen3 VL 8B Thinking is slightly higher per token than Qwen2 VL 7B (which costs approximately $0.15 input, $1.80 output per million tokens), reflecting the added capabilities and larger context. Users upgrading should expect better performance on complex reasoning tasks.
GPT-4o mini is a flagship multimodal model from OpenAI with a 128K context window. It has significantly more parameters (unknown, but estimated >70B) and generally achieves higher accuracy on standard benchmarks. However, Qwen3 VL 8B Thinking is substantially cheaper: GPT-4o mini costs $0.15 per million input tokens and $0.60 per million output tokens, which is actually lower than Qwen3's $0.18 input and $2.10 output? Wait, check: GPT-4o mini input is $0.15, output $0.60 — cheaper than Qwen3 VL 8B Thinking? Actually the output is much cheaper. So cost is not lower across the board. But Qwen3 supports video and longer output (40960 vs 16384 for GPT-4o mini). Context windows are similar. The choice depends on required accuracy and budget; Qwen3 is niche for very long outputs and open-source deployment.
Llama 3.2 11B Vision is an 11B-parameter multimodal model with a 128K context window and 8K max output tokens. Qwen3 VL 8B Thinking has a smaller parameter count but a much larger max output (40960 vs 8000) and includes thinking capabilities. Both support text and image input, but Llama 3.2 11B does not support video natively. Llama's pricing via providers is similar, around $0.15–$0.20 input, $0.60–$1.00 output per million tokens, making Qwen3 more expensive on output. For tasks that require very long generated text (e.g., report writing from video), Qwen3 is better suited. For shorter, cost-sensitive tasks, Llama 3.2 11B may be preferable.
Gemini 1.5 Flash is a fast, cost-efficient multimodal model with a 1M context window (up to 2M), supporting image, video, and audio. It is cheaper than Qwen3 VL 8B Thinking (Gemini Flash costs $0.075 input, $0.30 output per million tokens) and faster. However, Qwen3 VL 8B Thinking offers a thinking process that can improve reasoning on challenging visual tasks, and its max output is much larger (40K vs 8K for Gemini Flash). If your application requires step-by-step reasoning and long outputs, Qwen3 is a better choice. For high throughput and low latency, Gemini Flash is typically superior. Also, Qwen3 may be preferred when data sovereignty requires self-hosted or provider-agnostic deployment.
OpenAI-compatible — keep the SDK you already use
https://api.orcarouter.ai/v1from openai import OpenAI
client = OpenAI(
base_url="https://api.orcarouter.ai/v1",
api_key="$ORCAROUTER_API_KEY",
)
response = client.chat.completions.create(
model="qwen/qwen3-vl-8b-thinking",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)enable_searchenable_thinkinginclude_reasoninglogprobsmax_tokensnparallel_tool_callspresence_penaltyreasoningrepetition_penaltyresponse_formatseedstopstreamstream_optionstemperaturethinking_budgettool_choicetoolstop_ktop_logprobstop_p| Input / 1M tokens | $0.180 |
| Output / 1M tokens | $2.10 |
| Currency | USD |
Estimate based on list price
Estimate only — actual token counts depend on the provider's tokenizer.
GET /api/public/models/qwen/qwen3-vl-8b-thinkingOpen @misc{orcarouter_qwen3_vl_8b_thinking,
title = {Qwen3 VL 8B Thinking API},
author = {Qwen},
year = {2025},
howpublished = {OrcaRouter},
url = {https://www.orcarouter.ai/models/qwen/qwen3-vl-8b-thinking}
}Qwen. (2025). Qwen3 VL 8B Thinking API. OrcaRouter. https://www.orcarouter.ai/models/qwen/qwen3-vl-8b-thinking