통합 가이드

LlamaIndex + OrcaRouter

LlamaIndex's OpenAI LLM class accepts api_base and api_key overrides. Route indexing, query, and synthesis calls through OrcaRouter for zero markup and automatic failover across providers.

API 키 받기 LlamaIndex 홈페이지 ↗

설정 단계

5분 만에 OrcaRouter 연결

1.Install: pip install llama-index-llms-openai
2.Import OpenAI from llama_index.llms.openai
3.Construct with api_base='https://api.orcarouter.ai/v1' and api_key='sk-orca-…'
4.Assign to Settings.llm so every query engine picks it up.
5.Build indices and query as usual — synthesis routes through OrcaRouter.

설정 예시

from llama_index.llms.openai import OpenAI
from llama_index.core import Settings

Settings.llm = OpenAI(
    api_base="https://api.orcarouter.ai/v1",
    api_key="sk-orca-...",
    model="gpt-4o",
)

# Now every query engine, agent, and chat engine uses OrcaRouter.
from llama_index.core import VectorStoreIndex, SimpleDirectoryReader
docs = SimpleDirectoryReader("./data").load_data()
index = VectorStoreIndex.from_documents(docs)
response = index.as_query_engine().query("Summarize the key points.")

LlamaIndex을(를) OrcaRouter로 라우팅하는 이유는 무엇입니까?

RAG pipelines make many small calls per query (retrieve → rerank → synthesize). OrcaRouter's per-request routing means each of those calls independently picks the cheapest healthy backend, and you see the full breakdown in one dashboard.

기타 통합

⌘ Cursor

AI-first code editor.

🤖 Cline

Autonomous coding agent for VS Code.

➡ Continue

Open-source AI code assistant for VS Code and JetBrains.

✎ Aider

AI pair programming in your terminal.

▲ Vercel AI SDK

Streaming AI for TypeScript apps.

🦜 LangChain