LlamaIndex Integration

CortexDB integrates with LlamaIndex as a memory store, providing persistent hybrid-retrieval memory for agents and query engines.

Installation

pip install cortexdbai[llamaindex]

As a Memory Store

from llama_index.core.agent import ReActAgent
from llama_index.llms.openai import OpenAI
from cortexdb.integrations.llamaindex import CortexMemoryStore

memory = CortexMemoryStore(
    api_key="your-cortex-api-key",
    tenant_id="my-app",
)

agent = ReActAgent.from_tools(
    tools,
    llm=OpenAI(model="gpt-4o"),
    memory=memory,
    verbose=True,
)

response = agent.chat("Remember that our API rate limit is 1000 req/s per tenant.")
# Later...
response = agent.chat("What is our API rate limit?")

As a Retriever

from cortexdb.integrations.llamaindex import CortexRetriever
from llama_index.core.query_engine import RetrieverQueryEngine

retriever = CortexRetriever(
    api_key="your-cortex-api-key",
    tenant_id="my-app",
)

query_engine = RetrieverQueryEngine.from_args(retriever)
response = query_engine.query("What architectural decisions have been made?")

Under the Hood

The integration wraps CortexDB's REST API. Here are the equivalent calls:

# remember() — store a memory
curl -X POST https://api.cortexdb.ai/v1/remember \
  -H "Authorization: Bearer your-cortex-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "content": "Our API rate limit is 1000 req/s per tenant.",
    "tenant_id": "my-app"
  }'
# Returns: { "event_id": "evt_abc123" }

# recall() — retrieve relevant context
curl -X POST https://api.cortexdb.ai/v1/recall \
  -H "Authorization: Bearer your-cortex-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "query": "What is our API rate limit?",
    "tenant_id": "my-app"
  }'
# Returns: { "context": "...", "confidence": 0.95, "latency_ms": 11 }

Configuration

| Parameter | Default | Description | |---|---|---| | api_key | $CORTEX_API_KEY | CortexDB API key | | tenant_id | Required | Tenant identifier | | auto_remember | True | Auto-store conversation turns |