LangChain Integration

CortexDB integrates with LangChain as a memory backend, replacing ConversationBufferMemory and ConversationSummaryMemory with persistent, hybrid-retrieval memory.

Installation

pip install cortexdbai[langchain]

Setup

from langchain_openai import ChatOpenAI
from langchain.agents import AgentExecutor, create_openai_functions_agent
from cortexdb.integrations.langchain import CortexMemory

# Initialize CortexDB memory
memory = CortexMemory(
    api_key="your-cortex-api-key",
    tenant_id="my-app",
)

# Create agent with CortexDB memory
llm = ChatOpenAI(model="gpt-4o")
agent = create_openai_functions_agent(llm, tools, prompt)
executor = AgentExecutor(agent=agent, tools=tools, memory=memory)

# Memory persists across sessions
response = executor.invoke({"input": "Remember that I prefer Python over JavaScript."})
# ... later, even in a new session ...
response = executor.invoke({"input": "What programming language do I prefer?"})
# "Based on your previous conversations, you prefer Python over JavaScript."

As a Retriever

from cortexdb.integrations.langchain import CortexRetriever

retriever = CortexRetriever(
    api_key="your-cortex-api-key",
    tenant_id="my-app",
)

# Use in a RetrievalQA chain
from langchain.chains import RetrievalQA

qa = RetrievalQA.from_chain_type(
    llm=ChatOpenAI(model="gpt-4o"),
    retriever=retriever,
)

answer = qa.invoke("What decisions did we make about the database?")

Under the Hood

The integration wraps CortexDB's REST API. Here are the equivalent calls:

# remember() — store a conversation turn
curl -X POST https://api.cortexdb.ai/v1/remember \
  -H "Authorization: Bearer your-cortex-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "content": "I prefer Python over JavaScript.",
    "tenant_id": "my-app"
  }'
# Returns: { "event_id": "evt_abc123" }

# recall() — retrieve relevant context
curl -X POST https://api.cortexdb.ai/v1/recall \
  -H "Authorization: Bearer your-cortex-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "query": "What programming language do I prefer?",
    "tenant_id": "my-app"
  }'
# Returns: { "context": "...", "confidence": 0.92, "latency_ms": 14 }

Configuration

| Parameter | Default | Description | |---|---|---| | api_key | $CORTEX_API_KEY | CortexDB API key | | base_url | https://api.cortexdb.ai | Server URL | | tenant_id | Required | Tenant identifier | | auto_remember | True | Auto-store conversation turns |