websockets user separation

[GSequist]

hi there and thanks in advance if anyone has the time to help me

i am sure i am not getting right so many things when asking this that i apologize in advance

i struggle with user separation when trying to build on langchain

in a websocket context, where the connection persists beyond the scope of a single request-response cycle

..and i need to pass along user id to operations that span across different modules or even services i cannot do this can i?

one example building on one of your RAG cookbooks (great by the way) here

in the example below i am trying to pass user_id bc i create shor term faiss db for each user separately .. i cannot allow for another variable user id in the tool can I?

...but this goes beyond just the tool use

i cannot compile a graph and then run it passing along user id can i?

[hinthornw]

This is usually passed through the runnable config as a configurable parameter. Within a given node, you can use this to determine how to respond.

We use this for caching, for instance

[GSequist]

thanks! @hinthornw

can u pls point me to the right direction

where in the construction of the graph can i amend the runnable

for example

model = ChatOpenAI(temperature=0, streaming=True)
functions = [format_tool_to_openai_function(t) for t in tools]
model = model.bind_functions(functions)

class AgentState(TypedDict):
messages: Annotated[Sequence[BaseMessage], operator.add]

workflow = StateGraph(AgentState)

workflow.add_node("agent", call_model)
workflow.add_node("action", call_tool)

workflow.set_entry_point("agent")

workflow.add_conditional_edges(

"agent",

should_continue,

{

    "continue": "action",

    "end": END,
},

)

workflow.add_edge("action", "agent")

app = workflow.compile()

def invoke(inputs, user_id):
app.invoke(inputs, user_id)
for output in app.stream(inputs, user_id):
for key, value in output.items():
print(f"[invoke]: key: {key}, value: {value}")
yield key, value`