LangChain's abstraction hid a memory leak
I put chat state in Redis so the support agent could remember sessions. The API pods still ran out of memory.
1 post found
I put chat state in Redis so the support agent could remember sessions. The API pods still ran out of memory.