High availability deploy

[AlliotTech]

Hi, it seems like the LibreChat API container doesn't support HA deployment (multiple replicas).right?

[AlliotTech]

I enabled AzureAD login.

When I deployed 2 replicas for librechat-api, I sometimes get the following error when trying to log in with Azure AD:

Error: did not find expected authorization request details in session, req.session["oidc:login.microsoftonline.com"] is undefined

[AlliotTech]

Warning: connect.session() MemoryStore is not
designed for a production environment, as it will leak
memory, and will not scale past a single process.

I believe the root cause is the memoryStore session used by the librechat container.

[AlliotTech]

ref: #1840

[danny-avila]

You need to use Redis if using replicas

[AlliotTech]

Is there any documentation about this feature? The official documentation only states that it is not production-ready, but high availability is very important.

[danny-avila]

https://www.librechat.ai/docs/configuration/dotenv#redis

[AlliotTech]

Thanks for your help! For the HA deployment, the LibreChat API container relies on local storage for image storage. Are there any plans to support S3 or other distributed storage?

[danny-avila]

Yes. Supporting S3 will cover a lot of different storage options for S3-compatible services. I’m also hoping to implement MCP resources which will add plug-and-play storage options