[Question]: Deployment on AWS

[rivindubandara]

What is your question?

How can I deploy my version of LibreChat on AWS?

More Details

I have a customized version of LibreChat that I've just been running locally on my machine through npm. I want to know deploy this onto a web application either through an EC2 instance or a ELB. Can someone explain how this is possible, there seems to be very little documentation around this. Also how would user management work, I understand you can create users profile by registering, but how is that process managed, like resetting passwords or seeing the users who have registered?

What is the main subject of your question?

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

I think you should first try setting the app on EC2, it's the same as you would in any other linux environment, assuming you use a distro like Ubuntu: https://www.librechat.ai/docs/remote/docker_linux

[rivindubandara]

Hi Danny,

Thanks for this, I seem to have gotten it to work. However none of my customizations seem to have applied. When I run locally it's fine. However in the ec2 instance it's reverted to default. All the code seems to be correct in my repo.

Local host:

EC2:

In EC2 console:

Thanks

[danny-avila]

You need to build the image yourself on the EC2 instance. See this comment: #3740 (reply in thread)

Note that 2GB of RAM is usually the minimum for building the docker image.

[danny-avila]

2. or, use npm and node (recommended v10+ and v20+ respectively) on the EC2, also requires 2 GB RAM for compiling frontend code
3. build the docker image somewhere else and pull it from a private container registry (dockerhub, github container registry)

[rivindubandara]

@danny-avila I tried the steps in the thread but it's the same result. I have my librechat.yaml config coming in fine, it's just the tailwind css and logo etc which aren't coming through.

This is what I have in the override file.

[danny-avila]

Which compose file are you using?

[rivindubandara]

This is the docker-compose.yml

[jls42]

What is your question?

How can I deploy my version of LibreChat on AWS?

More Details

I have a customized version of LibreChat that I've just been running locally on my machine through npm. I want to know deploy this onto a web application either through an EC2 instance or a ELB. Can someone explain how this is possible, there seems to be very little documentation around this. Also how would user management work, I understand you can create users profile by registering, but how is that process managed, like resetting passwords or seeing the users who have registered?

What is the main subject of your question?

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

Hello,

Have you tried this one: https://gitlab.com/jls42/poc-librechat-ec2 ? This project provides a basis for deploying LibreChat on an EC2 instance, which could help you get started. Feel free to check the repository's documentation to learn about the specific steps and necessary configurations.

Readme in English : https://gitlab.com/jls42/poc-librechat-ec2/-/blob/main/README-en-gpt-4o.md?ref_type=heads

If you have your own customized version of LibreChat, you might need to adjust the deployment script. For instance, in the user_data.sh script at line 81, replace the default LibreChat repository URL with the URL of your custom version:

Example: Replace the default clone URL with your custom repository URL
git clone https://gitlab.com/your-username/your-custom-librechat.git

Here : https://gitlab.com/jls42/poc-librechat-ec2/-/blob/main/scripts/user_data.sh?ref_type=heads#L81

Good luck with your deployment!

Best regards,
Julien