Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dockerizing Route-LLM 🚀 #33

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

szymonrucinski
Copy link

Hi there! 👋

I've been following the Route-LLM project and I must say, it's really cool! The idea of using language models to generate routes and directions is brilliant. 🌟

However, I noticed that getting started with the project might be a bit confusing for some users, especially those who are new to the tech stack used. 🤔

I believe that deploying the project using Docker could make it even more accessible and user-friendly. By providing a Dockerfile and docker-compose.yml file, anyone interested in using Route-LLM could quickly build and run the server within seconds. This would greatly simplify the setup process and reduce the chances of running into environment-related issues. 🐳

Dockerizing the project could also help increase its popularity and adoption. Many developers and users prefer projects that are easy to deploy and run, and Docker has become a standard for containerization. 📈

To contribute to this effort, I have created a Dockerfile and docker-compose.yml file that document the workflow and make it straightforward to deploy Route-LLM on the cloud or any Docker-compatible environment. 🚀

I hope this contribution helps make Route-LLM even more accessible and attractive to a wider audience. Let me know if you have any feedback or suggestions!

Keep up the great work! 😊

@bitnom
Copy link
Contributor

bitnom commented Aug 9, 2024

I have improved it and included cuda. Just got it working so still testing and need to make a docker-compose version

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants