Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Commercial Cloud Deployment Example #339

Open
brycecf opened this issue Oct 24, 2024 · 1 comment
Open

[Feature Request]: Commercial Cloud Deployment Example #339

brycecf opened this issue Oct 24, 2024 · 1 comment
Labels
enhancement New feature or request example New example

Comments

@brycecf
Copy link

brycecf commented Oct 24, 2024

Features like AWS SQS support and #154 suggest the possibility of using llama-deploy in commercial clouds.

For developers whom are largely reliant on those services, an example of using llama-deploy on services in AWS, Azure, or (to a lesser extent) GCP would help provide more clarity on possible use cases.

At first glance, the Quick Start's configuration file looks like it could compete with IaC solutions like Terraform, which also complicates what a commercial cloud deployment would look like.

@masci masci added this to Framework Oct 24, 2024
@masci
Copy link
Member

masci commented Oct 24, 2024

Hey @brycecf thanks for the feedback, that's indeed something we should do, I'll set aside some time to work on it.

Regarding quick start configuration, that's not inteded to compete with IaC. While terraform code would dictate how to build the infrastructure powering the app, the deployment.yml file is meant to define the workflows that will run on top of that infra. Moreover, Llama Deploy is designed so that you can completely bypass the higer level (we call it API Server) with the relative configuration files and operate at the lower level (see Manual Orchestration in the docs).

Having a cloud deployment example will definitely make more clear these concepts, I'll figure something out!

@masci masci added the enhancement New feature or request label Oct 25, 2024
@masci masci added the example New example label Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request example New example
Projects
Status: No status
Development

No branches or pull requests

2 participants