Skip to content

Commit

Permalink
🚅 docs: Updated Example for LiteLLM ports and Volume mount (danny-avi…
Browse files Browse the repository at this point in the history
…la#2941)

* Added necessary "ports" section for it to work by default
* Added (commented out) example GCP Vertex volume mount for auth config and for ENV variable.
  • Loading branch information
ventz authored Jun 1, 2024
1 parent 8939d8a commit 37ae484
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions docker-compose.override.yml.example
Original file line number Diff line number Diff line change
Expand Up @@ -120,9 +120,13 @@ version: '3.4'
# image: ghcr.io/berriai/litellm:main-latest
# volumes:
# - ./litellm/litellm-config.yaml:/app/config.yaml
# - ./litellm/application_default_credentials.json:/app/application_default_credentials.json # only if using Google Vertex
# ports:
# - "4000:8000"
# command: [ "--config", "/app/config.yaml", "--port", "8000", "--num_workers", "8" ]
# environment:
# OPENAI_API_KEY: none ## needs to be set if ollama's openai api compatibility is used
# GOOGLE_APPLICATION_CREDENTIALS: /app/application_default_credentials.json ## only if using Google Vertex
# REDIS_HOST: redis
# REDIS_PORT: 6379
# REDIS_PASSWORD: RedisChangeMe
Expand Down

0 comments on commit 37ae484

Please sign in to comment.