Feature: config builder middleware #4

sonalibud · 2024-09-25T15:01:55Z

Title

Feature: Budserve Middleware added for creating user_config (router config) from api key and model data

🆕 New Feature

BudServeMiddleware added in proxy_server.py
Request body modified in middleware, added user_config key
Create user_config by fetching data from cache or from budserve_app api based on api_key and model name passed
endpoint_cache_config added to router class init to accept gpt-cache configuration

…e/custom-auth

…e/config-builder-middleware

…build user_config dictionary and pass it along llm request

…llm into feature/config-builder-middleware

…e/config-builder-middleware

sonalibud added 6 commits September 23, 2024 07:21

feat: custom auth dependency added

c943fd2

Merge branch 'main' of sonalibud:BudEcosystem/bud-litellm into featur…

24d9a0e

…e/custom-auth

fix: resolved dependency issues and cache store issue

9d7d507

fix: initial api key spend detail taken from db

d5f60b8

Merge branch 'main' of https://github.com/BerriAI/litellm into featur…

2c893a7

…e/config-builder-middleware

feat: budserve middleware to fetch endpoint and project settings and …

2e676d4

…build user_config dictionary and pass it along llm request

sonalibud self-assigned this Sep 25, 2024

sonalibud added 4 commits September 25, 2024 15:37

Merge branch 'feature/custom-auth' of sonalibud:BudEcosystem/bud-lite…

4743815

…llm into feature/config-builder-middleware

feat: added retrive credential details API in custom auth

792dc8b

chore: added example env and config for global litellm proxy server

fa1a0f4

Merge branch 'main' of https://github.com/BerriAI/litellm into featur…

ce09fe7

…e/config-builder-middleware

sonalibud changed the title ~~Feature/config builder middleware~~ Feature: config builder middleware Sep 26, 2024

Merge branch 'main' of sonalibud:BudEcosystem/bud-litellm into featur…

c0088d1

…e/config-builder-middleware