Skip to content

Commit

Permalink
[OutOfScope] Update databricks serving endpoint
Browse files Browse the repository at this point in the history
This change needed to be made after the submissions deadline because our original resources were destroyed and we had to recreate them.
  • Loading branch information
geovalexis committed Jun 19, 2024
1 parent 25795a2 commit cc8f57f
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion laia/llm.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@

client = OpenAI(
api_key=DATABRICKS_TOKEN,
base_url="https://adb-2978037251816793.13.azuredatabricks.net/serving-endpoints",
base_url="https://adb-652681204530583.3.azuredatabricks.net/serving-endpoints",
)

chat_completion = client.chat.completions.create(
Expand Down
2 changes: 1 addition & 1 deletion laia/rag.py
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@
llm = Databricks(
model="databricks-meta-llama-3-70b-instruct",
api_key=DATABRICKS_TOKEN,
api_base="https://adb-2978037251816793.13.azuredatabricks.net/serving-endpoints",
api_base="https://adb-652681204530583.3.azuredatabricks.net/serving-endpoints",
max_tokens=256,
)
# build or load index
Expand Down

0 comments on commit cc8f57f

Please sign in to comment.