Skip to content

Commit

Permalink
fix: ollama text embedding 500 error (#8131)
Browse files Browse the repository at this point in the history
  • Loading branch information
crazywoola authored Sep 9, 2024
1 parent 50d92f0 commit a27d4d5
Showing 1 changed file with 2 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,8 @@ def _invoke(self, model: str, credentials: dict,
endpoint_url,
headers=headers,
data=json.dumps(payload),
timeout=(10, 300)
timeout=(10, 300),
options={"use_mmap": "true"}
)

response.raise_for_status() # Raise an exception for HTTP errors
Expand Down

0 comments on commit a27d4d5

Please sign in to comment.