You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When running a large LLM like llama3-70B locally, the first message to it often times out due to the time it takes ollama to load the model the very first time. Trying again will work since the model will already be loaded or 'hot'.
This is a problem with other UIs I've used too. There needs to be a way for this thing to tell the difference between a long load time and a problem with ollama.
The text was updated successfully, but these errors were encountered:
When running a large LLM like llama3-70B locally, the first message to it often times out due to the time it takes ollama to load the model the very first time. Trying again will work since the model will already be loaded or 'hot'.
This is a problem with other UIs I've used too. There needs to be a way for this thing to tell the difference between a long load time and a problem with ollama.
The text was updated successfully, but these errors were encountered: