Docker Production Setup Fails: Env Variables Missing and Ollama Connection Error #353

av1155 · 2024-11-20T19:39:17Z

Describe the bug

I have attempted to set up the production environment using Docker, following the steps outlined in the README, as well as additional troubleshooting steps, but the setup consistently fails. My primary goal is to integrate Ollama.

Even though I create the .env.local file and input all the necessary information for OpenAI, Anthropic, and Ollama URLs, the following error persists when executing the commands npm run dockerbuild:prod and docker-compose —profile production up:

Issues:

Environment Variables Not Set:
Despite creating a .env.local file with the required environment variables (e.g., OpenAI, Anthropic, Ollama URL), they are not being recognized during the build process. The following warning messages appear:

WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.

Ollama Error in UI:
When attempting to send a message via Ollama, the UI shows the error:
"There was an error processing your request: No details were returned."
The logs include the following error message:
```
Error: Network connection lost.
    at async postToApi ...
    at async OllamaChatLanguageModel.doStream ...
```

Additional Context:

My local Ollama instance is running at http://127.0.0.1:11434, and I have verified it is accessible.
- Ollama is installed with Homebrew (macOS) and the server is running.
```
❯ curl http://127.0.0.1:11434
Ollama is running
```

I am using the latest version of the project and dependencies, including npm and docker-compose.

❯ docker -v
Docker version 27.3.1, build ce12230
❯ docker-compose -v
Docker Compose version v2.29.7-desktop.1
❯ npm -v
10.9.0

Full Log Output:

❯ docker-compose --profile production up
WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.
[+] Running 2/2
 ✔ Network boltnew-any-llm_default      Created                                                                                                   0.0s
 ✔ Container boltnew-any-llm-bolt-ai-1  Created                                                                                                   0.1s
Attaching to bolt-ai-1
bolt-ai-1  |
bolt-ai-1  | > bolt@ dockerstart /app
bolt-ai-1  | > bindings=$(./bindings.sh) && wrangler pages dev ./build/client $bindings --ip 0.0.0.0 --port 5173 --no-show-interactive-dev-session
bolt-ai-1  |
bolt-ai-1  | ./bindings.sh: line 12: .env.local: No such file or directory
bolt-ai-1  |
bolt-ai-1  |  ⛅️ wrangler 3.63.2 (update available 3.88.0)
bolt-ai-1  | ---------------------------------------------
bolt-ai-1  |
bolt-ai-1  | ✨ Compiled Worker successfully
bolt-ai-1  | [wrangler:inf] Ready on http://0.0.0.0:5173
[wrangler:inf] - http://127.0.0.1:5173
[wrangler:inf] - http://172.19.0.2:5173
⎔ Starting local server...
[wrangler:inf] GET / 200 OK (326ms)
[wrangler:inf] GET /assets/manifest-64f35b7b.js 200 OK (4ms)
[wrangler:inf] GET /assets/_index-CYAjcA4A.js 200 OK (18ms)
[wrangler:inf] GET /assets/index-CPTzpSUP.css 200 OK (76ms)
[wrangler:inf] GET /assets/root-BpC-Gj3n.css 200 OK (82ms)
[wrangler:inf] GET /assets/tailwind-compat-CC20SAMN.css 200 OK (82ms)
[wrangler:inf] GET /assets/xterm-lQO2bNqs.css 200 OK (81ms)
[wrangler:inf] GET /assets/ReactToastify-CYivYX3d.css 200 OK (81ms)
[wrangler:inf] GET /assets/_index-D_NZK3VS.css 200 OK (3ms)
[wrangler:inf] GET /assets/root-CbOXwCh9.js 200 OK (3ms)
[wrangler:inf] GET /assets/theme-9upYr29Y.js 200 OK (5ms)
[wrangler:inf] GET /assets/components-VKHSbR2h.js 200 OK (6ms)
[wrangler:inf] GET /assets/entry.client-kdhVl-y0.js 200 OK (26ms)
[wrangler:inf] GET /assets/_index-CgRH4noA.js 200 OK (26ms)
[wrangler:inf] GET /assets/wasm-CsTmP73Z.js 200 OK (9ms)
[wrangler:inf] GET /assets/light-plus-BsvsQ1iS.js 200 OK (6ms)
[wrangler:inf] GET /assets/dark-plus-KEYLhlmT.js 200 OK (7ms)
[wrangler:inf] GET /assets/shellscript-BZfs-ost.js 200 OK (8ms)
Error: Network connection lost.
bolt-ai-1  |     at async postToApi (file:///app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:65:22)
bolt-ai-1  |     at async OllamaChatLanguageModel.doStream (file:///app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/src/ollama-chat-language-model.ts:230:50)
bolt-ai-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:345:23)
bolt-ai-1  |     at null.<anonymous> (async file:///app/.wrangler/tmp/dev-RIKdeU/functionsWorker-0.4237590511921838.js:30634:22)
bolt-ai-1  |     at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/util/retry-with-exponential-backoff.ts:37:12)
bolt-ai-1  |     at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:310:13)
bolt-ai-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:387:11)
bolt-ai-1  |     at null.<anonymous> (async file:///app/.wrangler/tmp/dev-RIKdeU/functionsWorker-0.4237590511921838.js:30634:22)
bolt-ai-1  |     at async chatAction (file:///app/build/server/index.js:1169:20)
bolt-ai-1  |     at async Object.callRouteAction (file:///app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16) {
bolt-ai-1  |   retryable: true
bolt-ai-1  | }
[wrangler:inf] POST /api/chat 500 Internal Server Error (18ms)
bolt-ai-1  |
^CGracefully stopping... (press Ctrl+C again to force)
[+] Stopping 1/1
 ✔ Container boltnew-any-llm-bolt-ai-1  Stopped                                                                                                   0.1s
canceled

Link to the Bolt URL that caused the error

http://0.0.0.0:5173/

Steps to reproduce

Create a .env.local file with the following content:

OPENAI_API_KEY=<your-key>
ANTHROPIC_API_KEY=<your-key>
OLLAMA_API_BASE_URL=http://127.0.0.1:11434

Run the following commands:

npm run dockerbuild:prod
docker-compose --profile production up

Attempt to interact with the application UI and send a message using Ollama.

Expected behavior

The Docker setup should:

Load all environment variables from .env.local.
Connect to the Ollama API without errors and receive an answer.

Actual Behavior:

The environment variables are not recognized during the Docker build process.
The UI displays an error when sending a message via Ollama, and logs indicate network connection issues.

If I use the simple pnpm process, it works well, but I want to set up a Docker container for this so it's always running and I can just open a browser and use it.

Screen Recording / Screenshot

No response

Platform

OS: macOS Version 15.1 (24B2083)
Browser: Arc Browser

Additional context

No response

The text was updated successfully, but these errors were encountered:

chrismahoney · 2024-11-20T20:20:03Z

> ❯ docker-compose --profile production up
> WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.
> WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
> WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.
> [+] Running 2/2
>  ✔ Network boltnew-any-llm_default      Created                                                                                                   0.0s
>  ✔ Container boltnew-any-llm-bolt-ai-1  Created                                                                                                   0.1s

@coleam00 @emcconnell @wonderwhy-er Do we pull in #222 here for now, and incur a small bit of tech debt to manage the list of env vars being added to bindings.sh? I think regardless of the solution, we should deal with this sooner than later.

Also @av1155 I see you're using Arc, although that's unrelated to this issue you'll want to be on Chrome Canary while using oTToDev for the time being.

av1155 · 2024-11-20T20:22:06Z

@chrismahoney I see! Thank you for the tip, will do so!

chrismahoney · 2024-11-20T20:25:38Z

Also @av1155 for now, please try using the development profile for Docker instead of production. Both should be expected to work obviously, but as this is a relatively recent project (and we don't receive downstream changes from bolt) there will be more immediate updates to dev versus prod. This is more my opinion than anything else.

yamini · 2024-11-21T03:31:24Z

Same issue here. Specifying the .env.local file was the only thing that worked.

docker compose --env-file .env.local --profile development up --build

av1155 · 2024-11-21T03:43:53Z

After doing what @yamini said, I was able to load the .env.local variables, but, Ollama still does not work. Pnpm is the only way it will work for me so far as mentioned before.

I just wrote "Hey", and that happened. It thought for a sec, and then broke.

For some reason, the system attempts to use the model model: 'claude-3-5-sonnet-latest', as indicated in the following log, despite the Ollama model being selected. This has been the primary issue I’ve been facing. While I can resolve the .env.local issue by either removing it from .dockerignore or copying the variables manually, I still can't get it to work correctly with Ollama.

Log:

❯ docker compose --env-file .env.local --profile development  up --build
[+] Building 0.4s (12/12) FINISHED                                                                                                docker:desktop-linux
 => [bolt-ai-dev internal] load build definition from Dockerfile                                                                                  0.0s
 => => transferring dockerfile: 2.01kB                                                                                                            0.0s
 => [bolt-ai-dev internal] load metadata for docker.io/library/node:20.18.0                                                                       0.3s
 => [bolt-ai-dev internal] load .dockerignore                                                                                                     0.0s
 => => transferring context: 427B                                                                                                                 0.0s
 => [bolt-ai-dev base 1/5] FROM docker.io/library/node:20.18.0@sha256:a7a3b7ec6de4b11bb2d673b31de9d28c6da09c557ee65453672c8e4f754c23fc            0.0s
 => => resolve docker.io/library/node:20.18.0@sha256:a7a3b7ec6de4b11bb2d673b31de9d28c6da09c557ee65453672c8e4f754c23fc                             0.0s
 => [bolt-ai-dev internal] load build context                                                                                                     0.0s
 => => transferring context: 7.43kB                                                                                                               0.0s
 => CACHED [bolt-ai-dev base 2/5] WORKDIR /app                                                                                                    0.0s
 => CACHED [bolt-ai-dev base 3/5] COPY package.json pnpm-lock.yaml ./                                                                             0.0s
 => CACHED [bolt-ai-dev base 4/5] RUN corepack enable pnpm && pnpm install                                                                        0.0s
 => CACHED [bolt-ai-dev base 5/5] COPY . .                                                                                                        0.0s
 => CACHED [bolt-ai-dev bolt-ai-development 1/1] RUN mkdir -p ${WORKDIR}/run                                                                      0.0s
 => [bolt-ai-dev] exporting to image                                                                                                              0.0s
 => => exporting layers                                                                                                                           0.0s
 => => exporting manifest sha256:7778322d15c9bdfa08c13ecfd508668873ce1a3dfe1963af9d69cca977f7a4f9                                                 0.0s
 => => exporting config sha256:c91758ad11729743b58f8ebe2ab47758b056a0edaed450b13263950789f81c54                                                   0.0s
 => => exporting attestation manifest sha256:8c803e09ac34cf1b13c993b444deba19422a27a184749688ce4c6d9012b4f346                                     0.0s
 => => exporting manifest list sha256:ce4a938bfc2d15f0dd50c613f7af651d0a2df4c687350b586d281436041bee7f                                            0.0s
 => => naming to docker.io/library/bolt-ai:development                                                                                            0.0s
 => => unpacking to docker.io/library/bolt-ai:development                                                                                         0.0s
 => [bolt-ai-dev] resolving provenance for metadata file                                                                                          0.0s
[+] Running 1/0
 ✔ Container boltnew-any-llm-bolt-ai-dev-1  Recreated                                                                                             0.0s
Attaching to bolt-ai-dev-1
bolt-ai-dev-1  |
bolt-ai-dev-1  | > bolt@ dev /app
bolt-ai-dev-1  | > remix vite:dev "--host" "0.0.0.0"
bolt-ai-dev-1  |
bolt-ai-dev-1  |   ➜  Local:   http://localhost:5173/
bolt-ai-dev-1  |   ➜  Network: http://172.19.0.2:5173/
bolt-ai-dev-1  | RetryError [AI_RetryError]: Failed after 3 attempts. Last error: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |     at _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:98:13)
bolt-ai-dev-1  |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |     at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |     at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |     at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |     at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |     at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |     at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |     at async Promise.all (index 1)
bolt-ai-dev-1  |     at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |     at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |     at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |     at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |     at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |     at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |     at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |     at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |   cause: undefined,
bolt-ai-dev-1  |   reason: 'maxRetriesExceeded',
bolt-ai-dev-1  |   errors: [
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     }
bolt-ai-dev-1  |   ],
bolt-ai-dev-1  |   lastError: APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |       at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |       at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |       at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |       at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |       at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |       at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |       at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |       at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |       at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |       at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |       at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |       at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |       at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |       at async Promise.all (index 1)
bolt-ai-dev-1  |       at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |       at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |       at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |       at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |       at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |       at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |       at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |       at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |     cause: Error: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1607:16)
bolt-ai-dev-1  |         at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
bolt-ai-dev-1  |       errno: -111,
bolt-ai-dev-1  |       code: 'ECONNREFUSED',
bolt-ai-dev-1  |       syscall: 'connect',
bolt-ai-dev-1  |       address: '127.0.0.1',
bolt-ai-dev-1  |       port: 11434
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |     requestBodyValues: {
bolt-ai-dev-1  |       format: undefined,
bolt-ai-dev-1  |       model: 'claude-3-5-sonnet-latest',
bolt-ai-dev-1  |       options: [Object],
bolt-ai-dev-1  |       messages: [Array],
bolt-ai-dev-1  |       tools: undefined
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     statusCode: undefined,
bolt-ai-dev-1  |     responseHeaders: undefined,
bolt-ai-dev-1  |     responseBody: undefined,
bolt-ai-dev-1  |     isRetryable: true,
bolt-ai-dev-1  |     data: undefined,
bolt-ai-dev-1  |     [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |     [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |   },
bolt-ai-dev-1  |   [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |   [Symbol(vercel.ai.error.AI_RetryError)]: true
bolt-ai-dev-1  | }

dimanicus · 2024-11-21T08:19:12Z

I have the same issue with local Llama models (any of them). It may be the problem with parsing Llama model name, 'cause it seems in case of parsing error default model name is used, and it is Claude's 3.5 Sonnet.

It doesn't really explain its inability to connect to port 11434 though (I have just the same issue). May be it's a whole another matter. Because when I tried to change default constants to 'Ollama' and 'qwen2.5-coder:7b-32k', the connect error was still there, only model name in error message changed to qwen one. Here, look:

15:25:10 [vite] page reload app/utils/constants.ts (x2)
RetryError [AI_RetryError]: Failed after 3 attempts. Last error: Cannot connect to API: connect ECONNREFUSED ::1:11434
    at _retryWithExponentialBackoff (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:98:13)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async startStep (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
    at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
    at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
    at async chatAction (D:/ottodev/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
    at async Object.callRouteAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\data.js:37:16)
    at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4612:21
    at async callLoaderOrAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4677:16)
    at async Promise.all (index 1)
    at async callDataStrategyImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4552:17)
    at async callDataStrategy (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4041:19)
    at async submit (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3900:21)
    at async queryImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3858:22)
    at async Object.queryRoute (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3827:18)
    at async handleResourceRequest (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:413:20)
    at async requestHandler (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
    at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
  cause: undefined,
  reason: 'maxRetriesExceeded',
  errors: [
    APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED ::1:11434
        at postToApi (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@ai-sdk\provider-utils\dist\index.js:446:15)
        at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
        at async OllamaChatLanguageModel.doStream (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\[email protected][email protected]\node_modules\ollama-ai-provider\dist\index.js:485:50)
        at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
        at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
        at async _retryWithExponentialBackoff (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
        at async startStep (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
        at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
        at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
        at async chatAction (D:/ottodev/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
        at async Object.callRouteAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\data.js:37:16)
        at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4612:21
        at async callLoaderOrAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4677:16)
        at async Promise.all (index 1)
        at async callDataStrategyImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4552:17)
        at async callDataStrategy (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4041:19)
        at async submit (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3900:21)
        at async queryImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3858:22)
        at async Object.queryRoute (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3827:18)
        at async handleResourceRequest (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:413:20)
        at async requestHandler (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
        at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
      cause: [Error],
      url: 'http://localhost:11434/api/chat',
      requestBodyValues: [Object],
      statusCode: undefined,
      responseHeaders: undefined,
      responseBody: undefined,
      isRetryable: true,
      data: undefined,
      [Symbol(vercel.ai.error)]: true,
      [Symbol(vercel.ai.error.AI_APICallError)]: true
    },
    APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED ::1:11434
        at postToApi (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@ai-sdk\provider-utils\dist\index.js:446:15)
        at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
        at async OllamaChatLanguageModel.doStream (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\[email protected][email protected]\node_modules\ollama-ai-provider\dist\index.js:485:50)
        at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
        at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
        at async _retryWithExponentialBackoff (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
        at async startStep (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
        at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
        at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
        at async chatAction (D:/ottodev/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
        at async Object.callRouteAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\data.js:37:16)
        at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4612:21
        at async callLoaderOrAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4677:16)
        at async Promise.all (index 1)
        at async callDataStrategyImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4552:17)
        at async callDataStrategy (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4041:19)
        at async submit (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3900:21)
        at async queryImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3858:22)
        at async Object.queryRoute (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3827:18)
        at async handleResourceRequest (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:413:20)
        at async requestHandler (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
        at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
      cause: [Error],
      url: 'http://localhost:11434/api/chat',
      requestBodyValues: [Object],
      statusCode: undefined,
      responseHeaders: undefined,
      responseBody: undefined,
      isRetryable: true,
      data: undefined,
      [Symbol(vercel.ai.error)]: true,
      [Symbol(vercel.ai.error.AI_APICallError)]: true
    },
    APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED ::1:11434
        at postToApi (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@ai-sdk\provider-utils\dist\index.js:446:15)
        at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
        at async OllamaChatLanguageModel.doStream (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\[email protected][email protected]\node_modules\ollama-ai-provider\dist\index.js:485:50)
        at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
        at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
        at async _retryWithExponentialBackoff (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
        at async startStep (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
        at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
        at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
        at async chatAction (D:/ottodev/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
        at async Object.callRouteAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\data.js:37:16)
        at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4612:21
        at async callLoaderOrAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4677:16)
        at async Promise.all (index 1)
        at async callDataStrategyImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4552:17)
        at async callDataStrategy (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4041:19)
        at async submit (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3900:21)
        at async queryImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3858:22)
        at async Object.queryRoute (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3827:18)
        at async handleResourceRequest (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:413:20)
        at async requestHandler (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
        at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
      cause: [Error],
      url: 'http://localhost:11434/api/chat',
      requestBodyValues: [Object],
      statusCode: undefined,
      responseHeaders: undefined,
      responseBody: undefined,
      isRetryable: true,
      data: undefined,
      [Symbol(vercel.ai.error)]: true,
      [Symbol(vercel.ai.error.AI_APICallError)]: true
    }
  ],
  lastError: APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED ::1:11434
      at postToApi (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@ai-sdk\provider-utils\dist\index.js:446:15)
      at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
      at async OllamaChatLanguageModel.doStream (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\[email protected][email protected]\node_modules\ollama-ai-provider\dist\index.js:485:50)
      at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
      at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
      at async _retryWithExponentialBackoff (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
      at async startStep (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
      at async fn (file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
      at async file:///D:/ottodev/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
      at async chatAction (D:/ottodev/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
      at async Object.callRouteAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\data.js:37:16)
      at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4612:21
      at async callLoaderOrAction (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4677:16)
      at async Promise.all (index 1)
      at async callDataStrategyImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4552:17)
      at async callDataStrategy (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:4041:19)
      at async submit (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3900:21)
      at async queryImpl (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3858:22)
      at async Object.queryRoute (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]\node_modules\@remix-run\router\dist\router.cjs.js:3827:18)
      at async handleResourceRequest (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:413:20)
      at async requestHandler (D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected][email protected]\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
      at async D:\ottodev\bolt.new-any-llm\node_modules\.pnpm\@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
    cause: Error: connect ECONNREFUSED ::1:11434
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1615:16)
        at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
      errno: -4078,
      code: 'ECONNREFUSED',
      syscall: 'connect',
      address: '::1',
      port: 11434
    },
    url: 'http://localhost:11434/api/chat',
    requestBodyValues: {
      format: undefined,
      model: 'qwen2.5-coder:7b-32k',
      options: [Object],
      messages: [Array],
      tools: undefined
    },
    statusCode: undefined,
    responseHeaders: undefined,
    responseBody: undefined,
    isRetryable: true,
    data: undefined,
    [Symbol(vercel.ai.error)]: true,
    [Symbol(vercel.ai.error.AI_APICallError)]: true
  },
  [Symbol(vercel.ai.error)]: true,
  [Symbol(vercel.ai.error.AI_RetryError)]: true
}

jeugregg · 2024-11-21T17:39:31Z

same issue than @av1155
And the docker compose --env-file .env.local --profile development up --build from @yamini is working for me in developement of course.
I use this link : http://localhost:11434/

ColbyAttack · 2024-11-21T18:54:04Z

Same issues I posted about yesterday on the Ottodev Group - hopefully, we can get it figured out. Manually specifying the docker env didn't resolve mine. I still cant seem any of the Ollama models in the dropdown.

coleam00 · 2024-11-22T00:53:35Z

@ColbyAttack, @jeugregg, @dimanicus, @av1155 - this issue where it still tries to use Claude when the provider is changed to Ollama is generally fixed by restarting the container. Obviously not ideal but we are still looking into this problem specifically!

recallmenot · 2024-11-29T07:45:47Z

I could not get it to work.
The OS is Arch.

My .env.local only had these lines altered:
OLLAMA_API_BASE_URL=http://localhost:11434
...
DEFAULT_NUM_CTX=131072

Context size is that of the model: qwen2.5-coder:32b

building production

npm run dockerbuild:prod


> dockerbuild:prod
> docker build -t bolt-ai:production -t bolt-ai:latest --target bolt-ai-production .

DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  1.492MB
Step 1/21 : ARG BASE=node:20.18.0
Step 2/21 : FROM ${BASE} AS base
20.18.0: Pulling from library/node
b2b31b28ee3c: Pull complete 
c3cc7b6f0473: Pull complete 
2112e5e7c3ff: Pull complete 
af247aac0764: Pull complete 
2768a6d600d1: Pull complete 
8090fa0edd88: Pull complete 
4cf85a38fb04: Pull complete 
22496bd6ed1b: Pull complete 
Digest: sha256:a7a3b7ec6de4b11bb2d673b31de9d28c6da09c557ee65453672c8e4f754c23fc
Status: Downloaded newer image for node:20.18.0
 ---> 2fdabcc143dd
Step 3/21 : WORKDIR /app
 ---> Running in fd233427e923
 ---> Removed intermediate container fd233427e923
 ---> d987ea729083
Step 4/21 : COPY package.json pnpm-lock.yaml ./
 ---> 710a28185450
Step 5/21 : RUN corepack enable pnpm && pnpm install
 ---> Running in 0a3302e618f3
! Corepack is about to download https://registry.npmjs.org/pnpm/-/pnpm-9.4.0.tgz
Lockfile is up to date, resolution step is skipped
Progress: resolved 1, reused 0, downloaded 0, added 0
Packages: +1156
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

   ╭──────────────────────────────────────────────────────────────────╮
   │                                                                  │
   │                Update available! 9.4.0 → 9.14.3.                 │
   │   Changelog: https://github.com/pnpm/pnpm/releases/tag/v9.14.3   │
   │         Run "corepack install -g [email protected]" to update.         │
   │                                                                  │
   │         Follow @pnpmjs for updates: https://x.com/pnpmjs         │
   │                                                                  │
   ╰──────────────────────────────────────────────────────────────────╯

Progress: resolved 1156, reused 0, downloaded 40, added 39
Progress: resolved 1156, reused 0, downloaded 128, added 128
Progress: resolved 1156, reused 0, downloaded 230, added 230
Progress: resolved 1156, reused 0, downloaded 488, added 488
Progress: resolved 1156, reused 0, downloaded 684, added 683
Progress: resolved 1156, reused 0, downloaded 907, added 907
Progress: resolved 1156, reused 0, downloaded 966, added 966
Progress: resolved 1156, reused 0, downloaded 1093, added 1093
Progress: resolved 1156, reused 0, downloaded 1155, added 1155
Progress: resolved 1156, reused 0, downloaded 1156, added 1156, done
.../[email protected]/node_modules/esbuild postinstall$ node install.js
.../[email protected]/node_modules/esbuild postinstall$ node install.js
.../node_modules/workerd postinstall$ node install.js
.../[email protected]/node_modules/esbuild postinstall$ node install.js
.../[email protected]/node_modules/esbuild postinstall: Done
.../[email protected]/node_modules/esbuild postinstall: Done
.../[email protected]/node_modules/esbuild postinstall: Done
.../node_modules/workerd postinstall: Done

dependencies:
+ @ai-sdk/anthropic 0.0.39
+ @ai-sdk/cohere 1.0.1
+ @ai-sdk/google 0.0.52
+ @ai-sdk/mistral 0.0.43
+ @ai-sdk/openai 0.0.66
+ @codemirror/autocomplete 6.17.0
+ @codemirror/commands 6.6.0
+ @codemirror/lang-cpp 6.0.2
+ @codemirror/lang-css 6.2.1
+ @codemirror/lang-html 6.4.9
+ @codemirror/lang-javascript 6.2.2
+ @codemirror/lang-json 6.0.1
+ @codemirror/lang-markdown 6.2.5
+ @codemirror/lang-python 6.1.6
+ @codemirror/lang-sass 6.0.2
+ @codemirror/lang-wast 6.0.2
+ @codemirror/language 6.10.2
+ @codemirror/search 6.5.6
+ @codemirror/state 6.4.1
+ @codemirror/view 6.28.4
+ @iconify-json/ph 1.1.13
+ @iconify-json/svg-spinners 1.1.2
+ @lezer/highlight 1.2.0
+ @nanostores/react 0.7.2
+ @octokit/rest 21.0.2
+ @octokit/types 13.6.1
+ @openrouter/ai-sdk-provider 0.0.5
+ @radix-ui/react-dialog 1.1.1
+ @radix-ui/react-dropdown-menu 2.1.1
+ @radix-ui/react-tooltip 1.1.4
+ @remix-run/cloudflare 2.10.2
+ @remix-run/cloudflare-pages 2.10.2
+ @remix-run/react 2.10.2
+ @uiw/codemirror-theme-vscode 4.23.0
+ @unocss/reset 0.61.3
+ @webcontainer/api 1.3.0-internal.10
+ @xterm/addon-fit 0.10.0
+ @xterm/addon-web-links 0.11.0
+ @xterm/xterm 5.5.0
+ ai 3.4.9
+ date-fns 3.6.0
+ diff 5.2.0
+ file-saver 2.0.5
+ framer-motion 11.2.12
+ ignore 6.0.2
+ isbot 4.4.0
+ istextorbinary 9.5.0
+ jose 5.6.3
+ js-cookie 3.0.5
+ jszip 3.10.1
+ nanostores 0.10.3
+ ollama-ai-provider 0.15.2
+ react 18.3.1
+ react-dom 18.3.1
+ react-hotkeys-hook 4.5.0
+ react-markdown 9.0.1
+ react-resizable-panels 2.0.20
+ react-toastify 10.0.5
+ rehype-raw 7.0.0
+ rehype-sanitize 6.0.0
+ remark-gfm 4.0.0
+ remix-island 0.2.0
+ remix-utils 7.6.0
+ shiki 1.9.1
+ unist-util-visit 5.0.0

devDependencies:
+ @blitz/eslint-plugin 0.1.0
+ @cloudflare/workers-types 4.20240620.0
+ @remix-run/dev 2.10.0
+ @types/diff 5.2.1
+ @types/file-saver 2.0.7
+ @types/js-cookie 3.0.6
+ @types/react 18.3.3
+ @types/react-dom 18.3.0
+ fast-glob 3.3.2
+ husky 9.1.7
+ is-ci 3.0.1
+ node-fetch 3.3.2
+ prettier 3.3.2
+ sass-embedded 1.80.4
+ typescript 5.5.2
+ unified 11.0.5
+ unocss 0.61.3
+ vite 5.3.1
+ vite-plugin-node-polyfills 0.22.0
+ vite-plugin-optimize-css-modules 1.1.0
+ vite-tsconfig-paths 4.3.2
+ vitest 2.0.1
+ wrangler 3.63.2
+ zod 3.23.8


> bolt@ prepare /app
> husky

.git can't be foundDone in 10.1s
 ---> Removed intermediate container 0a3302e618f3
 ---> ad706cbdc539
Step 6/21 : COPY . .
 ---> 828dcb608f2c
Step 7/21 : EXPOSE 5173
 ---> Running in 5e6fed44f2d3
 ---> Removed intermediate container 5e6fed44f2d3
 ---> a37fc442e157
Step 8/21 : FROM base AS bolt-ai-production
 ---> a37fc442e157
Step 9/21 : ARG GROQ_API_KEY
 ---> Running in 4c8f92d21830
 ---> Removed intermediate container 4c8f92d21830
 ---> 93e10561d311
Step 10/21 : ARG HuggingFace_API_KEY
 ---> Running in 014b6637dcbb
 ---> Removed intermediate container 014b6637dcbb
 ---> 5b7b546828fa
Step 11/21 : ARG OPENAI_API_KEY
 ---> Running in b65a23dc219c
 ---> Removed intermediate container b65a23dc219c
 ---> 2f60ac35b83f
Step 12/21 : ARG ANTHROPIC_API_KEY
 ---> Running in 35ccba714eaa
 ---> Removed intermediate container 35ccba714eaa
 ---> 54a150dc4560
Step 13/21 : ARG OPEN_ROUTER_API_KEY
 ---> Running in 26c6b0f332a9
 ---> Removed intermediate container 26c6b0f332a9
 ---> 3c2b22134fc0
Step 14/21 : ARG GOOGLE_GENERATIVE_AI_API_KEY
 ---> Running in cbf7ee284cca
 ---> Removed intermediate container cbf7ee284cca
 ---> eb4154728db2
Step 15/21 : ARG OLLAMA_API_BASE_URL
 ---> Running in 853dfc99cd30
 ---> Removed intermediate container 853dfc99cd30
 ---> dc835ad55275
Step 16/21 : ARG VITE_LOG_LEVEL=debug
 ---> Running in fad98cdc363a
 ---> Removed intermediate container fad98cdc363a
 ---> d841d46f2eed
Step 17/21 : ARG DEFAULT_NUM_CTX
 ---> Running in 5ed7653b1485
 ---> Removed intermediate container 5ed7653b1485
 ---> 2b60709bad23
Step 18/21 : ENV WRANGLER_SEND_METRICS=false     GROQ_API_KEY=${GROQ_API_KEY}     HuggingFace_KEY=${HuggingFace_API_KEY}     OPENAI_API_KEY=${OPENAI_API_KEY}     ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY}     OPEN_ROUTER_API_KEY=${OPEN_ROUTER_API_KEY}     GOOGLE_GENERATIVE_AI_API_KEY=${GOOGLE_GENERATIVE_AI_API_KEY}     OLLAMA_API_BASE_URL=${OLLAMA_API_BASE_URL}     VITE_LOG_LEVEL=${VITE_LOG_LEVEL}     DEFAULT_NUM_CTX=${DEFAULT_NUM_CTX}
 ---> Running in e45548a4a1b1
 ---> Removed intermediate container e45548a4a1b1
 ---> 3752d9354484
Step 19/21 : RUN mkdir -p /root/.config/.wrangler &&     echo '{"enabled":false}' > /root/.config/.wrangler/metrics.json
 ---> Running in ecb6f2efbf7b
 ---> Removed intermediate container ecb6f2efbf7b
 ---> 038210f58aab
Step 20/21 : RUN npm run build
 ---> Running in 65f93c5c8895

> build
> remix vite:build

vite v5.3.1 building for production...
transforming...
✓ 1596 modules transformed.
Generated an empty chunk: "api.enhancer".
Generated an empty chunk: "api.models".
Generated an empty chunk: "api.chat".
rendering chunks...
[unocss] failed to load icon "ph:folder-simple-upload"
computing gzip size...
build/client/.vite/manifest.json                            130.22 kB │ gzip:  10.11 kB
build/client/assets/tailwind-compat-CC20SAMN.css              2.25 kB │ gzip:   1.00 kB
build/client/assets/_index-D_NZK3VS.css                       2.61 kB │ gzip:   0.96 kB
build/client/assets/xterm-lQO2bNqs.css                        4.08 kB │ gzip:   1.67 kB
build/client/assets/ReactToastify-CYivYX3d.css               14.19 kB │ gzip:   2.71 kB
build/client/assets/index-CPTzpSUP.css                       17.01 kB │ gzip:   2.78 kB
build/client/assets/root-BnWMzKOp.css                        59.97 kB │ gzip:  11.24 kB
build/client/assets/api.enhancer-l0sNRNKZ.js                  0.00 kB │ gzip:   0.02 kB
build/client/assets/api.chat-l0sNRNKZ.js                      0.00 kB │ gzip:   0.02 kB
build/client/assets/api.models-l0sNRNKZ.js                    0.00 kB │ gzip:   0.02 kB
build/client/assets/chat._id-CbbV6wyZ.js                      0.12 kB │ gzip:   0.12 kB
build/client/assets/_index-DI1I-yso.js                        0.14 kB │ gzip:   0.13 kB
build/client/assets/codeowners-CGmujMTu.js                    0.48 kB │ gzip:   0.30 kB
build/client/assets/tsv-DnLUQrgA.js                           0.63 kB │ gzip:   0.33 kB
build/client/assets/shellsession-4WldjxEd.js                  0.68 kB │ gzip:   0.43 kB
build/client/assets/qmldir-MS3qTAOR.js                        0.88 kB │ gzip:   0.43 kB
build/client/assets/git-rebase-CtmYztAk.js                    0.89 kB │ gzip:   0.41 kB
build/client/assets/html-derivative-CvQVKW9i.js               0.91 kB │ gzip:   0.51 kB
build/client/assets/fortran-fixed-form-CdVjoHtb.js            1.01 kB │ gzip:   0.53 kB
build/client/assets/csv-B2DkETJQ.js                           1.04 kB │ gzip:   0.35 kB
build/client/assets/theme-9upYr29Y.js                         1.22 kB │ gzip:   0.67 kB
build/client/assets/xsl-bm8RKyr3.js                           1.26 kB │ gzip:   0.50 kB
build/client/assets/ini-DeVv6D4_.js                           1.36 kB │ gzip:   0.48 kB
build/client/assets/git-commit-BleTlbuD.js                    1.42 kB │ gzip:   0.64 kB
build/client/assets/sparql-BgtC_-ln.js                        1.43 kB │ gzip:   0.81 kB
build/client/assets/docker-DNR26wTC.js                        1.52 kB │ gzip:   0.56 kB
build/client/assets/wenyan-D3VXSfF0.js                        1.55 kB │ gzip:   1.09 kB
build/client/assets/hxml-C5imjkyf.js                          1.72 kB │ gzip:   0.88 kB
build/client/assets/desktop-D71BffLY.js                       1.81 kB │ gzip:   0.76 kB
build/client/assets/berry-CxrokwfH.js                         2.08 kB │ gzip:   0.77 kB
build/client/assets/reg-CrhH3_Og.js                           2.15 kB │ gzip:   0.69 kB
build/client/assets/erb-C4FIxXpw.js                           2.16 kB │ gzip:   0.71 kB
build/client/assets/diff-DvyTQcux.js                          2.38 kB │ gzip:   0.71 kB
build/client/assets/gleam-Dd6f7Z5P.js                         2.44 kB │ gzip:   0.83 kB
build/client/assets/index-Bchvt8wP.js                         2.48 kB │ gzip:   1.53 kB
build/client/assets/log-Ksn5IXup.js                           2.50 kB │ gzip:   0.86 kB
build/client/assets/json-CupVZNk8.js                          2.64 kB │ gzip:   0.80 kB
build/client/assets/index-DzZnwzs5.js                         2.69 kB │ gzip:   1.54 kB
build/client/assets/jssm-Dble9ECP.js                          2.74 kB │ gzip:   0.68 kB
build/client/assets/jsonl-BUpeXbsf.js                         2.83 kB │ gzip:   0.82 kB
build/client/assets/jsonc-DYI1rfmx.js                         2.93 kB │ gzip:   0.82 kB
build/client/assets/po-HrnDn_2Q.js                            2.97 kB │ gzip:   0.96 kB
build/client/assets/tasl-BxwAa5i0.js                          3.03 kB │ gzip:   0.85 kB
build/client/assets/genie-DAfrLhwG.js                         3.05 kB │ gzip:   1.19 kB
build/client/assets/vala-CO5hpdkB.js                          3.08 kB │ gzip:   1.17 kB
build/client/assets/rel-6Kuza3Wr.js                           3.08 kB │ gzip:   1.10 kB
build/client/assets/hy-C3qJFuQy.js                            3.08 kB │ gzip:   1.58 kB
build/client/assets/logo-DdacRhvC.js                          3.09 kB │ gzip:   1.46 kB
build/client/assets/json5-Bh8mriwU.js                         3.20 kB │ gzip:   0.93 kB
build/client/assets/jsonnet-C9d3aiqh.js                       3.25 kB │ gzip:   1.06 kB
build/client/assets/fluent-KPqz0Sb3.js                        3.32 kB │ gzip:   0.87 kB
build/client/assets/narrat-B9CT-1u6.js                        3.33 kB │ gzip:   1.10 kB
build/client/assets/turtle-C15OxdQ5.js                        3.36 kB │ gzip:   0.95 kB
build/client/assets/ssh-config-BH1M7C1g.js                    3.46 kB │ gzip:   1.57 kB
build/client/assets/splunk-6XBPEST2.js                        3.65 kB │ gzip:   1.63 kB
build/client/assets/smalltalk-DSsji4Hu.js                     3.81 kB │ gzip:   1.22 kB
build/client/assets/glsl-DNg5e6rY.js                          3.84 kB │ gzip:   1.42 kB
build/client/assets/bicep-3ghuYFLd.js                         3.87 kB │ gzip:   1.05 kB
build/client/assets/pascal-BvCdDh2R.js                        3.90 kB │ gzip:   1.65 kB
build/client/assets/zenscript-B1nm99XP.js                     3.93 kB │ gzip:   1.40 kB
build/client/assets/entry.client-kdhVl-y0.js                  4.06 kB │ gzip:   1.53 kB
build/client/assets/http-mWhOz2-8.js                          4.14 kB │ gzip:   1.11 kB
build/client/assets/nextflow-DBxHOdLe.js                      4.30 kB │ gzip:   1.24 kB
build/client/assets/fennel-C6XIsc4F.js                        4.48 kB │ gzip:   1.53 kB
build/client/assets/bibtex-BaedD2tq.js                        4.49 kB │ gzip:   0.78 kB
build/client/assets/tcl-C_8Fx7bH.js                           4.52 kB │ gzip:   1.67 kB
build/client/assets/qml-DcMLa_hy.js                           4.79 kB │ gzip:   1.35 kB
build/client/assets/gdresource-nSffpn2A.js                    4.86 kB │ gzip:   1.34 kB
build/client/assets/zig-xtV5iK4E.js                           4.90 kB │ gzip:   1.57 kB
build/client/assets/xml-KWQaRJyt.js                           4.91 kB │ gzip:   1.19 kB
build/client/assets/awk-i0IPvypD.js                           4.97 kB │ gzip:   1.37 kB
build/client/assets/fish-DfeQjIbs.js                          5.02 kB │ gzip:   1.69 kB
build/client/assets/jinja-DwshyRC8.js                         5.14 kB │ gzip:   1.39 kB
build/client/assets/powerquery-CApMHEaB.js                    5.30 kB │ gzip:   1.49 kB
build/client/assets/dax-DsfXcHUZ.js                           5.32 kB │ gzip:   2.29 kB
build/client/assets/verilog-DVfdqzEq.js                       5.44 kB │ gzip:   1.85 kB
build/client/assets/prisma-BBJYjQ0k.js                        5.51 kB │ gzip:   1.34 kB
build/client/assets/gdshader-B_SUYfiV.js                      5.73 kB │ gzip:   1.72 kB
build/client/assets/proto-DOtRmeXT.js                         5.77 kB │ gzip:   1.38 kB
build/client/assets/vb-beD-FUib.js                            5.79 kB │ gzip:   2.33 kB
build/client/assets/red-jaXbsbtS.js                           5.90 kB │ gzip:   1.55 kB
build/client/assets/wgsl-BZz1Hhek.js                          5.90 kB │ gzip:   1.67 kB
build/client/assets/shaderlab-DBpbMEBh.js                     5.90 kB │ gzip:   2.08 kB
build/client/assets/toml-BT9ZzGyQ.js                          5.91 kB │ gzip:   1.36 kB
build/client/assets/postcss-DXT9h7v2.js                       5.96 kB │ gzip:   1.89 kB
build/client/assets/soy-DhLnWwFA.js                           6.11 kB │ gzip:   1.64 kB
build/client/assets/min-dark-iSbrOpM4.js                      6.12 kB │ gzip:   1.70 kB
build/client/assets/clojure-BF6G6X0H.js                       6.14 kB │ gzip:   1.46 kB
build/client/assets/solarized-light-xPNGhBYe.js               6.15 kB │ gzip:   1.69 kB
build/client/assets/cypher-ByMv4Xf1.js                        6.21 kB │ gzip:   1.81 kB
build/client/assets/solarized-dark-C86elO-m.js                6.52 kB │ gzip:   1.77 kB
build/client/assets/ara-CG4fK2Nq.js                           6.56 kB │ gzip:   2.11 kB
build/client/assets/dart-DZLoTQm4.js                          6.64 kB │ gzip:   1.83 kB
build/client/assets/min-light-BITGhEdf.js                     6.81 kB │ gzip:   1.86 kB
build/client/assets/riscv-AgnqFTPX.js                         6.91 kB │ gzip:   2.20 kB
build/client/assets/hlsl-DmDrTTlz.js                          7.16 kB │ gzip:   2.22 kB
build/client/assets/systemd-CuJfdYLG.js                       7.26 kB │ gzip:   2.53 kB
build/client/assets/qss-FJDVp-XM.js                           7.43 kB │ gzip:   2.57 kB
build/client/assets/regexp-C_ZPRiAj.js                        7.46 kB │ gzip:   1.48 kB
build/client/assets/monokai-sMI-pExk.js                       7.47 kB │ gzip:   1.86 kB
build/client/assets/typst-I4qd5QHW.js                         7.62 kB │ gzip:   1.68 kB
build/client/assets/haml-BsKmeTIz.js                          7.80 kB │ gzip:   2.00 kB
build/client/assets/scheme-1Je9_Reo.js                        7.92 kB │ gzip:   2.64 kB
build/client/assets/kotlin-BIxS-Weu.js                        7.92 kB │ gzip:   2.10 kB
build/client/assets/plsql-BbJj1K1w.js                         7.98 kB │ gzip:   2.96 kB
build/client/assets/make-B9S9BZZh.js                          8.14 kB │ gzip:   1.74 kB
build/client/assets/vue-html-BQKlc1uT.js                      8.34 kB │ gzip:   1.92 kB
build/client/assets/dark-plus-KEYLhlmT.js                     8.47 kB │ gzip:   2.03 kB
build/client/assets/sass-CMDmr8et.js                          8.52 kB │ gzip:   2.46 kB
build/client/assets/slack-dark-C7oZ9nno.js                    8.69 kB │ gzip:   1.94 kB
build/client/assets/tex-Dk885XYG.js                           8.71 kB │ gzip:   2.89 kB
build/client/assets/andromeeda-YxQm0tCS.js                    8.75 kB │ gzip:   2.30 kB
build/client/assets/jison-5Ig0VrXv.js                         8.76 kB │ gzip:   1.84 kB
build/client/assets/slack-ochin-hXH8Gyq8.js                   9.09 kB │ gzip:   2.07 kB
build/client/assets/rst-5AUMhdsS.js                           9.23 kB │ gzip:   2.30 kB
build/client/assets/sas-WQZNIjpJ.js                           9.33 kB │ gzip:   4.05 kB
build/client/assets/light-plus-BsvsQ1iS.js                    9.33 kB │ gzip:   2.20 kB
build/client/assets/dream-maker-Eh5U-gDp.js                   9.54 kB │ gzip:   2.34 kB
build/client/assets/beancount-Urb1RsFe.js                     9.64 kB │ gzip:   1.49 kB
build/client/assets/gherkin-DjTlIhuc.js                       9.89 kB │ gzip:   5.11 kB
build/client/assets/cadence-Bgpqy2XC.js                       9.89 kB │ gzip:   2.27 kB
build/client/assets/raku-D384ylkT.js                         10.02 kB │ gzip:   2.93 kB
build/client/assets/yaml-C5gCGmDW.js                         10.08 kB │ gzip:   2.32 kB
build/client/assets/elm-CTSLo1i4.js                          10.09 kB │ gzip:   2.18 kB
build/client/assets/cmake-DXZpi2gR.js                        10.13 kB │ gzip:   3.56 kB
build/client/assets/hcl-CpAANOdC.js                          10.67 kB │ gzip:   2.45 kB
build/client/assets/github-light-CRlnGVMD.js                 10.84 kB │ gzip:   2.48 kB
build/client/assets/puppet-37ic6j3l.js                       10.85 kB │ gzip:   2.25 kB
build/client/assets/prolog-BH_RS3WO.js                       11.04 kB │ gzip:   3.82 kB
build/client/assets/github-dark-CzPA46E-.js                  11.06 kB │ gzip:   2.53 kB
build/client/assets/handlebars-C0vBBVRa.js                   11.12 kB │ gzip:   2.38 kB
build/client/assets/hjson-DZqG9GXz.js                        11.58 kB │ gzip:   1.84 kB
build/client/assets/bat-BPiaQZfK.js                          11.95 kB │ gzip:   3.24 kB
build/client/assets/terraform-DBeuZS66.js                    12.07 kB │ gzip:   3.08 kB
build/client/assets/v-C2TBxDwV.js                            12.13 kB │ gzip:   2.80 kB
build/client/assets/vesper-BSB_bK09.js                       12.27 kB │ gzip:   1.95 kB
build/client/assets/apache-rS0jd3Ly.js                       12.35 kB │ gzip:   3.76 kB
build/client/assets/vitesse-light-Br6ll-O0.js                12.98 kB │ gzip:   2.99 kB
build/client/assets/vitesse-black-B3g-KkBK.js                13.04 kB │ gzip:   3.02 kB
build/client/assets/vitesse-dark-Bxkoe-BC.js                 13.12 kB │ gzip:   3.02 kB
build/client/assets/clarity-CIekO_uJ.js                      13.21 kB │ gzip:   2.44 kB
build/client/assets/aurora-x-BaWyeHV_.js                     13.25 kB │ gzip:   2.26 kB
build/client/assets/actionscript-3-BigF1UXR.js               13.25 kB │ gzip:   2.78 kB
build/client/assets/pug-BmZh5kCX.js                          13.39 kB │ gzip:   2.91 kB
build/client/assets/synthwave-84-BBDuFDsq.js                 13.44 kB │ gzip:   2.83 kB
build/client/assets/nix-B7rNE5kf.js                          13.64 kB │ gzip:   2.31 kB
build/client/assets/github-light-default-UREJT2Bw.js         13.75 kB │ gzip:   3.02 kB
build/client/assets/lua-BPmF2VOm.js                          13.85 kB │ gzip:   3.13 kB
build/client/assets/github-dark-dimmed-CRDKj6ck.js           14.03 kB │ gzip:   3.10 kB
build/client/assets/github-dark-default-BXF7Vm5l.js          14.03 kB │ gzip:   3.10 kB
build/client/assets/solidity-CThH5sBG.js                     14.48 kB │ gzip:   3.06 kB
build/client/assets/ayu-dark-Bn5gmY5k.js                     14.51 kB │ gzip:   3.05 kB
build/client/assets/wasm-Cicx_DS6.js                         14.51 kB │ gzip:   2.85 kB
build/client/assets/liquid-Dj-jsJFu.js                       14.86 kB │ gzip:   2.90 kB
build/client/assets/angular-html-DZQ5UQWW.js                 14.91 kB │ gzip:   3.39 kB
build/client/assets/purescript-CfPQhs6g.js                   14.97 kB │ gzip:   2.61 kB
build/client/assets/cue-C6Aznpr-.js                          15.16 kB │ gzip:   2.05 kB
build/client/assets/svelte-DavKDhWY.js                       15.60 kB │ gzip:   3.05 kB
build/client/assets/gnuplot-nclm9rTJ.js                      15.73 kB │ gzip:   3.59 kB
build/client/assets/rust-DGxQkqYo.js                         15.98 kB │ gzip:   3.32 kB
build/client/assets/abap-DXFkqnOI.js                         16.05 kB │ gzip:   5.98 kB
build/client/assets/elixir-DjCTzIqv.js                       16.33 kB │ gzip:   3.17 kB
build/client/assets/gdscript-B474tPdy.js                     16.44 kB │ gzip:   3.68 kB
build/client/assets/graphql-Cac5VMXA.js                      16.59 kB │ gzip:   2.62 kB
build/client/assets/move-DOHBU7tp.js                         17.44 kB │ gzip:   3.90 kB
build/client/assets/marko-DTTVzMRa.js                        17.61 kB │ gzip:   3.18 kB
build/client/assets/groovy-wChcbJ1V.js                       17.70 kB │ gzip:   3.76 kB
build/client/assets/nushell-CrgTADc5.js                      17.74 kB │ gzip:   4.91 kB
build/client/assets/material-theme-B2BuIiKK.js               18.08 kB │ gzip:   3.09 kB
build/client/assets/material-theme-darker-BrGg7AAd.js        18.09 kB │ gzip:   3.09 kB
build/client/assets/material-theme-ocean-CBL0qBdF.js         18.09 kB │ gzip:   3.11 kB
build/client/assets/material-theme-lighter-DDRuGeQH.js       18.10 kB │ gzip:   3.08 kB
build/client/assets/material-theme-palenight-D7gg1Usp.js     18.10 kB │ gzip:   3.10 kB
build/client/assets/glimmer-ts-61dai_V5.js                   18.32 kB │ gzip:   2.94 kB
build/client/assets/glimmer-js-Bhx_sfM5.js                   18.32 kB │ gzip:   2.95 kB
build/client/assets/matlab-Btshr8M_.js                       18.44 kB │ gzip:   3.98 kB
build/client/assets/mdc-Bn_uTtpR.js                          19.16 kB │ gzip:   6.66 kB
build/client/assets/vue-DwKRC_TW.js                          19.38 kB │ gzip:   3.02 kB
build/client/assets/kusto-DGEpfOTx.js                        19.39 kB │ gzip:   4.52 kB
build/client/assets/snazzy-light-CA9nliXM.js                 19.75 kB │ gzip:   3.79 kB
build/client/assets/viml-BLluXI4E.js                         20.30 kB │ gzip:   7.22 kB
build/client/assets/twig-llAgFoxS.js                         20.30 kB │ gzip:   3.95 kB
build/client/assets/dracula-DGO8GyiP.js                      20.47 kB │ gzip:   3.97 kB
build/client/assets/dracula-soft-9B1nZgL-.js                 20.48 kB │ gzip:   4.00 kB
build/client/assets/powershell-9ZOzOPqN.js                   20.53 kB │ gzip:   4.65 kB
build/client/assets/nim-0XdZC7BR.js                          20.93 kB │ gzip:   3.47 kB
build/client/assets/rose-pine-CX_FIdg1.js                    21.22 kB │ gzip:   3.80 kB
build/client/assets/rose-pine-moon-CdedUr_-.js               21.23 kB │ gzip:   3.82 kB
build/client/assets/rose-pine-dawn-Bj5xdiaE.js               21.23 kB │ gzip:   3.82 kB
build/client/assets/index-Dw12XvZ7.js                        21.71 kB │ gzip:   9.79 kB
build/client/assets/mermaid-Dkb1Nx48.js                      22.10 kB │ gzip:   3.87 kB
build/client/assets/vhdl-QZ3jNtnE.js                         22.21 kB │ gzip:   3.97 kB
build/client/assets/index-D75Zk_hv.js                        22.56 kB │ gzip:  10.03 kB
build/client/assets/sql-DbK06e1c.js                          22.73 kB │ gzip:   7.53 kB
build/client/assets/fsharp-C-VjhQSu.js                       22.97 kB │ gzip:   4.12 kB
build/client/assets/common-lisp-C3qUB5O8.js                  23.25 kB │ gzip:   6.31 kB
build/client/assets/astro-U9VgAVQT.js                        23.26 kB │ gzip:   7.57 kB
build/client/assets/razor-CtZ59qoM.js                        23.50 kB │ gzip:   3.45 kB
build/client/assets/apl-D9TNySCV.js                          23.76 kB │ gzip:   4.74 kB
build/client/assets/system-verilog-BscxmKrE.js               23.84 kB │ gzip:   4.81 kB
build/client/assets/one-light-alpzPJ78.js                    23.99 kB │ gzip:   3.64 kB
build/client/assets/java-ClXEvkw9.js                         24.78 kB │ gzip:   4.36 kB
build/client/assets/scss-DqznleHU.js                         24.91 kB │ gzip:   4.25 kB
build/client/assets/typespec-DAP_O-zg.js                     25.22 kB │ gzip:   2.79 kB
build/client/assets/coffee-B4DZ7swD.js                       25.62 kB │ gzip:   6.50 kB
build/client/assets/julia-CnoVwgV8.js                        25.75 kB │ gzip:   6.04 kB
build/client/assets/nord-CsyjKwr8.js                         25.83 kB │ gzip:   4.36 kB
build/client/assets/scala-vMsNTMhM.js                        26.09 kB │ gzip:   4.20 kB
build/client/assets/index-CSZGGhH_.js                        26.17 kB │ gzip:   8.72 kB
build/client/assets/night-owl-BeocmOPF.js                    27.48 kB │ gzip:   5.07 kB
build/client/assets/applescript-B4yE-MfL.js                  27.91 kB │ gzip:   6.30 kB
build/client/assets/index-8lw9Rm7f.js                        28.75 kB │ gzip:  11.70 kB
build/client/assets/stylus-DSrLtGYv.js                       29.66 kB │ gzip:   8.10 kB
build/client/assets/crystal-DwllXkRF.js                      30.65 kB │ gzip:   5.53 kB
build/client/assets/one-dark-pro-BTtaZsq5.js                 31.68 kB │ gzip:   5.40 kB
build/client/assets/haxe-Dit6kIrv.js                         31.99 kB │ gzip:   5.87 kB
build/client/assets/codeql-BOpLLL-w.js                       32.08 kB │ gzip:   4.03 kB
build/client/assets/nginx-Bo7Ko850.js                        32.50 kB │ gzip:   4.45 kB
build/client/assets/poimandres-Cda-MJFk.js                   32.82 kB │ gzip:   5.47 kB
build/client/assets/tokyo-night-eJfcURhx.js                  32.89 kB │ gzip:   5.87 kB
build/client/assets/erlang-DS9ZWoKD.js                       33.08 kB │ gzip:   4.40 kB
build/client/assets/houston-CZZ6oYdA.js                      33.91 kB │ gzip:   5.74 kB
build/client/assets/r-BXfENWL6.js                            34.03 kB │ gzip:  11.07 kB
build/client/assets/ruby-CPHW1Myo.js                         34.49 kB │ gzip:   5.71 kB
build/client/assets/asm-PWN5J14X.js                          37.93 kB │ gzip:   8.09 kB
build/client/assets/cobol-DgBJixdi.js                        38.34 kB │ gzip:  11.06 kB
build/client/assets/d-PifQWv0n.js                            38.49 kB │ gzip:   8.21 kB
build/client/assets/shellscript-BZfs-ost.js                  38.50 kB │ gzip:   6.18 kB
build/client/assets/haskell-DAGYewaG.js                      39.07 kB │ gzip:   7.13 kB
build/client/assets/perl-InL218rs.js                         40.08 kB │ gzip:   4.78 kB
build/client/assets/apex-Sfo2eW0G.js                         42.54 kB │ gzip:   6.74 kB
build/client/assets/ada-CowR2XfX.js                          42.76 kB │ gzip:   5.87 kB
build/client/assets/index-Brr5YkQ1.js                        42.99 kB │ gzip:  14.82 kB
build/client/assets/go-BJn7Ek5W.js                           43.86 kB │ gzip:   6.26 kB
build/client/assets/catppuccin-mocha-CEfge3mM.js             44.19 kB │ gzip:   7.63 kB
build/client/assets/catppuccin-latte-BYdKNJ10.js             44.19 kB │ gzip:   7.64 kB
build/client/assets/catppuccin-frappe-CSPeAESR.js            44.19 kB │ gzip:   7.65 kB
build/client/assets/catppuccin-macchiato-DVLwECkk.js         44.20 kB │ gzip:   7.64 kB
build/client/assets/index-4AQhhi2I.js                        44.69 kB │ gzip:  19.07 kB
build/client/assets/imba-BXg-Svbq.js                         47.16 kB │ gzip:   9.92 kB
build/client/assets/css-CbYhyuC0.js                          47.37 kB │ gzip:  12.56 kB
build/client/assets/markdown-BdfWgkoX.js                     50.81 kB │ gzip:   5.64 kB
build/client/assets/latex-DhY63DBA.js                        52.73 kB │ gzip:   6.19 kB
build/client/assets/wikitext-2Gt4HDrj.js                     53.58 kB │ gzip:   5.79 kB
build/client/assets/ballerina-T9ysyp6P.js                    54.33 kB │ gzip:   8.17 kB
build/client/assets/html-CqhC7HHo.js                         55.14 kB │ gzip:  11.79 kB
build/client/assets/stata-8O9LehIm.js                        56.54 kB │ gzip:  13.66 kB
build/client/assets/ocaml-RqY_Nz63.js                        60.33 kB │ gzip:   5.09 kB
build/client/assets/c-RCJZWN-0.js                            67.59 kB │ gzip:  10.47 kB
build/client/assets/mojo--7WWnkdy.js                         69.93 kB │ gzip:  11.22 kB
build/client/assets/python-DwuVtWc2.js                       70.76 kB │ gzip:  11.29 kB
build/client/assets/root-Cc1p3XHe.js                         72.31 kB │ gzip:  23.70 kB
build/client/assets/less-Du6_OKDb.js                         76.35 kB │ gzip:  12.91 kB
build/client/assets/csharp-DISxKEhY.js                       78.97 kB │ gzip:  10.39 kB
build/client/assets/hack-OhUXFOZr.js                         79.92 kB │ gzip:  27.46 kB
build/client/assets/index-B-v6jJQ5.js                        84.26 kB │ gzip:  33.42 kB
build/client/assets/asciidoc-CF5eOCvB.js                     85.17 kB │ gzip:   8.17 kB
build/client/assets/fortran-free-form-D6pmzCqS.js            89.19 kB │ gzip:  12.14 kB
build/client/assets/swift-Dez-Qvcc.js                        90.59 kB │ gzip:  17.15 kB
build/client/assets/vyper-o-cPXEvd.js                        93.22 kB │ gzip:  13.14 kB
build/client/assets/blade-HiqCVk8k.js                        98.76 kB │ gzip:  28.39 kB
build/client/assets/racket-Cp2HGa90.js                      101.40 kB │ gzip:  17.31 kB
build/client/assets/index-CjNwCnz3.js                       101.46 kB │ gzip:  33.75 kB
build/client/assets/objective-c-DHmGyzbM.js                 102.03 kB │ gzip:  23.50 kB
build/client/assets/php-DdJTc9Za.js                         103.33 kB │ gzip:  28.40 kB
build/client/assets/mdx-CBPJd_fO.js                         118.30 kB │ gzip:  23.40 kB
build/client/assets/objective-cpp-BWKJ1FCf.js               164.63 kB │ gzip:  30.77 kB
build/client/assets/javascript-Dch3xQiY.js                  167.86 kB │ gzip:  17.12 kB
build/client/assets/tsx-BlxWTfDV.js                         168.58 kB │ gzip:  17.18 kB
build/client/assets/jsx-CsyrCbsw.js                         170.83 kB │ gzip:  17.21 kB
build/client/assets/typescript-DC8MraHL.js                  174.98 kB │ gzip:  16.64 kB
build/client/assets/angular-ts-DOuPvTiZ.js                  177.43 kB │ gzip:  17.22 kB
build/client/assets/components-VKHSbR2h.js                  249.31 kB │ gzip:  80.12 kB
build/client/assets/wolfram-BICIrM8O.js                     264.33 kB │ gzip:  76.98 kB
build/client/assets/wasm-CsTmP73Z.js                        622.30 kB │ gzip: 230.27 kB
build/client/assets/cpp-B9__le0e.js                         628.29 kB │ gzip:  48.49 kB
build/client/assets/emacs-lisp-BEjL32p1.js                  807.64 kB │ gzip: 202.93 kB
build/client/assets/_index-CQlnamSz.js                    1,770.48 kB │ gzip: 538.20 kB

(!) Some chunks are larger than 500 kB after minification. Consider:
- Using dynamic import() to code-split the application
- Use build.rollupOptions.output.manualChunks to improve chunking: https://rollupjs.org/configuration-options/#output-manualchunks
- Adjust chunk size limit for this warning via build.chunkSizeWarningLimit.
✓ built in 9.68s
vite v5.3.1 building SSR bundle for production...
transforming...
✓ 47 modules transformed.
[unocss] failed to load icon "ph:folder-simple-upload"
rendering chunks...
build/server/.vite/manifest.json                   1.18 kB
build/server/assets/tailwind-compat-CC20SAMN.css   2.25 kB
build/server/assets/xterm-lQO2bNqs.css             4.08 kB
build/server/assets/ReactToastify-CYivYX3d.css    14.19 kB
build/server/assets/index-CPTzpSUP.css            17.01 kB
build/server/assets/server-build-CzWVwSxd.css     37.69 kB
build/server/index.js                             81.75 kB
✓ built in 362ms
npm notice
npm notice New minor version of npm available! 10.8.2 -> 10.9.1
npm notice Changelog: https://github.com/npm/cli/releases/tag/v10.9.1
npm notice To update run: npm install -g [email protected]
npm notice
 ---> Removed intermediate container 65f93c5c8895
 ---> fb982a52d9f0
Step 21/21 : CMD [ "pnpm", "run", "dockerstart"]
 ---> Running in 9616f8abfefb
 ---> Removed intermediate container 9616f8abfefb
 ---> 915c29f71e5e
Successfully built 915c29f71e5e
Successfully tagged bolt-ai:production
Successfully tagged bolt-ai:latest

running production

docker-compose --profile production up

WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPENAI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "ANTHROPIC_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string. 
WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPENAI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "ANTHROPIC_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string. 
[+] Running 2/2
 ✔ Network boltnew-any-llm_default      Created                                                                    0.1s 
 ✔ Container boltnew-any-llm-bolt-ai-1  Created                                                                    0.2s 
Attaching to bolt-ai-1
bolt-ai-1  | 
bolt-ai-1  | > bolt@ dockerstart /app
bolt-ai-1  | > bindings=$(./bindings.sh) && wrangler pages dev ./build/client $bindings --ip 0.0.0.0 --port 5173 --no-show-interactive-dev-session
bolt-ai-1  | 
bolt-ai-1  | ./bindings.sh: line 12: .env.local: No such file or directory
bolt-ai-1  | 
bolt-ai-1  |  ⛅️ wrangler 3.63.2 (update available 3.91.0)
bolt-ai-1  | ---------------------------------------------
bolt-ai-1  | 
bolt-ai-1  | ✨ Compiled Worker successfully
bolt-ai-1  | [wrangler:inf] Ready on http://0.0.0.0:5173
[wrangler:inf] - http://127.0.0.1:5173
[wrangler:inf] - http://172.18.0.2:5173
⎔ Starting local server...
[wrangler:inf] GET / 200 OK (241ms)
[wrangler:inf] GET /assets/root-BnWMzKOp.css 200 OK (10ms)
[wrangler:inf] GET /assets/tailwind-compat-CC20SAMN.css 200 OK (27ms)
[wrangler:inf] GET /assets/_index-D_NZK3VS.css 200 OK (19ms)
[wrangler:inf] GET /assets/xterm-lQO2bNqs.css 200 OK (31ms)
[wrangler:inf] GET /assets/entry.client-kdhVl-y0.js 200 OK (5ms)
[wrangler:inf] GET /assets/index-CPTzpSUP.css 200 OK (38ms)
[wrangler:inf] GET /assets/root-Cc1p3XHe.js 200 OK (6ms)
[wrangler:inf] GET /assets/components-VKHSbR2h.js 200 OK (164ms)
[wrangler:inf] GET /assets/theme-9upYr29Y.js 200 OK (163ms)
[wrangler:inf] GET /assets/ReactToastify-CYivYX3d.css 200 OK (193ms)
[wrangler:inf] GET /assets/_index-CQlnamSz.js 200 OK (150ms)
[wrangler:inf] GET /assets/_index-DI1I-yso.js 200 OK (153ms)
[wrangler:inf] GET /assets/manifest-0d6251e5.js 200 OK (188ms)
[wrangler:inf] GET /favicon.svg 200 OK (44ms)
[wrangler:inf] GET /assets/dark-plus-KEYLhlmT.js 200 OK (4ms)
[wrangler:inf] GET /assets/light-plus-BsvsQ1iS.js 200 OK (4ms)
[wrangler:inf] GET /assets/shellscript-BZfs-ost.js 200 OK (8ms)
[wrangler:inf] GET /assets/wasm-CsTmP73Z.js 200 OK (10ms)
Error: Network connection lost.
bolt-ai-1  |     at async postToApi (file:///app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:65:22)
bolt-ai-1  |     at async OllamaChatLanguageModel.doStream (file:///app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/src/ollama-chat-language-model.ts:230:50)
bolt-ai-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:345:23)
bolt-ai-1  |     at null.<anonymous> (async file:///app/.wrangler/tmp/dev-KEZSTO/functionsWorker-0.5474869079544444.js:30634:22)
bolt-ai-1  |     at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/util/retry-with-exponential-backoff.ts:37:12)
bolt-ai-1  |     at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:310:13)
bolt-ai-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:387:11)
bolt-ai-1  |     at null.<anonymous> (async file:///app/.wrangler/tmp/dev-KEZSTO/functionsWorker-0.5474869079544444.js:30634:22)
bolt-ai-1  |     at async chatAction (file:///app/build/server/index.js:1325:20)
bolt-ai-1  |     at async Object.callRouteAction (file:///app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16) {
bolt-ai-1  |   retryable: true
bolt-ai-1  | }
[wrangler:inf] POST /api/chat 500 Internal Server Error (31ms)
bolt-ai-1  | 
bolt-ai-1  |  ELIFECYCLE  Command failed.
bolt-ai-1 exited with code 0
bolt-ai-1  | 
bolt-ai-1  | > bolt@ dockerstart /app
bolt-ai-1  | > bindings=$(./bindings.sh) && wrangler pages dev ./build/client $bindings --ip 0.0.0.0 --port 5173 --no-show-interactive-dev-session
bolt-ai-1  | 
bolt-ai-1  | ./bindings.sh: line 12: .env.local: No such file or directory
bolt-ai-1  | 
bolt-ai-1  |  ⛅️ wrangler 3.63.2 (update available 3.91.0)
bolt-ai-1  | ---------------------------------------------
bolt-ai-1  | 
bolt-ai-1  | ✨ Compiled Worker successfully
bolt-ai-1  | [wrangler:inf] Ready on http://0.0.0.0:5173
[wrangler:inf] - http://127.0.0.1:5173
[wrangler:inf] - http://172.18.0.2:5173
⎔ Starting local server...
bolt-ai-1  | 
Gracefully stopping... (press Ctrl+C again to force)
[+] Stopping 1/1
 ✔ Container boltnew-any-llm-bolt-ai-1  Stopped

running production with --env-file

docker-compose --env-file .env.local --profile production up 

[+] Running 1/1
 ✔ Container boltnew-any-llm-bolt-ai-1  Recreated                                                                  0.1s 
Attaching to bolt-ai-1
bolt-ai-1  | 
bolt-ai-1  | > bolt@ dockerstart /app
bolt-ai-1  | > bindings=$(./bindings.sh) && wrangler pages dev ./build/client $bindings --ip 0.0.0.0 --port 5173 --no-show-interactive-dev-session
bolt-ai-1  | 
bolt-ai-1  | ./bindings.sh: line 12: .env.local: No such file or directory
bolt-ai-1  | 
bolt-ai-1  |  ⛅️ wrangler 3.63.2 (update available 3.91.0)
bolt-ai-1  | ---------------------------------------------
bolt-ai-1  | 
bolt-ai-1  | ✨ Compiled Worker successfully
bolt-ai-1  | [wrangler:inf] Ready on http://0.0.0.0:5173
[wrangler:inf] - http://127.0.0.1:5173
[wrangler:inf] - http://172.18.0.2:5173
⎔ Starting local server...
[wrangler:inf] GET / 200 OK (177ms)
[wrangler:inf] GET /assets/manifest-0d6251e5.js 200 OK (10ms)
[wrangler:inf] GET /assets/entry.client-kdhVl-y0.js 200 OK (13ms)
[wrangler:inf] GET /assets/components-VKHSbR2h.js 200 OK (9ms)
[wrangler:inf] GET /assets/theme-9upYr29Y.js 200 OK (14ms)
[wrangler:inf] GET /assets/tailwind-compat-CC20SAMN.css 200 OK (26ms)
[wrangler:inf] GET /assets/root-BnWMzKOp.css 200 OK (30ms)
[wrangler:inf] GET /assets/index-CPTzpSUP.css 200 OK (46ms)
[wrangler:inf] GET /assets/root-Cc1p3XHe.js 200 OK (24ms)
[wrangler:inf] GET /assets/_index-CQlnamSz.js 200 OK (168ms)
[wrangler:inf] GET /assets/_index-DI1I-yso.js 200 OK (173ms)
[wrangler:inf] GET /assets/xterm-lQO2bNqs.css 200 OK (172ms)
[wrangler:inf] GET /assets/ReactToastify-CYivYX3d.css 200 OK (201ms)
[wrangler:inf] GET /assets/_index-D_NZK3VS.css 200 OK (157ms)
[wrangler:inf] GET /favicon.svg 200 OK (18ms)
[wrangler:inf] GET /assets/light-plus-BsvsQ1iS.js 200 OK (3ms)
[wrangler:inf] GET /assets/dark-plus-KEYLhlmT.js 200 OK (4ms)
[wrangler:inf] GET /assets/shellscript-BZfs-ost.js 200 OK (8ms)
[wrangler:inf] GET /assets/wasm-CsTmP73Z.js 200 OK (10ms)
Error: Network connection lost.
bolt-ai-1  |     at async postToApi (file:///app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:65:22)
bolt-ai-1  |     at async OllamaChatLanguageModel.doStream (file:///app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/src/ollama-chat-language-model.ts:230:50)
bolt-ai-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:345:23)
bolt-ai-1  |     at null.<anonymous> (async file:///app/.wrangler/tmp/dev-EUPp12/functionsWorker-0.373416090118563.js:30634:22)
bolt-ai-1  |     at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/util/retry-with-exponential-backoff.ts:37:12)
bolt-ai-1  |     at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:310:13)
bolt-ai-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/core/generate-text/stream-text.ts:387:11)
bolt-ai-1  |     at null.<anonymous> (async file:///app/.wrangler/tmp/dev-EUPp12/functionsWorker-0.373416090118563.js:30634:22)
bolt-ai-1  |     at async chatAction (file:///app/build/server/index.js:1325:20)
bolt-ai-1  |     at async Object.callRouteAction (file:///app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16) {
bolt-ai-1  |   retryable: true
bolt-ai-1  | }
[wrangler:inf] POST /api/chat 500 Internal Server Error (18ms)
bolt-ai-1  | 
Gracefully stopping... (press Ctrl+C again to force)
[+] Stopping 1/1
 ✔ Container boltnew-any-llm-bolt-ai-1  Stopped                                                                    0.2s

building development

npm run dockerbuild

> dockerbuild
> docker build -t bolt-ai:development -t bolt-ai:latest --target bolt-ai-development .

DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  1.492MB
Step 1/34 : ARG BASE=node:20.18.0
Step 2/34 : FROM ${BASE} AS base
 ---> 2fdabcc143dd
Step 3/34 : WORKDIR /app
 ---> Using cache
 ---> d987ea729083
Step 4/34 : COPY package.json pnpm-lock.yaml ./
 ---> Using cache
 ---> 710a28185450
Step 5/34 : RUN corepack enable pnpm && pnpm install
 ---> Using cache
 ---> ad706cbdc539
Step 6/34 : COPY . .
 ---> Using cache
 ---> 828dcb608f2c
Step 7/34 : EXPOSE 5173
 ---> Using cache
 ---> a37fc442e157
Step 8/34 : FROM base AS bolt-ai-production
 ---> a37fc442e157
Step 9/34 : ARG GROQ_API_KEY
 ---> Using cache
 ---> 93e10561d311
Step 10/34 : ARG HuggingFace_API_KEY
 ---> Using cache
 ---> 5b7b546828fa
Step 11/34 : ARG OPENAI_API_KEY
 ---> Using cache
 ---> 2f60ac35b83f
Step 12/34 : ARG ANTHROPIC_API_KEY
 ---> Using cache
 ---> 54a150dc4560
Step 13/34 : ARG OPEN_ROUTER_API_KEY
 ---> Using cache
 ---> 3c2b22134fc0
Step 14/34 : ARG GOOGLE_GENERATIVE_AI_API_KEY
 ---> Using cache
 ---> eb4154728db2
Step 15/34 : ARG OLLAMA_API_BASE_URL
 ---> Using cache
 ---> dc835ad55275
Step 16/34 : ARG VITE_LOG_LEVEL=debug
 ---> Using cache
 ---> d841d46f2eed
Step 17/34 : ARG DEFAULT_NUM_CTX
 ---> Using cache
 ---> 2b60709bad23
Step 18/34 : ENV WRANGLER_SEND_METRICS=false     GROQ_API_KEY=${GROQ_API_KEY}     HuggingFace_KEY=${HuggingFace_API_KEY}     OPENAI_API_KEY=${OPENAI_API_KEY}     ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY}     OPEN_ROUTER_API_KEY=${OPEN_ROUTER_API_KEY}     GOOGLE_GENERATIVE_AI_API_KEY=${GOOGLE_GENERATIVE_AI_API_KEY}     OLLAMA_API_BASE_URL=${OLLAMA_API_BASE_URL}     VITE_LOG_LEVEL=${VITE_LOG_LEVEL}     DEFAULT_NUM_CTX=${DEFAULT_NUM_CTX}
 ---> Using cache
 ---> 3752d9354484
Step 19/34 : RUN mkdir -p /root/.config/.wrangler &&     echo '{"enabled":false}' > /root/.config/.wrangler/metrics.json
 ---> Using cache
 ---> 038210f58aab
Step 20/34 : RUN npm run build
 ---> Using cache
 ---> fb982a52d9f0
Step 21/34 : CMD [ "pnpm", "run", "dockerstart"]
 ---> Using cache
 ---> 915c29f71e5e
Step 22/34 : FROM base AS bolt-ai-development
 ---> a37fc442e157
Step 23/34 : ARG GROQ_API_KEY
 ---> Using cache
 ---> 93e10561d311
Step 24/34 : ARG HuggingFace
 ---> Running in 907f5a6c8f23
 ---> Removed intermediate container 907f5a6c8f23
 ---> 63efd1c6ba61
Step 25/34 : ARG OPENAI_API_KEY
 ---> Running in c981c0f4aad2
 ---> Removed intermediate container c981c0f4aad2
 ---> c42d7c960534
Step 26/34 : ARG ANTHROPIC_API_KEY
 ---> Running in 73ec746b78e8
 ---> Removed intermediate container 73ec746b78e8
 ---> 448d59faa590
Step 27/34 : ARG OPEN_ROUTER_API_KEY
 ---> Running in 77258abe119c
 ---> Removed intermediate container 77258abe119c
 ---> 89bc2a7a318e
Step 28/34 : ARG GOOGLE_GENERATIVE_AI_API_KEY
 ---> Running in a12c98180441
 ---> Removed intermediate container a12c98180441
 ---> 689a050942a3
Step 29/34 : ARG OLLAMA_API_BASE_URL
 ---> Running in cf16266ef467
 ---> Removed intermediate container cf16266ef467
 ---> 84c702642e75
Step 30/34 : ARG VITE_LOG_LEVEL=debug
 ---> Running in 4ff2bcdbd1c8
 ---> Removed intermediate container 4ff2bcdbd1c8
 ---> afeeed457523
Step 31/34 : ARG DEFAULT_NUM_CTX
 ---> Running in 90c6a3741b14
 ---> Removed intermediate container 90c6a3741b14
 ---> cb6f48e50395
Step 32/34 : ENV GROQ_API_KEY=${GROQ_API_KEY}     HuggingFace_API_KEY=${HuggingFace_API_KEY}     OPENAI_API_KEY=${OPENAI_API_KEY}     ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY}     OPEN_ROUTER_API_KEY=${OPEN_ROUTER_API_KEY}     GOOGLE_GENERATIVE_AI_API_KEY=${GOOGLE_GENERATIVE_AI_API_KEY}     OLLAMA_API_BASE_URL=${OLLAMA_API_BASE_URL}     VITE_LOG_LEVEL=${VITE_LOG_LEVEL}     DEFAULT_NUM_CTX=${DEFAULT_NUM_CTX}
 ---> Running in c945089cef47
 ---> Removed intermediate container c945089cef47
 ---> 64186d0f8bc0
Step 33/34 : RUN mkdir -p ${WORKDIR}/run
 ---> Running in 4327a8bd686e
 ---> Removed intermediate container 4327a8bd686e
 ---> 99459b830fd7
Step 34/34 : CMD pnpm run dev --host
 ---> Running in 837ade01448e
 ---> Removed intermediate container 837ade01448e
 ---> a7915ebccac8
Successfully built a7915ebccac8
Successfully tagged bolt-ai:development
Successfully tagged bolt-ai:latest

running development

docker-compose --profile development up

WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPENAI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "ANTHROPIC_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string. 
WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPENAI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "ANTHROPIC_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string. 
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string. 
[+] Running 1/1
 ✔ Container boltnew-any-llm-bolt-ai-dev-1  Recreated                                                                                                                                             0.1s 
Attaching to bolt-ai-dev-1
bolt-ai-dev-1  | 
bolt-ai-dev-1  | > bolt@ dev /app
bolt-ai-dev-1  | > remix vite:dev "--host" "0.0.0.0"
bolt-ai-dev-1  | 
bolt-ai-dev-1  |   ➜  Local:   http://localhost:5173/
bolt-ai-dev-1  |   ➜  Network: http://172.18.0.2:5173/
bolt-ai-dev-1  | [unocss] failed to load icon "ph:folder-simple-upload"
bolt-ai-dev-1  | RetryError [AI_RetryError]: Failed after 3 attempts. Last error: Cannot connect to API: connect ECONNREFUSED 172.17.0.1:11434
bolt-ai-dev-1  |     at _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:98:13)
bolt-ai-dev-1  |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |     at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |     at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |     at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |     at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |     at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |     at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |     at async Promise.all (index 1)
bolt-ai-dev-1  |     at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |     at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |     at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |     at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |     at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |     at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |     at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |     at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |   cause: undefined,
bolt-ai-dev-1  |   reason: 'maxRetriesExceeded',
bolt-ai-dev-1  |   errors: [
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 172.17.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://host.docker.internal:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 172.17.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://host.docker.internal:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 172.17.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://host.docker.internal:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     }
bolt-ai-dev-1  |   ],
bolt-ai-dev-1  |   lastError: APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 172.17.0.1:11434
bolt-ai-dev-1  |       at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |       at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |       at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |       at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |       at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |       at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |       at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |       at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |       at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |       at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |       at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |       at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |       at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |       at async Promise.all (index 1)
bolt-ai-dev-1  |       at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |       at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |       at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |       at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |       at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |       at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |       at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |       at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |     cause: Error: connect ECONNREFUSED 172.17.0.1:11434
bolt-ai-dev-1  |         at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1607:16)
bolt-ai-dev-1  |         at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
bolt-ai-dev-1  |       errno: -111,
bolt-ai-dev-1  |       code: 'ECONNREFUSED',
bolt-ai-dev-1  |       syscall: 'connect',
bolt-ai-dev-1  |       address: '172.17.0.1',
bolt-ai-dev-1  |       port: 11434
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     url: 'http://host.docker.internal:11434/api/chat',
bolt-ai-dev-1  |     requestBodyValues: {
bolt-ai-dev-1  |       format: undefined,
bolt-ai-dev-1  |       model: 'claude-3-5-sonnet-latest',
bolt-ai-dev-1  |       options: [Object],
bolt-ai-dev-1  |       messages: [Array],
bolt-ai-dev-1  |       tools: undefined
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     statusCode: undefined,
bolt-ai-dev-1  |     responseHeaders: undefined,
bolt-ai-dev-1  |     responseBody: undefined,
bolt-ai-dev-1  |     isRetryable: true,
bolt-ai-dev-1  |     data: undefined,
bolt-ai-dev-1  |     [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |     [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |   },
bolt-ai-dev-1  |   [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |   [Symbol(vercel.ai.error.AI_RetryError)]: true
bolt-ai-dev-1  | }

running development with --env-file

docker-compose --env-file .env.local --profile development up

[+] Running 1/0
 ✔ Container boltnew-any-llm-bolt-ai-dev-1  Running                                                                                                                                               0.0s 
Attaching to bolt-ai-dev-1
bolt-ai-dev-1  | RetryError [AI_RetryError]: Failed after 3 attempts. Last error: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |     at _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:98:13)
bolt-ai-dev-1  |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |     at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |     at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |     at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |     at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |     at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |     at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |     at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |     at async Promise.all (index 1)
bolt-ai-dev-1  |     at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |     at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |     at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |     at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |     at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |     at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |     at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |     at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |   cause: undefined,
bolt-ai-dev-1  |   reason: 'maxRetriesExceeded',
bolt-ai-dev-1  |   errors: [
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |         at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |         at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |         at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |         at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |         at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |         at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |         at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |         at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |         at async Promise.all (index 1)
bolt-ai-dev-1  |         at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |         at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |         at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |         at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |         at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |         at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |         at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |         at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |       cause: [Error],
bolt-ai-dev-1  |       url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |       requestBodyValues: [Object],
bolt-ai-dev-1  |       statusCode: undefined,
bolt-ai-dev-1  |       responseHeaders: undefined,
bolt-ai-dev-1  |       responseBody: undefined,
bolt-ai-dev-1  |       isRetryable: true,
bolt-ai-dev-1  |       data: undefined,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |       [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |     }
bolt-ai-dev-1  |   ],
bolt-ai-dev-1  |   lastError: APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |       at postToApi (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:446:15)
bolt-ai-dev-1  |       at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
bolt-ai-dev-1  |       at async OllamaChatLanguageModel.doStream (/app/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
bolt-ai-dev-1  |       at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
bolt-ai-dev-1  |       at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |       at async _retryWithExponentialBackoff (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
bolt-ai-dev-1  |       at async startStep (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
bolt-ai-dev-1  |       at async fn (file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
bolt-ai-dev-1  |       at async file:///app/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
bolt-ai-dev-1  |       at async chatAction (/app/app/routes/api.chat.ts:64:20)
bolt-ai-dev-1  |       at async Object.callRouteAction (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
bolt-ai-dev-1  |       at async /app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
bolt-ai-dev-1  |       at async callLoaderOrAction (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
bolt-ai-dev-1  |       at async Promise.all (index 1)
bolt-ai-dev-1  |       at async callDataStrategyImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
bolt-ai-dev-1  |       at async callDataStrategy (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
bolt-ai-dev-1  |       at async submit (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
bolt-ai-dev-1  |       at async queryImpl (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
bolt-ai-dev-1  |       at async Object.queryRoute (/app/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
bolt-ai-dev-1  |       at async handleResourceRequest (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
bolt-ai-dev-1  |       at async requestHandler (/app/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
bolt-ai-dev-1  |       at async /app/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
bolt-ai-dev-1  |     cause: Error: connect ECONNREFUSED 127.0.0.1:11434
bolt-ai-dev-1  |         at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1607:16)
bolt-ai-dev-1  |         at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
bolt-ai-dev-1  |       errno: -111,
bolt-ai-dev-1  |       code: 'ECONNREFUSED',
bolt-ai-dev-1  |       syscall: 'connect',
bolt-ai-dev-1  |       address: '127.0.0.1',
bolt-ai-dev-1  |       port: 11434
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     url: 'http://127.0.0.1:11434/api/chat',
bolt-ai-dev-1  |     requestBodyValues: {
bolt-ai-dev-1  |       format: undefined,
bolt-ai-dev-1  |       model: 'claude-3-5-sonnet-latest',
bolt-ai-dev-1  |       options: [Object],
bolt-ai-dev-1  |       messages: [Array],
bolt-ai-dev-1  |       tools: undefined
bolt-ai-dev-1  |     },
bolt-ai-dev-1  |     statusCode: undefined,
bolt-ai-dev-1  |     responseHeaders: undefined,
bolt-ai-dev-1  |     responseBody: undefined,
bolt-ai-dev-1  |     isRetryable: true,
bolt-ai-dev-1  |     data: undefined,
bolt-ai-dev-1  |     [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |     [Symbol(vercel.ai.error.AI_APICallError)]: true
bolt-ai-dev-1  |   },
bolt-ai-dev-1  |   [Symbol(vercel.ai.error)]: true,
bolt-ai-dev-1  |   [Symbol(vercel.ai.error.AI_RetryError)]: true
bolt-ai-dev-1  | }
Gracefully stopping... (press Ctrl+C again to force)
[+] Stopping 1/1
 ✔ Container boltnew-any-llm-bolt-ai-dev-1  Stopped

Restarting the docker containers via docker container restart boltnew-any-llm-bolt-ai-1 and docker container restart boltnew-any-llm-bolt-ai-dev-1 did not help either.

Retrieving dependencies on the bare system went fine

pnpm install

Lockfile is up to date, resolution step is skipped
Packages: +1156
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

   ╭──────────────────────────────────────────────────────────────────╮
   │                                                                  │
   │                Update available! 9.12.3 → 9.14.3.                │
   │   Changelog: https://github.com/pnpm/pnpm/releases/tag/v9.14.3   │
   │                Run "pnpm add -g pnpm" to update.                 │
   │                                                                  │
   │         Follow @pnpmjs for updates: https://x.com/pnpmjs         │
   │                                                                  │
   ╰──────────────────────────────────────────────────────────────────╯

Downloading @cloudflare/[email protected]: 39.74 MB/39.74 MB, done
Progress: resolved 1156, reused 0, downloaded 1156, added 1156, done
node_modules/.pnpm/[email protected]/node_modules/esbuild: Running postinstall script, done in 75ms
node_modules/.pnpm/[email protected]/node_modules/esbuild: Running postinstall script, done in 75ms
node_modules/.pnpm/[email protected]/node_modules/workerd: Running postinstall script, done in 208ms
node_modules/.pnpm/[email protected]/node_modules/esbuild: Running postinstall script, done in 199ms

dependencies:
+ @ai-sdk/anthropic 0.0.39
+ @ai-sdk/cohere 1.0.1
+ @ai-sdk/google 0.0.52
+ @ai-sdk/mistral 0.0.43
+ @ai-sdk/openai 0.0.66
+ @codemirror/autocomplete 6.17.0
+ @codemirror/commands 6.6.0
+ @codemirror/lang-cpp 6.0.2
+ @codemirror/lang-css 6.2.1
+ @codemirror/lang-html 6.4.9
+ @codemirror/lang-javascript 6.2.2
+ @codemirror/lang-json 6.0.1
+ @codemirror/lang-markdown 6.2.5
+ @codemirror/lang-python 6.1.6
+ @codemirror/lang-sass 6.0.2
+ @codemirror/lang-wast 6.0.2
+ @codemirror/language 6.10.2
+ @codemirror/search 6.5.6
+ @codemirror/state 6.4.1
+ @codemirror/view 6.28.4
+ @iconify-json/ph 1.1.13
+ @iconify-json/svg-spinners 1.1.2
+ @lezer/highlight 1.2.0
+ @nanostores/react 0.7.2
+ @octokit/rest 21.0.2
+ @octokit/types 13.6.1
+ @openrouter/ai-sdk-provider 0.0.5
+ @radix-ui/react-dialog 1.1.1
+ @radix-ui/react-dropdown-menu 2.1.1
+ @radix-ui/react-tooltip 1.1.4
+ @remix-run/cloudflare 2.10.2
+ @remix-run/cloudflare-pages 2.10.2
+ @remix-run/react 2.10.2
+ @uiw/codemirror-theme-vscode 4.23.0
+ @unocss/reset 0.61.3
+ @webcontainer/api 1.3.0-internal.10
+ @xterm/addon-fit 0.10.0
+ @xterm/addon-web-links 0.11.0
+ @xterm/xterm 5.5.0
+ ai 3.4.9
+ date-fns 3.6.0
+ diff 5.2.0
+ file-saver 2.0.5
+ framer-motion 11.2.12
+ ignore 6.0.2
+ isbot 4.4.0
+ istextorbinary 9.5.0
+ jose 5.6.3
+ js-cookie 3.0.5
+ jszip 3.10.1
+ nanostores 0.10.3
+ ollama-ai-provider 0.15.2
+ react 18.3.1
+ react-dom 18.3.1
+ react-hotkeys-hook 4.5.0
+ react-markdown 9.0.1
+ react-resizable-panels 2.0.20
+ react-toastify 10.0.5
+ rehype-raw 7.0.0
+ rehype-sanitize 6.0.0
+ remark-gfm 4.0.0
+ remix-island 0.2.0
+ remix-utils 7.6.0
+ shiki 1.9.1
+ unist-util-visit 5.0.0

devDependencies:
+ @blitz/eslint-plugin 0.1.0
+ @cloudflare/workers-types 4.20240620.0
+ @remix-run/dev 2.10.0
+ @types/diff 5.2.1
+ @types/file-saver 2.0.7
+ @types/js-cookie 3.0.6
+ @types/react 18.3.3
+ @types/react-dom 18.3.0
+ fast-glob 3.3.2
+ husky 9.1.7
+ is-ci 3.0.1
+ node-fetch 3.3.2
+ prettier 3.3.2
+ sass-embedded 1.80.4
+ typescript 5.5.2
+ unified 11.0.5
+ unocss 0.61.3
+ vite 5.3.1
+ vite-plugin-node-polyfills 0.22.0
+ vite-plugin-optimize-css-modules 1.1.0
+ vite-tsconfig-paths 4.3.2
+ vitest 2.0.1
+ wrangler 3.63.2
+ zod 3.23.8

> bolt@ prepare /build/bolt.new-any-llm
> husky


Done in 8.9s

Yet I can not even

use it outside of docker

pnpm run dev

> bolt@ dev /build/bolt.new-any-llm
> remix vite:dev

  ➜  Local:   http://localhost:5173/
  ➜  Network: use --host to expose
  ➜  press h + enter to show help
The file does not exist at "/build/bolt.new-any-llm/node_modules/.vite/deps/@nanostores_react.js?v=b89e21a8" which is in the optimize deps directory. The dependency might be incompatible with the dep optimizer. Try adding it to `optimizeDeps.exclude`.
The file does not exist at "/build/bolt.new-any-llm/node_modules/.vite/deps/chunk-SIU3P4NL.js?v=b89e21a8" which is in the optimize deps directory. The dependency might be incompatible with the dep optimizer. Try adding it to `optimizeDeps.exclude`.
[unocss] failed to load icon "ph:folder-simple-upload"
The file does not exist at "/build/bolt.new-any-llm/node_modules/.vite/deps/chunk-HWNAV2N6.js?v=b89e21a8" which is in the optimize deps directory. The dependency might be incompatible with the dep optimizer. Try adding it to `optimizeDeps.exclude`.
The file does not exist at "/build/bolt.new-any-llm/node_modules/.vite/deps/chunk-D7OBYB2I.js?v=b89e21a8" which is in the optimize deps directory. The dependency might be incompatible with the dep optimizer. Try adding it to `optimizeDeps.exclude`.
The file does not exist at "/build/bolt.new-any-llm/node_modules/.vite/deps/chunk-QWPA66WM.js?v=b89e21a8" which is in the optimize deps directory. The dependency might be incompatible with the dep optimizer. Try adding it to `optimizeDeps.exclude`.
The file does not exist at "/build/bolt.new-any-llm/node_modules/.vite/deps/chunk-TQAFIBNO.js?v=b89e21a8" which is in the optimize deps directory. The dependency might be incompatible with the dep optimizer. Try adding it to `optimizeDeps.exclude`.
The file does not exist at "/build/bolt.new-any-llm/node_modules/.vite/deps/shellscript-OF2IHCQP.js?v=b89e21a8" which is in the optimize deps directory. The dependency might be incompatible with the dep optimizer. Try adding it to `optimizeDeps.exclude`.
8:26:02 AM [vite] ✨ new dependencies optimized: vite-plugin-node-polyfills/shims/buffer, vite-plugin-node-polyfills/shims/global, vite-plugin-node-polyfills/shims/process, remix-utils/client-only, nanostores, @nanostores/react, js-cookie, @radix-ui/react-tooltip, ai/react, framer-motion, react-toastify, diff, node:path, jszip, file-saver, @octokit/rest, date-fns, ignore, @radix-ui/react-dialog, react-resizable-panels, istextorbinary, @webcontainer/api, @codemirror/autocomplete, @codemirror/commands, @codemirror/language, @codemirror/search, @codemirror/state, @codemirror/view, react-markdown, @radix-ui/react-dropdown-menu, @xterm/addon-fit, @xterm/addon-web-links, @xterm/xterm, rehype-raw, remark-gfm, rehype-sanitize, unist-util-visit, @uiw/codemirror-theme-vscode, @codemirror/lang-javascript, @codemirror/lang-html, @codemirror/lang-css, @codemirror/lang-sass, @codemirror/lang-json, @codemirror/lang-markdown, @codemirror/lang-wast, @codemirror/lang-python, @codemirror/lang-cpp, shiki, @remix-run/cloudflare
8:26:02 AM [vite] ✨ optimized dependencies changed. reloading
8:26:03 AM [vite] ✨ new dependencies optimized: remix-island
8:26:03 AM [vite] ✨ optimized dependencies changed. reloading
APICallError [AI_APICallError]: Not Found
    at /build/bolt.new-any-llm/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:505:14
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async postToApi (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected][email protected]/node_modules/@ai-sdk/provider-utils/dist/index.js:398:28)
    at async OllamaChatLanguageModel.doStream (/build/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected]/node_modules/ollama-ai-provider/dist/index.js:485:50)
    at async fn (file:///build/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3938:23)
    at async file:///build/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
    at async _retryWithExponentialBackoff (file:///build/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:86:12)
    at async startStep (file:///build/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3903:13)
    at async fn (file:///build/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:3977:11)
    at async file:///build/bolt.new-any-llm/node_modules/.pnpm/[email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/ai/dist/index.mjs:256:22
    at async chatAction (/build/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
    at async Object.callRouteAction (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:37:16)
    at async /build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4612:21
    at async callLoaderOrAction (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4677:16)
    at async Promise.all (index 1)
    at async callDataStrategyImpl (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4552:17)
    at async callDataStrategy (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:4041:19)
    at async submit (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3900:21)
    at async queryImpl (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3858:22)
    at async Object.queryRoute (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]/node_modules/@remix-run/router/dist/router.cjs.js:3827:18)
    at async handleResourceRequest (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:413:20)
    at async requestHandler (/build/bolt.new-any-llm/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:18)
    at async /build/bolt.new-any-llm/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_qwyxqdhnwp3srgtibfrlais3ge/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
  cause: undefined,
  url: 'http://127.0.0.1:11434/api/chat',
  requestBodyValues: {
    format: undefined,
    model: 'claude-3-5-sonnet-latest',
    options: { num_ctx: 131072, num_predict: 8000, temperature: 0 },
    messages: [ [Object], [Object], [Object], [Object], [Object], [Object] ],
    tools: undefined
  },
  statusCode: 404,
  responseHeaders: {
    'content-length': '78',
    'content-type': 'application/json; charset=utf-8',
    date: 'Fri, 29 Nov 2024 07:26:28 GMT'
  },
  responseBody: '{"error":"model \\"claude-3-5-sonnet-latest\\" not found, try pulling it first"}',
  isRetryable: false,
  data: undefined,
  [Symbol(vercel.ai.error)]: true,
  [Symbol(vercel.ai.error.AI_APICallError)]: true
}

In the web UI, I selected "Ollama", and I can see the two models I have installed (one of which is the extended context), so some part of oTToDEV is communicating with my Ollama server.

recallmenot · 2024-11-29T10:53:12Z

I still can not launch oTTo through docker, but I managed to make the bare version work by undoing 12dcb8d.
Launched with pnpm run preview it was able to connect to Ollama.

coleam00 · 2024-11-29T23:59:28Z

Yes we pushed a fix for this now @recallmenot! It shouldn't try to use Claude anymore when you have Ollama selected either now.

sid-newby · 2024-12-02T06:27:20Z

same issue with non-docker implementation, although im not using ollama. still errors on ollama. also tailwind is bork.

❯ pnpm run dev

> bolt@ dev /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main
> remix vite:dev

 warn  Route discovery/manifest behavior is changing in React Router v7
┃ You can use the `v3_lazyRouteDiscovery` future flag to opt-in early.
┃ -> https://remix.run/docs/en/2.13.1/start/future-flags#v3_lazyRouteDiscovery
┗
 warn  Data fetching is changing to a single fetch in React Router v7
┃ You can use the `v3_singleFetch` future flag to opt-in early.
┃ -> https://remix.run/docs/en/2.13.1/start/future-flags#v3_singleFetch
┗
Re-optimizing dependencies because lockfile has changed
  ➜  Local:   http://localhost:5173/
  ➜  Network: use --host to expose
  ➜  press h + enter to show help

warn - The `content` option in your Tailwind CSS configuration is missing or empty.
warn - Configure your content sources or your generated CSS will be missing styles.
warn - https://tailwindcss.com/docs/content-configuration
Error getting Ollama models: TypeError: fetch failed
    at node:internal/deps/undici/undici:13178:13
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.getOllamaModels [as getDynamicModels] (/Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/utils/constants.ts:294:22)
    at async Promise.all (index 0)
    at Module.initializeModelList (/Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/utils/constants.ts:365:9)
    at handleRequest (/Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/entry.server.tsx:30:3)
    at handleDocumentRequest (/Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:340:12)
    at requestHandler (/Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/node_modules/.pnpm/@[email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:160:18)
    at /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/node_modules/.pnpm/@[email protected]_@[email protected][email protected][email protected][email protected]_typ_zyxju6yjkqxopc2lqyhhptpywm/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:25 {
  [cause]: AggregateError: 
      at internalConnectMultiple (node:net:1118:18)
      at afterConnectMultiple (node:net:1685:7)
      at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
    code: 'ECONNREFUSED',
    [errors]: [ [Error], [Error] ]
  }
}
Deprecation Warning: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.

More info and automated migrator: https://sass-lang.com/d/import

  ╷
1 │ @import './variables.scss';
  │         ^^^^^^^^^^^^^^^^^^
  ╵
    /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/styles/index.scss 1:9  root stylesheet

Deprecation Warning: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.

More info and automated migrator: https://sass-lang.com/d/import

  ╷
2 │ @import './z-index.scss';
  │         ^^^^^^^^^^^^^^^^
  ╵
    /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/styles/index.scss 2:9  root stylesheet

Deprecation Warning: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.

More info and automated migrator: https://sass-lang.com/d/import

  ╷
3 │ @import './animations.scss';
  │         ^^^^^^^^^^^^^^^^^^^
  ╵
    /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/styles/index.scss 3:9  root stylesheet

Deprecation Warning: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.

More info and automated migrator: https://sass-lang.com/d/import

  ╷
4 │ @import './components/terminal.scss';
  │         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  ╵
    /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/styles/index.scss 4:9  root stylesheet

Deprecation Warning: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.

More info and automated migrator: https://sass-lang.com/d/import

  ╷
5 │ @import './components/resize-handle.scss';
  │         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  ╵
    /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/styles/index.scss 5:9  root stylesheet

Warning: 3 repetitive deprecation warnings omitted.
Run in verbose mode to see all warnings.

12:20:30 AM [vite] Internal server error: [postcss] /Users/sidnewby/Prog/ottodev/bolt.new-any-llm-main/app/styles/index.scss:4:3: 'colors.alpha.gray.10' does not exist in your theme config. 'colors' has the following keys: 'inherit', 'current', 'transparent', 'black', 'white', 'slate', 'gray', 'zinc', 'neutral', 'stone', 'red', 'orange', 'amber', 'yellow', 'lime', 'green', 'emerald', 'teal', 'cyan', 'sky', 'blue', 'indigo', 'violet', 'purple', 'fuchsia', 'pink', 'rose'

dustinwloring1988 · 2024-12-02T16:26:37Z

please check the latest

aliasfoxkde · 2024-12-03T01:41:48Z

This happens with the latest build. Just tested a clean build but latest pnpm and all packages. The issue is caused by a getOllamaBaseUrl() check. This probably shouldn't be an error, it probably shouldn't even be a warning because you shouldn't be required to supply the OllamaBaseUrl:

See apps/utils/constants.ts, line 319:

async function getOllamaModels(): Promise<ModelInfo[]> {
  /*
   * if (typeof window === 'undefined') {
   * return [];
   * }
   */

  try {
    const baseUrl = getOllamaBaseUrl();
    const response = await fetch(`${baseUrl}/api/tags`);
    const data = (await response.json()) as OllamaApiResponse;

    return data.models.map((model: OllamaModel) => ({
      name: model.name,
      label: `${model.name} (${model.details.parameter_size})`,
      provider: 'Ollama',
      maxTokenAllowed: 8000,
    }));
  } catch (e) {
    console.error('Error getting Ollama models:', e);
    return [];
  }
}

I suppressed the error in my code and everything works fine. And I'll pull the latest version when an official fix/decision is made.

dustinwloring1988 · 2024-12-03T01:55:13Z

thanks for the information I will look more into this tomorrow.

aliasfoxkde · 2024-12-03T02:59:28Z

Actually, the code was right there. I just uncommented it:

  if (typeof window === 'undefined') {
    return [];
  }

Not sure why or when it was commented out.

dustinwloring1988 · 2024-12-03T10:27:22Z

We ended up commenting it out due to an issue it was causing, dose everything else work after this if so fell free to make a pull request so it can be merged.

dustinwloring1988 · 2024-12-04T11:19:49Z

If you know how to try pull requests try this one let me know if it fixes it as it fixes a couple of issues: #526

rafaferreira · 2024-12-07T17:31:56Z

I am having the same issue as what was reported here!

It looks like it is ignoring the .env.local file

docker compose --profile production up
WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPENAI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "ANTHROPIC_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "TOGETHER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "TOGETHER_API_BASE_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "GROQ_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "HuggingFace_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPENAI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "ANTHROPIC_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPEN_ROUTER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "GOOGLE_GENERATIVE_AI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "OLLAMA_API_BASE_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "TOGETHER_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "TOGETHER_API_BASE_URL" variable is not set. Defaulting to a blank string.
[+] Running 1/0

thecodacus · 2025-01-06T07:52:01Z

it will ignore the envfile as its in the .docker ignore list

can you try this PR #1008
and set the urls from settings window

dustinwloring1988 added the question Further information is requested label Dec 2, 2024

dustinwloring1988 mentioned this issue Dec 3, 2024

fix: dockerstart fix in package.json for production build (Ready for review) #526

Closed

basicbloke mentioned this issue Dec 13, 2024

Move Ollama to beginning of PROVIDER_LIST #686

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Docker Production Setup Fails: Env Variables Missing and Ollama Connection Error #353

Docker Production Setup Fails: Env Variables Missing and Ollama Connection Error #353

av1155 commented Nov 20, 2024 •

edited

Loading

chrismahoney commented Nov 20, 2024 •

edited

Loading

av1155 commented Nov 20, 2024

chrismahoney commented Nov 20, 2024

yamini commented Nov 21, 2024

av1155 commented Nov 21, 2024

dimanicus commented Nov 21, 2024 •

edited

Loading

jeugregg commented Nov 21, 2024 •

edited

Loading

ColbyAttack commented Nov 21, 2024

coleam00 commented Nov 22, 2024

recallmenot commented Nov 29, 2024

recallmenot commented Nov 29, 2024

coleam00 commented Nov 29, 2024

sid-newby commented Dec 2, 2024 •

edited

Loading

dustinwloring1988 commented Dec 2, 2024

aliasfoxkde commented Dec 3, 2024 •

edited

Loading

dustinwloring1988 commented Dec 3, 2024

aliasfoxkde commented Dec 3, 2024

dustinwloring1988 commented Dec 3, 2024 •

edited

Loading

dustinwloring1988 commented Dec 4, 2024

rafaferreira commented Dec 7, 2024

thecodacus commented Jan 6, 2025 •

edited

Loading

Docker Production Setup Fails: Env Variables Missing and Ollama Connection Error #353

Docker Production Setup Fails: Env Variables Missing and Ollama Connection Error #353

Comments

av1155 commented Nov 20, 2024 • edited Loading

Describe the bug

Issues:

Additional Context:

Full Log Output:

Link to the Bolt URL that caused the error

Steps to reproduce

Expected behavior

The Docker setup should:

Actual Behavior:

Screen Recording / Screenshot

Platform

Additional context

chrismahoney commented Nov 20, 2024 • edited Loading

av1155 commented Nov 20, 2024

chrismahoney commented Nov 20, 2024

yamini commented Nov 21, 2024

av1155 commented Nov 21, 2024

Log:

dimanicus commented Nov 21, 2024 • edited Loading

jeugregg commented Nov 21, 2024 • edited Loading

ColbyAttack commented Nov 21, 2024

coleam00 commented Nov 22, 2024

recallmenot commented Nov 29, 2024

recallmenot commented Nov 29, 2024

coleam00 commented Nov 29, 2024

sid-newby commented Dec 2, 2024 • edited Loading

dustinwloring1988 commented Dec 2, 2024

aliasfoxkde commented Dec 3, 2024 • edited Loading

dustinwloring1988 commented Dec 3, 2024

aliasfoxkde commented Dec 3, 2024

dustinwloring1988 commented Dec 3, 2024 • edited Loading

dustinwloring1988 commented Dec 4, 2024

rafaferreira commented Dec 7, 2024

thecodacus commented Jan 6, 2025 • edited Loading

av1155 commented Nov 20, 2024 •

edited

Loading

chrismahoney commented Nov 20, 2024 •

edited

Loading

dimanicus commented Nov 21, 2024 •

edited

Loading

jeugregg commented Nov 21, 2024 •

edited

Loading

sid-newby commented Dec 2, 2024 •

edited

Loading

aliasfoxkde commented Dec 3, 2024 •

edited

Loading

dustinwloring1988 commented Dec 3, 2024 •

edited

Loading

thecodacus commented Jan 6, 2025 •

edited

Loading