Is there a way to implement this into open web UI?

[GoudaCouda]

Pretty much just title I have set the open web UI to my api port but i cant get it to work

[erew123]

@GoudaCouda This is all I know about it #344 (comment)

People claim it works

[GoudaCouda]

hmm

i am getting these errors in my open web UI docker env not sure what to do honestly but ill have to mess around with it

INFO: 172.17.0.1:36346 - "POST /audio/api/v1/config/update HTTP/1.1" 200 OK
INFO: 172.17.0.1:36346 - "GET /api/config HTTP/1.1" 200 OK
INFO: 172.17.0.1:51926 - "GET /api/v1/chats/76b736bf-e52c-48fe-a1a7-579fb7ccc5f1 HTTP/1.1" 200 OK
INFO: 172.17.0.1:51926 - "GET /api/v1/chats/76b736bf-e52c-48fe-a1a7-579fb7ccc5f1/tags HTTP/1.1" 200 OK
INFO: 172.17.0.1:51926 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK
INFO: 172.17.0.1:51926 - "GET /ollama/api/version HTTP/1.1" 200 OK
ERROR [open_webui.apps.audio.main] Cannot connect to host 127.0.0.1:7851 ssl:default [Connect call failed ('127.0.0.1', 7851)]
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1061, in _wrap_create_connection
sock = await aiohappyeyeballs.start_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 104, in start_connection
raise first_exception
File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 82, in start_connection
sock = await _connect_sock(
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 174, in _connect_sock
await loop.sock_connect(sock, address)
File "uvloop/loop.pyx", line 2633, in sock_connect
File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb
ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 7851)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/app/backend/open_webui/apps/audio/main.py", line 299, in speech
async with session.post(
File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1355, in aenter
self._resp: _RetType = await self._coro
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 659, in _request
conn = await self._connector.connect(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 557, in connect
proto = await self._create_connection(req, traces, timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1002, in _create_connection
_, proto = await self._create_direct_connection(req, traces, timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1336, in _create_direct_connection
raise last_exc
File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1305, in _create_direct_connection
transp, proto = await self._wrap_create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1076, in _wrap_create_connection
raise client_error(req.connection_key, exc) from exc
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:7851 ssl:default [Connect call failed ('127.0.0.1', 7851)]
INFO: 172.17.0.1:51926 - "POST /audio/api/v1/speech HTTP/1.1" 500 Internal Server Error
ERROR: Exception in ASGI application

• Exception Group Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 192, in call
  | await response(scope, wrapped_receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 258, in call
  | async with anyio.create_task_group() as task_group:
  | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 763, in aexit
  | raise BaseExceptionGroup(
  | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
  +-+---------------- 1 ----------------
  | Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
  | result = await app( # type: ignore[func-returns-value]
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
  | return await self.app(scope, receive, send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
  | await super().call(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
  | await self.app(scope, receive, _send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
  | await self.simple_response(scope, receive, send, request_headers=headers)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 148, in simple_response
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
  | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
  | await route.handle(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
  | await super().call(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
  | await self.app(scope, receive, _send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
  | await self.simple_response(scope, receive, send, request_headers=headers)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 148, in simple_response
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
  | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
  | await route.handle(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 297, in handle
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 77, in app
  | await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 72, in app
  | response = await func(request)
  | ^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 278, in app
  | raw_response = await run_endpoint_function(
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
  | return await dependant.call(**values)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/app/backend/open_webui/apps/audio/main.py", line 325, in speech
  | status_code=getattr(r, "status", 500),
  | ^
  | UnboundLocalError: cannot access local variable 'r' where it is not associated with a value
  +------------------------------------

During handling of the above exception, another exception occurred:

• Exception Group Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 87, in collapse_excgroups
  | yield
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 190, in call
  | async with anyio.create_task_group() as task_group:
  | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 763, in aexit
  | raise BaseExceptionGroup(
  | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
  +-+---------------- 1 ----------------
  | Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 265, in call
  | await wrap(partial(self.listen_for_disconnect, receive))
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 238, in listen_for_disconnect
  | message = await receive()
  | ^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 54, in wrapped_receive
  | msg = await self.receive()
  | ^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 555, in receive
  | await self.message_event.wait()
  | File "/usr/local/lib/python3.11/asyncio/locks.py", line 213, in wait
  | await fut
  | asyncio.exceptions.CancelledError: Cancelled by cancel scope 7f28ce5b6890
  |
  | During handling of the above exception, another exception occurred:
  |
  | Exception Group Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 192, in call
  | await response(scope, wrapped_receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 258, in call
  | async with anyio.create_task_group() as task_group:
  | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 763, in aexit
  | raise BaseExceptionGroup(
  | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
  +-+---------------- 1 ----------------
  | Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
  | result = await app( # type: ignore[func-returns-value]
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
  | return await self.app(scope, receive, send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
  | await super().call(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
  | await self.app(scope, receive, _send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
  | await self.simple_response(scope, receive, send, request_headers=headers)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 148, in simple_response
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
  | await func()
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
  | return await super().stream_response(send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
  | async for chunk in self.body_iterator:
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
  | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
  | await route.handle(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
  | await super().call(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
  | await self.app(scope, receive, _send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
  | await self.simple_response(scope, receive, send, request_headers=headers)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 148, in simple_response
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
  | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
  | await route.handle(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 297, in handle
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 77, in app
  | await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 72, in app
  | response = await func(request)
  | ^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 278, in app
  | raw_response = await run_endpoint_function(
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
  | return await dependant.call(**values)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/app/backend/open_webui/apps/audio/main.py", line 325, in speech
  | status_code=getattr(r, "status", 500),
  | ^
  | UnboundLocalError: cannot access local variable 'r' where it is not associated with a value
  +------------------------------------

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
result = await app( # type: ignore[func-returns-value]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
return await self.app(scope, receive, send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
await self.app(scope, receive, _send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
await self.simple_response(scope, receive, send, request_headers=headers)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 148, in simple_response
await self.app(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
await func()
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
return await super().stream_response(send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
async for chunk in self.body_iterator:
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
await route.handle(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
await self.app(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
await self.app(scope, receive, _send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
await self.simple_response(scope, receive, send, request_headers=headers)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 148, in simple_response
await self.app(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
await route.handle(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 297, in handle
await self.app(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 77, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 72, in app
response = await func(request)
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 278, in app
raw_response = await run_endpoint_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
return await dependant.call(**values)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/backend/open_webui/apps/audio/main.py", line 325, in speech
status_code=getattr(r, "status", 500),
^
UnboundLocalError: cannot access local variable 'r' where it is not associated with a value

[erew123]

@GoudaCouda

I dont support Docker at this time/have not tested in docker though someone else is working on it #378

I would say however, you have not allowed or mapped something network wise in docker, based on that:

ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 7851)

[GoudaCouda]

ok yea your right that was a stupid issue but im running into an issue here im thinking maybe it isnt accessing my models correctly?

ERROR [open_webui.apps.audio.main] 500, message='Internal Server Error', url='http://192.168.1.22:7851/v1/audio/speech'
Traceback (most recent call last):
File "/app/backend/open_webui/apps/audio/main.py", line 304, in speech
r.raise_for_status()
File "/usr/local/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 1121, in raise_for_status
raise ClientResponseError(
aiohttp.client_exceptions.ClientResponseError: 500, message='Internal Server Error', url='http://192.168.1.22:7851/v1/audio/speech'
INFO: 172.17.0.1:37038 - "POST /audio/api/v1/speech HTTP/1.1" 500 Internal Server Error

[erew123]

It is the API address of AllTalk https://github.com/erew123/alltalk_tts/wiki/API-%E2%80%90-Best-Practices-AllTalk-API-Integration

[danielw97]

I don't use openwebui a tun, but make sure the url for the openai api is pointing to the correct address.
i.e. for me it would be http://host.docker.internal:7851/v1
hope this helps a bit.

[GoudaCouda]

Yea that seems to be the right ip but im still getting an error . Are my models set up fine?

ERROR [open_webui.apps.audio.main] 400, message='Bad Request', url='http://host.docker.internal:7851/v1/audio/speech'
Traceback (most recent call last):
File "/app/backend/open_webui/apps/audio/main.py", line 304, in speech
r.raise_for_status()
File "/usr/local/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 1121, in raise_for_status
raise ClientResponseError(
aiohttp.client_exceptions.ClientResponseError: 400, message='Bad Request', url='http://host.docker.internal:7851/v1/audio/speech'
INFO: 172.17.0.1:36010 - "POST /audio/api/v1/speech HTTP/1.1" 400 Bad Request
INFO: 172.17.0.1:41860 - "GET /audio/api/v1/voices HTTP/1.1" 200 OK

[erew123]

I couldnt tell you myself, as I say I dont support docker and have no experience with that app. Surface wise your settings look correct.

INFO: 172.17.0.1:36010 - "POST /audio/api/v1/speech HTTP/1.1" 400 Bad Request
INFO: 172.17.0.1:41860 - "GET /audio/api/v1/voices HTTP/1.1" 200 OK

I have no idea with that IP mapping however,

There is a basic web-page testing tool for OpenAI endpoints in the AllTalk system folder. Not sure if its possible for you to run that to test