[BUG] ChatBot tab: upstream connect error or disconnect/reset before headers...

[ChGen]

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

• 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

• 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

I've managed to install and start it locally. When switching to Chat tab, I have the error message below. I've tried MS Edge and Firefox browsers.
The same error I get when I open provided online demo (https://minicpm-omni-webdemo-us.modelbest.cn/), linked in the README.md (screenshot below).
For local setup I'm using master branch, python 3.11 conda environment., ubuntu 24.04 WSL2 Windows 11 24H2 setup, NVIDIA GPU.
No particular errors was found in the logs for servers: pnpm run dev and python web_demos/minicpm-o_2.6/model_server.py

upstream connect error or disconnect/reset before headers. retried and the latest reset reason: connection failure, transport failure reason: delayed connect error: 111

期望行为 | Expected Behavior

No response

复现方法 | Steps To Reproduce

1. Open online demo (https://minicpm-omni-webdemo-us.modelbest.cn/) from the README.md or local instance.
2. Switch to ChatBot tab
3. See the error "upstream connect error or disconnect/reset before headers. retried and the latest reset reason: connection failure, transport failure reason: delayed connect error: 111"

运行环境 | Environment

- OS: Ubuntu 24.04 (WSL2 MS Windows 24H2)
- Python: Python 3.11.11
- Transformers: 4.44.2
- PyTorch: 2.3.1
- CUDA (`python -c 'import torch; print(torch.version.cuda)'`): 12.1

备注 | Anything else?

$ conda --version
conda 24.9.2

$ wsl.exe -v
WSL version: 2.3.26.0
Kernel version: 5.15.167.4-1
WSLg version: 1.0.65
MSRDC version: 1.2.5620
Direct3D version: 1.611.1-81528511
DXCore version: 10.0.26100.1-240331-1435.ge-release
Windows version: 10.0.26100.2894


$ nvidia-smi
Sun Jan 19 15:31:52 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.51.01              Driver Version: 565.90         CUDA Version: 12.7     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4070 ...    On  |   00000000:01:00.0  On |                  N/A |
|  0%   45C    P5             20W /  285W |     613MiB /  16376MiB |      1%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+