[Bug]: Is IP-Adapter not available in API?

[cjkangme]

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

I'm currently using AUTOMATIC1111 through its API interface. I've noticed that the IP-Adapter doesn't seem to work properly when accessed through the API, even though it works perfectly in the WebUI.

I've confirmed that IP-Adapter functions correctly when used through the WebUI interface. When I attempted to use the exact same configuration settings through the API, the IP-Adapter effects were not being applied to the output.
No error messages are displayed during the process, and other features work correctly (download the clip_h preprocessor if it is missing).

This seems to be similar to the issue discussed in #2630 (#2630), which appears to still be unresolved.

Here is my config

"ControlNet": {
                    "args": [
                        {
                            "control_mode": "Balanced",
                            "enabled": True,
                            "guidance_end": 1.0,
                            "guidance_start": 0.3,
                            "hr_option": "Both",
                            "image": base64,
                            "inpaint_crop_input_image": True,
                            "module": "ip-adapter_clip_h",
                            "model": "ip-adapter-plus_sd15",
                            "processor_res": 512,
                            "pulid_mode": "Fidelity",
                            "resize_mode": "Crop and Resize",
                            "save_detected_map": True,
                            "threshold_a": 0.5,
                            "threshold_b": 0.5,
                            "union_control_type": "Unknown",
                            "weight": 1.0,
                        },
                        {
                            "control_mode": "Balanced",
                            "enabled": True,
                            "guidance_end": 1.0,
                            "guidance_start": 0.0,
                            "hr_option": "Both",
                            "image": base64,
                            "inpaint_crop_input_image": True,
                            "model": "control_depth-fp16",
                            "processor_res": 512,
                            "pulid_mode": "Fidelity",
                            "resize_mode": "Crop and Resize",
                            "save_detected_map": True,
                            "threshold_a": 0.5,
                            "threshold_b": 0.5,
                            "union_control_type": "Unknown",
                            "weight": 0.5,
                        },
                        {
                            "control_mode": "Balanced",
                            "enabled": True,
                            "guidance_end": 1.0,
                            "guidance_start": 0.0,
                            "hr_option": "Both",
                            "image": base64,
                            "inpaint_crop_input_image": True,
                            "model": "control_v11p_sd15_lineart",
                            "processor_res": 512,
                            "pulid_mode": "Fidelity",
                            "resize_mode": "Crop and Resize",
                            "save_detected_map": True,
                            "threshold_a": 0.5,
                            "threshold_b": 0.5,
                            "union_control_type": "Unknown",
                            "weight": 0.5,
                        },
                    ]
                },

Other ContolNets work ok. but only the IP-Adapter does not work.

Steps to reproduce the problem

occurs when use API

What should have happened?

IP-Adapter does not work

Commit where the problem happens

controlnet:

What browsers do you use to access the UI ?

No response

Command Line Arguments

bash webui.sh --api --xformers --listen --no-download-sd-model

List of enabled extensions

ControlNet
RegionalPrompter

Console logs

(no error)

webui-1           | 2024-11-26 05:39:15,014 - ControlNet - INFO - unit_separate = False, style_align = False
webui-1           | 2024-11-26 05:39:15,195 - ControlNet - INFO - Loading model: ip-adapter-plus_sd15 [c817b455]
webui-1           | 2024-11-26 05:39:15,252 - ControlNet - INFO - Loaded state_dict from [/home/texturing/stable-diffusion-webui/models/ControlNet/ip-adapter-plus_sd15.bin]
webui-1           | 2024-11-26 05:39:15,422 - ControlNet - INFO - ControlNet model ip-adapter-plus_sd15 [c817b455](ControlModelType.IPAdapter) loaded.
webui-1           | 2024-11-26 05:39:15,424 - ControlNet - INFO - Using preprocessor: ip-adapter_clip_h
webui-1           | 2024-11-26 05:39:15,424 - ControlNet - INFO - preprocessor resolution = 512
webui-1           | 2024-11-26 05:39:20,620 - ControlNet - WARNING - Unable to determine version for ControlNet model 'control_depth-fp16'.
webui-1           | 2024-11-26 05:39:20,620 - ControlNet - INFO - Loading model: control_depth-fp16 [400750f6]
webui-1           | 2024-11-26 05:39:20,624 - ControlNet - INFO - Loaded state_dict from [/home/texturing/stable-diffusion-webui/models/ControlNet/control_depth-fp16.safetensors]
webui-1           | 2024-11-26 05:39:20,624 - ControlNet - INFO - controlnet_default_config
webui-1           | 2024-11-26 05:39:21,726 - ControlNet - INFO - ControlNet model control_depth-fp16 [400750f6](ControlModelType.ControlNet) loaded.
webui-1           | 2024-11-26 05:39:21,789 - ControlNet - INFO - Using preprocessor: none
webui-1           | 2024-11-26 05:39:21,789 - ControlNet - INFO - preprocessor resolution = 512
webui-1           | 2024-11-26 05:39:21,843 - ControlNet - INFO - Loading model: control_v11p_sd15_lineart [43d4be0d]
webui-1           | 2024-11-26 05:39:22,133 - ControlNet - INFO - Loaded state_dict from [/home/texturing/stable-diffusion-webui/models/ControlNet/control_v11p_sd15_lineart.pth]
webui-1           | 2024-11-26 05:39:22,133 - ControlNet - INFO - controlnet_default_config
webui-1           | 2024-11-26 05:39:23,466 - ControlNet - INFO - ControlNet model control_v11p_sd15_lineart [43d4be0d](ControlModelType.ControlNet) loaded.
webui-1           | 2024-11-26 05:39:23,517 - ControlNet - INFO - Using preprocessor: none
webui-1           | 2024-11-26 05:39:23,517 - ControlNet - INFO - preprocessor resolution = 512
webui-1           | 2024-11-26 05:39:23,605 - ControlNet - INFO - ControlNet Hooked - Time = 8.59289288520813

Additional information

No response