Feature: support multiple backend

[WLDFC]

Scope

Stable Diffusion WebUI (AUTOMATIC1111)

Describe the problem related to the feature request

Some servers have enough video memory to hold multiple SDs, so I wonder if robots can support multiple SDs,

Describe the solution you'd like

Can I add one more API server address?

Describe alternatives you've considered

No response

Additional context

No response

[MaikoTan]

Je pense qu'il était difficile de faire le travail de "load-balance" avec plusieurs backends, existe-t-il une solution valide ?

I thought it is difficult to do the "load-balance" work with multiple backends, is there any valid solution?

[MaikoTan]

So is there an valid approach to load-balance multiple backends?
I think a better algorithm should be like: slower backend gets lower weights, faster one gets higher weights, and a backend with an empty queue gets the highest priority.
But I am not familiar with this, hopefully there are someone would take a look here.