Alternatives to OpenAIMultiModal for LLM Deployed on OpenAI-like Endpoints (e.g., vLLM)

[Searcherr]

Greetings community!

I was going through the following example of getting structured response from vision model: https://docs.llamaindex.ai/en/stable/examples/multi_modal/gpt4o_mm_structured_outputs/

And began wondering about alternatives to the OpenAIMultiModal object in scenarios where an LLM (e.g., llama-3.2-11b-vision) is deployed as an OpenAI-like endpoint (for instance, using vLLM)

Does anyone have ideas or experience with this setup? Any guidance would be appreciated!