[FEATURE] Check downstream services before deleting MLModel

[yuye-aws]

Is your feature request related to a problem?
There are several types of downstream services dependent on MLModel. For example, several tools in agent framework (MLModelTool, VectorDBTool and RAGTool) uses MLModel. When deleting the MLModel, we need to first check whether any of the downstream service is using this MLModel.

What solution would you like?
Just like connector, it will return an error if the connector is being used by any model:

1 models are still using this connector, please delete or update the models first: [L05NKJIBVJ7VbbiuxOUx]

What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.

Do you have any additional context?
Add any other context or screenshots about the feature request here.

[ylwu-amzn]

Thanks @yuye-aws, Do you have bandwidth to help on this ?

[ylwu-amzn]

Assign to you first, let me know if you don't have enough bandwidth.

[yuye-aws]

I'm working on the opensearch-ml-quickstart project in these weeks. @ylwu-amzn You can mark this issue as 2.19.

[yuye-aws]

Plus one use case: Check ConnectorTool agent before deleting the connector

[dhrubo-os]

Similar issue: #3088

[dhrubo-os]

@yuye-aws Let's publish your RFC / Design plan so that we can make sure it also aligns with team's bigger plan and also address the issue 3088 I mentioned here. We should also have detailed discussion on this.

[yuye-aws]

@dhrubo-os The issue mentions that scan ingest pipelines, search pipelines, any other places where the models may be used in existing resources. Can you at least provide a list of possible places where ml model is being used? For know, the model includes:

1. ML Model tool
2. Text embedding processor in pipelines.

Is there any other use cases?

[xinyual]

@ylwu-amzn Hi Yaliang, I will take this issue and come up with a RFC ASAP since yuye doesn't have enough bandwidth.

[yuye-aws]

@ylwu-amzn Hi Yaliang, I will take this issue and come up with a RFC ASAP since yuye doesn't have enough bandwidth.

Thanks Xinyuan! This issue can be assigned to you, right?

[yuye-aws]

@xinyual Found that RAG tool also has two fields: embedding_model_id and inference_model_id https://opensearch.org/docs/latest/ml-commons-plugin/agents-tools/tools/rag-tool/

[yuye-aws]

Also the conversational agent needs llm.model_id https://opensearch.org/docs/latest/ml-commons-plugin/api/agent-apis/register-agent/

[yuye-aws]

The model controller uses model_id https://opensearch.org/docs/latest/ml-commons-plugin/api/controller-apis/create-controller/

[yuye-aws]

There is a search response processor named retrieval_augmented_generation using model_id : https://opensearch.org/docs/latest/search-plugins/search-pipelines/rag-processor/

[xinyual]

Raise a RFC for this issue. #3191 @yuye-aws @ylwu-amzn @dhrubo-os Please have a look.