Skip to content

Commit

Permalink
Added Red Hat OpenShift AI Integration doc (#8429)
Browse files Browse the repository at this point in the history
  • Loading branch information
kesarwam authored Dec 19, 2024
1 parent db6c98e commit b55d450
Show file tree
Hide file tree
Showing 5 changed files with 35 additions and 7 deletions.
Binary file added docs/assets/img/logos/red_hat_openshift_ai.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
14 changes: 7 additions & 7 deletions docs/integrations/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,25 +30,25 @@ See below for detailed instructions for using different technologies with lakeFS
<tr>
<td width="25%" align=center><a href="./aws_cli.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/cli.png" alt="cli logo"/><br/>AWS CLI</a></td>
<td width="25%" align=center><a href="./cloudera.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/cloudera.png" alt="cloudera logo"/><br/>Cloudera</a></td>
<td width="25%" align=center><a href="./databricks.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/databricks.png" alt="Databricks Logo"/><br/>Databricks</a></td>
<td width="25%" align=center><a href="./delta.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/delta-lake.png" alt="delta lake logo"/><br/>Delta Lake</a></td>
<td width="25%" align=center><a href="./git.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/git.png" alt="git logo"/><br/>Git</a></td>
</tr>
<tr>
<td width="25%" align=center><a href="./dremio.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/dremio.png" alt="dremio logo"/><br/>Dremio</a></td>
<td width="25%" align=center><a href="./duckdb.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/duckdb.png" alt="duckdb logo"/><br/>DuckDB</a></td>
<td width="25%" align=center><a href="./git.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/git.png" alt="git logo"/><br/>Git</a></td>
<td width="25%" align=center><a href="./glue_hive_metastore.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/glue.png" alt="glue logo"/><br/>Glue / Hive metastore</a></td>
<td width="25%" align=center><a href="./kubeflow.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/kubeflow.png" alt="kubeflow logo"/><br/>Kubeflow</a></td>
</tr>
<tr>
<td width="25%" align=center><a href="./huggingface_datasets.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/huggingface.png" alt="Hugging Face Logo"/><br/>HuggingFace Datasets</a></td>
<td width="25%" align=center><a href="./kubeflow.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/kubeflow.png" alt="kubeflow logo"/><br/>Kubeflow</a></td>
<td width="25%" align=center><a href="./presto_trino.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/trino_presto.png" alt="presto and trino logos"/><br/>Presto / Trino</a></td>
<td width="25%" align=center><a href="./python.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/python.png" alt="python logo"/><br/>Python</a></td>
<td width="25%" align=center><a href="./r.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/r.png" alt="r logo"/><br/>R</a></td>
<td width="25%" align=center><a href="./vertex_ai.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/vertex_ai.png" alt="Vertex AI Logo"/><br/>Vertex AI</a></td>
</tr>
<tr>
<td width="25%" align=center><a href="./huggingface_datasets.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/huggingface.png" alt="Hugging Face Logo"/><br/>HuggingFace Datasets</a></td>
<td width="25%" align=center><a href="./databricks.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/databricks.png" alt="Databricks Logo"/><br/>Databricks</a></td>
<td width="25%" align=center></td>
<td width="25%" align=center><a href="./r.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/r.png" alt="r logo"/><br/>R</a></td>
<td width="25%" align=center><a href="./red_hat_openshift_ai.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/red_hat_openshift_ai.png" alt="Red Hat OpenShift AI Logo"/><br/>Red Hat OpenShift AI</a></td>
<td width="25%" align=center><a href="./vertex_ai.html"><img width=120 src="{{ site.baseurl }}/assets/img/logos/vertex_ai.png" alt="Vertex AI Logo"/><br/>Vertex AI</a></td>
<td width="25%" align=center></td>
</tr>
</table>
Expand Down
28 changes: 28 additions & 0 deletions docs/integrations/red_hat_openshift_ai.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
title: Red Hat OpenShift AI
parent: Integrations
redirect_from:
---

# Using lakeFS with Red Hat OpenShift AI
Red Hat® OpenShift® is an enterprise-ready Kubernetes container platform with full-stack automated operations to manage hybrid cloud, multi-cloud, and edge deployments. OpenShift includes an enterprise-grade Linux operating system, container runtime, networking, monitoring, registry, and authentication and authorization solutions.

[Red Hat® OpenShift® AI](https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai) is a flexible, scalable artificial intelligence (AI) and machine learning (ML) platform that enables enterprises to create and deliver AI-enabled applications at scale across hybrid cloud environments. Built using open source technologies, OpenShift AI provides trusted, operationally consistent capabilities for teams to experiment, serve models, and deliver innovative apps.

OpenShift AI and lakeFS can be deployed in OpenShift cluster in 3 different architectures:
1. OpenShift AI, lakeFS and object storage are delpoyed in OpenShift cluster
2. OpenShift AI and lakeFS are deployed in OpenShift cluster while object storage is external
3. OpenShift AI is deployed in OpenShift cluster while lakeFS and object storage are external

<img src="{{ site.baseurl }}/assets/img/red-hat/OpenShiftDeploymentArchitecture.png" alt="OpenShift AI and lakeFS Deployment Architecture" width="100%" height="100%" />

Refer to an example in [lakeFS-samples](https://github.com/treeverse/lakeFS-samples/tree/main/01_standalone_examples/red-hat-openshift-ai) to deploy lakeFS, MinIO and OpenShift AI tutorial ([Fraud Detection demo](https://docs.redhat.com/en/documentation/red_hat_openshift_ai_self-managed/2-latest/html/openshift_ai_tutorial_-_fraud_detection_example/index)) in OpenShift cluster. Fraud detection demo is a step-by-step guide for using OpenShift AI to train an example model in JupyterLab, deploy the model, and refine the model by using automated pipelines.

In this example, OpenShift AI is configured to connect over S3 interace to lakeFS, which will version the data in a backend MinIO instance. This is the architecture to run Fraud Detection demo with or without lakeFS:
<img src="{{ site.baseurl }}/assets/img/red-hat/OpenShiftAIDemoArchitecture.png" alt="OpenShift AI and lakeFS Deployment Architecture for the demo" width="100%" height="100%" />

lakeFS-samples also includes multiple Helm chart examples to deploy lakeFS and MinIO in different scenarios:
1. [lakefs-local.yaml](https://github.com/treeverse/lakeFS-samples/blob/main/01_standalone_examples/red-hat-openshift-ai/cluster-configuration/lakefs-local.yaml): Bring up lakeFS using local object storage. This would be useful for a quick demo where MinIO is not included.
2. [lakefs-minio.yaml](https://github.com/treeverse/lakeFS-samples/blob/main/01_standalone_examples/red-hat-openshift-ai/cluster-configuration/lakefs-minio.yaml): Bring up lakeFS configured to use MinIO as backend object storage. This will be used in the lakeFS demo.
3. [minio-direct.yaml](https://github.com/treeverse/lakeFS-samples/blob/main/01_standalone_examples/red-hat-openshift-ai/cluster-configuration/minio-direct.yaml): This file would only be used if lakeFS is not in the picture and OpenShift AI will communicate directly with MinIO. It will bring up MinIO as it is in the default Fraud Detection demo, complete with configuring MinIO storage buckets and the OpenShift AI data connections. It may serve useful in debugging an issue.
4. [minio-via-lakefs.yaml](https://github.com/treeverse/lakeFS-samples/blob/main/01_standalone_examples/red-hat-openshift-ai/cluster-configuration/minio-via-lakefs.yaml): Bring up MinIO for the modified Fraud Detection demo that includes lakeFS, complete with configuring MinIO storage buckets, but do NOT configure the OpenShift AI data connections. This will be used in the lakeFS demo.

0 comments on commit b55d450

Please sign in to comment.