Esti

replace lakefs_client with lakefs-sdk in Spark integration test harness #13297

Sign in to view logs

Re-run triggered November 30, 2024 17:44

arielshaqed

#8403

mahdikhashan:fix/use-updated-python-client-in-spark-integration-tests-8391

Status Success

Total duration 51s

Artifacts 3

esti.yaml

on: pull_request

Check if secrets are available.

Generate code from latest lakeFS app

Build lakeFS HadoopFS

Prepare Spark Apps

Build and push rclone export Docker image

Build and push Docker image

Build metadata client for Spark 3.x

Test lakeFS rclone export functionality

Test lakeFS Hadoop FileSystem

Test lakeFS multipart upload with Hadoop S3A

Test metastore client commands using trino

Run latest lakeFS app on AWS S3 DynamoDB KV

Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage

Run latest lakeFS app on Azure with Azure blobstore

Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB

Test lakeFS against the python wrapper client

E2E - DynamoDB Local - Local Block Adapter

Run latest lakeFS app on AWS S3 + Basic Auth

Matrix: Run latest lakeFS app on AWS S3

Matrix: spark

Test lakeFS metadata client export with Spark 3.x

Test unified gc

Annotations

1 warning

Deprecation notice: v1, v2, and v3 of the artifact actions

The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "generated-code", "lakefs-hadoopfs", "spark-apps". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

Artifacts

Produced during runtime

Name	Size
generated-code	27.2 MB
lakefs-hadoopfs	6.29 MB
spark-apps	4.35 MB