Skip to content

Spark client update to use the new lakefs sdk package #9221

Spark client update to use the new lakefs sdk package

Spark client update to use the new lakefs sdk package #9221

Triggered via pull request October 10, 2023 06:26
Status Success
Total duration 15m 38s
Artifacts 3
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

esti.yaml

on: pull_request
Check if secrets are available.
4s
Check if secrets are available.
Generate code from latest lakeFS app
21s
Generate code from latest lakeFS app
Build lakeFS HadoopFS
41s
Build lakeFS HadoopFS
Prepare Spark Apps
1m 22s
Prepare Spark Apps
Matrix: Build metadata client for Spark 3.x
Build and push rclone export Docker image
36s
Build and push rclone export Docker image
login-to-amazon-ecr
6s
login-to-amazon-ecr
Build and push Docker image
2m 9s
Build and push Docker image
Matrix: Test lakeFS metadata client export with Spark 3.x
Test lakeFS rclone export functionality
1m 3s
Test lakeFS rclone export functionality
Test lakeFS Hadoop FileSystem
7m 17s
Test lakeFS Hadoop FileSystem
Test lakeFS multipart upload with Hadoop S3A
2m 39s
Test lakeFS multipart upload with Hadoop S3A
Test unified gc
2m 37s
Test unified gc
Test metastore client commands using trino
1m 39s
Test metastore client commands using trino
Run latest lakeFS app on AWS S3 DynamoDB KV
4m 42s
Run latest lakeFS app on AWS S3 DynamoDB KV
Run latest lakeFS app on AWS S3
5m 59s
Run latest lakeFS app on AWS S3
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
4m 38s
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
Run latest lakeFS app on Azure with Azure blobstore
6m 25s
Run latest lakeFS app on Azure with Azure blobstore
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
7m 8s
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Matrix: spark
Fit to window
Zoom out
Zoom in

Annotations

1 warning
login-to-amazon-ecr
Your docker password is not masked. See https://github.com/aws-actions/amazon-ecr-login#docker-credentials for more information.

Artifacts

Produced during runtime
Name Size
generated-code Expired
15.3 MB
lakefs-hadoopfs Expired
5.96 MB
spark-apps Expired
4.42 MB