Skip to content

Spark client update to use the new lakefs sdk package #9220

Spark client update to use the new lakefs sdk package

Spark client update to use the new lakefs sdk package #9220

Triggered via pull request October 10, 2023 06:12
Status Success
Total duration 13m 50s
Artifacts 3
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

esti.yaml

on: pull_request
Check if secrets are available.
3s
Check if secrets are available.
Generate code from latest lakeFS app
18s
Generate code from latest lakeFS app
Build lakeFS HadoopFS
45s
Build lakeFS HadoopFS
Prepare Spark Apps
1m 23s
Prepare Spark Apps
Matrix: Build metadata client for Spark 3.x
Build and push rclone export Docker image
34s
Build and push rclone export Docker image
login-to-amazon-ecr
4s
login-to-amazon-ecr
Build and push Docker image
2m 37s
Build and push Docker image
Matrix: Test lakeFS metadata client export with Spark 3.x
Test lakeFS rclone export functionality
50s
Test lakeFS rclone export functionality
Test lakeFS Hadoop FileSystem
6m 0s
Test lakeFS Hadoop FileSystem
Test lakeFS multipart upload with Hadoop S3A
2m 45s
Test lakeFS multipart upload with Hadoop S3A
Test unified gc
2m 35s
Test unified gc
Test metastore client commands using trino
2m 9s
Test metastore client commands using trino
Run latest lakeFS app on AWS S3 DynamoDB KV
4m 33s
Run latest lakeFS app on AWS S3 DynamoDB KV
Run latest lakeFS app on AWS S3
4m 55s
Run latest lakeFS app on AWS S3
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
5m 21s
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
Run latest lakeFS app on Azure with Azure blobstore
6m 23s
Run latest lakeFS app on Azure with Azure blobstore
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
9m 6s
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Matrix: spark
Fit to window
Zoom out
Zoom in

Annotations

1 warning
login-to-amazon-ecr
Your docker password is not masked. See https://github.com/aws-actions/amazon-ecr-login#docker-credentials for more information.

Artifacts

Produced during runtime
Name Size
generated-code Expired
15.3 MB
lakefs-hadoopfs Expired
5.96 MB
spark-apps Expired
4.42 MB