Skip to content
Back to pull request #11879

fix(ingestion): fix stateful ingestion for GCS source #28933

Sign in to view logs

fix(ingestion): fix stateful ingestion for GCS source

fix(ingestion): fix stateful ingestion for GCS source #28933

Triggered via pull request January 13, 2025 11:39
@josgesjosges
synchronize #11879
josges:fix_gcs
Status Success
Total duration 33m 10s
Artifacts 9

docker-unified.yml

on: pull_request
setup
20s
setup
Build and Push DataHub Ingestion (Base) Docker Image
32s
Build and Push DataHub Ingestion (Base) Docker Image
Build and Push DataHub Upgrade Docker Image
0s
Build and Push DataHub Upgrade Docker Image
Build and Push DataHub Elasticsearch Setup Docker Image
0s
Build and Push DataHub Elasticsearch Setup Docker Image
Build and Push DataHub Frontend Docker Image
0s
Build and Push DataHub Frontend Docker Image
Build and Push DataHub GMS Docker Image
0s
Build and Push DataHub GMS Docker Image
Build and Push DataHub Kafka Setup Docker Image
0s
Build and Push DataHub Kafka Setup Docker Image
Build and Push DataHub MAE Consumer Docker Image
0s
Build and Push DataHub MAE Consumer Docker Image
Build and Push DataHub MCE Consumer Docker Image
0s
Build and Push DataHub MCE Consumer Docker Image
Build and Push DataHub MySQL Setup Docker Image
0s
Build and Push DataHub MySQL Setup Docker Image
smoke_test_matrix
0s
smoke_test_matrix
Build and Push DataHub Ingestion (Base-Full) Docker Image
54s
Build and Push DataHub Ingestion (Base-Full) Docker Image
Build and Push DataHub Ingestion (Base-Slim) Docker Image
36s
Build and Push DataHub Ingestion (Base-Slim) Docker Image
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
0s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
0s
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
[Monitoring] Scan Frontend images for vulnerabilities
0s
[Monitoring] Scan Frontend images for vulnerabilities
[Monitoring] Scan GMS images for vulnerabilities
0s
[Monitoring] Scan GMS images for vulnerabilities
[Monitoring] Scan Kafka Setup images for vulnerabilities
0s
[Monitoring] Scan Kafka Setup images for vulnerabilities
[Monitoring] Scan MAE consumer images for vulnerabilities
0s
[Monitoring] Scan MAE consumer images for vulnerabilities
[Monitoring] Scan MCE consumer images for vulnerabilities
0s
[Monitoring] Scan MCE consumer images for vulnerabilities
[Monitoring] Scan MySQL Setup images for vulnerabilities
0s
[Monitoring] Scan MySQL Setup images for vulnerabilities
Build and Push DataHub Ingestion (Full) Docker Images
6m 34s
Build and Push DataHub Ingestion (Full) Docker Images
Build and Push DataHub Ingestion Docker Images
3m 34s
Build and Push DataHub Ingestion Docker Images
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
3m 39s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
Matrix: Run Smoke Tests
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
3m 17s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
Deploy to Datahub HEAD
0s
Deploy to Datahub HEAD
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 14 warnings
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
CodeQL Action major versions v1 and v2 have been deprecated. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2025-01-10-code-scanning-codeql-action-v2-is-now-deprecated/
setup
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
smoke_test_matrix
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base-Slim) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base-Full) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Full) Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 0, 5)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 3)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

Artifacts

Produced during runtime
Name Size
Test Results (smoke tests) pytests 0
1.07 KB
Test Results (smoke tests) pytests 1
1.21 KB
Test Results (smoke tests) pytests 2
999 Bytes
Test Results (smoke tests) pytests 3
937 Bytes
Test Results (smoke tests) pytests 4
1.16 KB
action_image_artifact_acryldata_datahub-ingestion_pr11879 Expired
935 MB
action_image_artifact_acryldata_datahub-ingestion_pr11879-slim Expired
651 MB
datahub-project~datahub~FWUACB.dockerbuild
37.8 KB
datahub-project~datahub~M1Q54P.dockerbuild
49.7 KB