Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ETL pipeline testing QS (e2e-python) #985

Merged
merged 47 commits into from
Feb 13, 2024
Merged

Conversation

cristianhkr
Copy link
Contributor

Provide a new end to end testing quickstarter to test ETLs pipelines.

Technologies:
-pytest
-greatexpectations
-allure
-boto3
...

@BraisVQ BraisVQ self-requested a review January 24, 2024 13:36
@metmajer
Copy link
Member

@braisvq1996 @cristianhkr not sure this QS is appealing to an open source audience. Please move it to GitHub.com/Boehringer-Ingelheim.

@metmajer metmajer self-requested a review January 24, 2024 22:38
@bassagan
Copy link

@braisvq1996 @cristianhkr not sure this QS is appealing to an open-source audience. Please move it to GitHub.com/Boehringer-Ingelheim.

This QS does not need any infrastructure besides an AWS account and is not related to anything specific to Boehringer. This is a testing framework that executes its tests on the cloud, so it might fit an open-source community like AWS or Azure QS.

We can discuss it internally if you consider we should be moving it to the private repository.

@metmajer
Copy link
Member

@braisvq1996 as discussed with @bassagan, the Quickstarter is generally usable and not only in our enterprise context. Good for me to take this up in our open source library.

@BraisVQ
Copy link
Contributor

BraisVQ commented Feb 12, 2024

Quickstarter has been tested and works properly with Release manager pipeline

@BraisVQ BraisVQ self-requested a review February 13, 2024 13:38
Copy link
Contributor

@BraisVQ BraisVQ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Quickstarter has successfully passed all the tests, including Release manager orchestration pipeline usage.

@BraisVQ BraisVQ merged commit 023911a into opendevstack:master Feb 13, 2024
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants