Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cleanup SNS topics #161

Open
tvogels01 opened this issue Mar 27, 2020 · 0 comments
Open

Cleanup SNS topics #161

tvogels01 opened this issue Mar 27, 2020 · 0 comments
Labels
Arthur v2 Tom's weekend projects component: internals feature
Milestone
Arthur v2

Comments

@tvogels01
Copy link
Contributor

tvogels01 commented Mar 27, 2020 •
edited
Loading

Summary

We multiplex success and failure notifications on the same SNS topic. We would gain more flexibility by keeping success and failure separate SNS topics. This should be true for ETLs and Validation pipeline.s

Details

Here's a list of topics that receive messages based on the outcome of a pipeline run.

What happens Current Topic Future Topic
ETL starts -- start
ETL finishes successfully status success
ETL fails to finish status, page failure
Validation is successful -- validation-success
Validation is unsuccessful validation-page validation-failure
@tvogels01 tvogels01 added this to the Arthur v2 milestone Mar 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Arthur v2 Tom's weekend projects component: internals feature
Projects
None yet
Milestone
Arthur v2
Development

No branches or pull requests
1 participant
@tvogels01