You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
reference PR #244
Background: we're setting up an event-driven pipeline, where our Ops team delivers a file to a set s3 location, and should be run when delivered.
Adding support for preconditions in ShellCommandActivity allows us to build a custom step which begins execution when a path (using S3KeyExists) is available in s3.
I'll post up an example (probably tomorrow) which hopefully will explain/show a bit better :)
The text was updated successfully, but these errors were encountered:
here's the custom step and an example script that show how we've set up an event driven pipeline. When our ops team delivers to s3://my-s3-bucket-name/app/qa/full/#{format(@scheduledStartTime, 'YYYY-MM-dd')}/, then the pipeline kicks off.
This does only work where dataduct has pr #244 built (our staging branch has merged it for us)
reference PR #244
Background: we're setting up an event-driven pipeline, where our Ops team delivers a file to a set s3 location, and should be run when delivered.
Adding support for preconditions in ShellCommandActivity allows us to build a custom step which begins execution when a path (using S3KeyExists) is available in s3.
I'll post up an example (probably tomorrow) which hopefully will explain/show a bit better :)
The text was updated successfully, but these errors were encountered: