Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for new schedule types on-demand and timeseries #237

Open
kewlkiev opened this issue Apr 20, 2016 · 1 comment
Open

Support for new schedule types on-demand and timeseries #237

kewlkiev opened this issue Apr 20, 2016 · 1 comment

Comments

@kewlkiev
Copy link

Couldn't find any feature in dataduct for
http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-concepts-schedules.html#dp-concepts-ondemand

Which can activate a pipeline on trigger, rather than on a schedule.

A design which I discussed with @everanurag was to have current schedule.py being renamed to cronschedule.py and this in turn inherits schedule.py. which will be parent object for ondemand,cron and timeseries.

Let me know what you guys think?

@kewlkiev
Copy link
Author

kewlkiev commented May 10, 2016

Currently Dataduct's steps are very tightly coupled to schedule, which means for feature like on-demand which requires no schedule reference in any step, It involves changing validation in lots of places if I make schedule object as None.
@idralyuk @everanurag , can you please raise a pull request for the interim fix.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant