Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for repeated reduce phase #19

Open
tomachalek opened this issue Jun 12, 2015 · 0 comments
Open

Support for repeated reduce phase #19

tomachalek opened this issue Jun 12, 2015 · 0 comments
Assignees
Milestone

Comments

@tomachalek
Copy link
Owner

ApplyItems -> Map -> Reduce -> ... -> Reduce -> Finish

This may be useful when processing recursive or graph-like structures (e.g. crawling the Web).

"static" variant

reduce(function (key, values) {
   // 1st run
});
reduce(function (key, values) {
   // 2nd run
});

"dynamic" variant

reduce(function (key, values) {
   // the function is called again and again as long as reduceLoop returns true
});

reduceLoop(function (???) {
  if (done) {
    return false; // => finish

  }  else {
    return true;
  }
});
@tomachalek tomachalek self-assigned this Jun 12, 2015
@tomachalek tomachalek added this to the v0.6.0 milestone Jun 12, 2015
@tomachalek tomachalek modified the milestones: v0.7.0, v0.6.0 Sep 28, 2015
@tomachalek tomachalek changed the title Repeated map-reduce Support for repeated reduce phase Dec 24, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant