Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hard to read complete data #40

Open
pawelpabich opened this issue Aug 19, 2015 · 1 comment
Open

Hard to read complete data #40

pawelpabich opened this issue Aug 19, 2015 · 1 comment

Comments

@pawelpabich
Copy link
Contributor

The batch parameter on Scanner data structure controls how many cells (not rows) will be retrieved at a time. This means that for it be useful one needs to write code to combines the data from possibly multiple batches so only complete rows are returned to the client code. This might not be needed with stateless scanners #7 as they have limit parameter which operates on the row level.

I have a piece of code that does that and if there is enough appetite I can open a pull request.
The gist of it is here: https://gist.github.com/pawelpabich/53d5cfc3ef51a083a042. I also have set of tests that covers it.

@pawelpabich
Copy link
Contributor Author

One more thing, if you don't specify batch parameter then, in my experience, all gets returned at once which might cause Out of Memory exceptions along the way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant