Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Introduce a bulk insert mode for dynamic bucket #1409

Open
1 of 2 tasks
JingsongLi opened this issue Jun 20, 2023 · 4 comments
Open
1 of 2 tasks

[Feature] Introduce a bulk insert mode for dynamic bucket #1409

JingsongLi opened this issue Jun 20, 2023 · 4 comments
Labels
enhancement New feature or request

Comments

@JingsongLi
Copy link
Contributor

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

Remove bucket assigner node.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@JingsongLi JingsongLi added the enhancement New feature or request label Jun 20, 2023
@TaoZex
Copy link
Contributor

TaoZex commented Jun 21, 2023

I am interested in this task, please assign to me.

@JingsongLi
Copy link
Contributor Author

I am interested in this task, please assign to me.

Welcome, You can just create a pull request.

@baimafeima-yf
Copy link

Is this feature available now? i want to bulk insert to the dynamic table. i have two question:
1.how to bulk insert .If according to the official example, if there are 100000 pieces of data, the write method will be called 100000 times ,Will this seriously affect efficiency?
2.if dynamic table execute “write.write(row)”.it will appears:"Can't extract bucket from row in dynamic bucket mode, you should use 'TableWrite.write(InternalRow row, int bucket)' method."
Can I successfully execute the write method without specifying a bucket
e1327432f131ae7ce4f99fdb9c92ce1

@baimafeima-yf
Copy link

@JingsongLi @TaoZex

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants