Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Do not report statistics for append only table or predications without keys #2185

Open
1 of 2 tasks
FangYongs opened this issue Oct 27, 2023 · 4 comments
Open
1 of 2 tasks
Assignees
Labels
enhancement New feature or request

Comments

@FangYongs
Copy link
Contributor

FangYongs commented Oct 27, 2023

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

Some olap queries in tpc-h will run faster when we perform them without statistics for append-only table or predications without keys. We can add an option for this to improve the olap latency. subtask of #1945

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@FangYongs FangYongs added the enhancement New feature or request label Oct 27, 2023
@schnappi17
Copy link
Contributor

@FangYongs Please assign it to me, I'll take it, thanks~

@JingsongLi
Copy link
Contributor

Hi @FangYongs , do you have some performance benchmark?

@FangYongs
Copy link
Contributor Author

@JingsongLi Yes. We are currently using TPC-H for performance benchmark of Flink and Paimon, and we found statistics on the append-only table can cause some query performance to regress. When we turn off statistics separately for these queries, the query latencies are lower. So we would like to add an option in Paimon to uniformly support this behavior.

@JingsongLi
Copy link
Contributor

@FangYongs I see, Is there some benchmark result? How large is the performance regression.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
3 participants