-
Notifications
You must be signed in to change notification settings - Fork 990
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[format][orc] open orc switch useSelected,allowSARGToFilter to make sure pushdown works #4231
Conversation
…ure pushdown works
Tests failed in |
@JingsongLi Wait for me fix up. Need time to test more ! |
…on vectors would not work
Attention : |
hold for while . |
Chinese:保持这些参数打开,或许可以获得几倍到几十倍的查询效率提升,尤其是针对大orc文件小数据量查询的场景。注意,由于删除向量功能强依赖于orc文件的row顺序,开启此参数后不保证row顺序不变,从而建议禁用删除向量功能,以在olap场景获得巨大性能提升。 'orc.reader.filter.use.selected'='true',
'orc.reader.sarg.to.filter'='true' |
paimon-format/src/main/java/org/apache/paimon/format/orc/reader/OrcBytesColumnVector.java
Outdated
Show resolved
Hide resolved
paimon-format/src/main/java/org/apache/paimon/format/orc/reader/OrcDecimalColumnVector.java
Outdated
Show resolved
Hide resolved
paimon-format/src/main/java/org/apache/paimon/format/orc/OrcReaderFactory.java
Outdated
Show resolved
Hide resolved
close this, see #4497 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1
Open orc switch useSelected,allowSARGToFilter to make sure pushdown works,
To reduce query response time.
Purpose
Linked issue: close #xxx
Tests
API and Format
Documentation