Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hive11 #7

Open
wants to merge 142 commits into
base: master
Choose a base branch
from
Open

Hive11 #7

wants to merge 142 commits into from

Conversation

RonBarabash
Copy link
Member

No description provided.

Guru107 and others added 30 commits October 22, 2019 10:55
@Guru107
[MINOR] Move all repository declarations to parent pom
301b16a
@Guru107
Merge branch 'master' of https://github.com/apache/incubator-hudi
34d7fc2
@Guru107
Make it work for hive11
6842125
@Guru107
[MINOR] Fix avro schema warnings in build
6c727ce
@Guru107
Merge branch 'master' into hive11
e258793
@Guru107
[HUDI-324] TimestampKeyGenerator should support milliseconds
a68f1cf
@Guru107
Merge branch 'master' into hive11
c578d2e
@Guru107
[HUDI-324] TimestampKeyGenerator should support milliseconds
d3f3a40
@Guru107
Merge branch 'master' into hive11
8c30f4b
@Guru107
Make decimal type work
b9f5142
@Guru107
Merge branch 'master' into hive11
907675f
@Guru107
Merge branch 'hive11' into feature/avro18
5e12142
@Guru107
Merge pull request #1 from Guru107/feature/avro18
43f6aa6 
Feature/avro18
@bvaradar @vinothchandar
[HUDI-80] Leverage Commit metadata to figure out partitions to be cle…
8ff06dd 
…aned for Cleaning by commits mode (apache#1008)
@bvaradar
[HUDI-330] add EmptyStatement java checkstyle rule
045fa87
@umehrot2 @bvaradar
Migrate integration tests to spark 2.4.4
92c69f5
@bvaradar
[HUDI-329] Presto Containers for integration test must allow newly bu…
f7c2f8c 
…ilt local jars to override
@lamberken @vinothchandar
[HOTFIX] fix missing version of rat-plugin (apache#1015)
22315a8
@Guru107
Fix decimal type precision
614d6a8
@Guru107
Merge branch 'master' into hive11
24a5cfe 
# Conflicts:
#	packaging/hudi-spark-bundle/pom.xml
#	packaging/hudi-utilities-bundle/pom.xml
@n3nash @bvaradar
- Fixing RT queries for HiveOnSpark that causes race conditions
3a05eda 
- Adding more comments to understand usage of reader/writer schema
@n3nash @bvaradar
- Ensure that rollback instant is always created before the next comm…
f82e589 
…it instant.

  This especially affects IncrementalPull for MOR tables since we can end up pulling in
  log blocks for uncommitted data
- Ensure that generated commit instants are 1 second apart
@broussea1901 @vinothchandar
[HUDI-339] Add support of Azure cloud storage (apache#1019)
e806eb7 
- Add Azure WASB (BLOB) and ADLS storage in StorageSchemes enum
- Update testStorageSchemes to test new added storage
@Guru107
shade parquet jars
58bda0c
@Guru107
Merge branch 'master' into hive11
a40e509
@lamberken @leesf
[HUDI-342] add pull request template for hudi project (apache#1022)
6649249
@lamberken @leesf
[HUDI-346] Set allowMultipleEmptyLines to false for EmptyLineSeparato…
804e348 
…r rule (apache#1025)
@lamberken @bvaradar
[HOTFIX] Fix error configuration item of dockerfile-maven-plugin
d9fbe33
@Guru107
[HUDI-348] Issue template for the project
a34d8a6
@Guru107
Merge branch 'master' into hive11
87b0c83 
# Conflicts:
#	hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/SafeParquetRecordReaderWrapper.java
lamberken and others added 30 commits December 29, 2019 19:03
@lamberken @bvaradar
[HUDI-453] Fix throw failed to archive commits error when writing dat…
58c5bed 
…a to MOR/COW table
@lamberken @bvaradar
Fix checkstyle
179837e
@lamberken @bvaradar
Skip setting commit metadata
2f25416
@lamberken @bvaradar
Fix empty content clean plan
8440482
@lamberken @bvaradar
Update comment
e4ea7a2
@dengziming @bvaradar
[MINOR]: alter some wrong params which bring fatal exception
2a823f3
@lamberken @yanghua
[HUDI-482] Fix missing @OverRide annotation on methods (apache#1156)
ab6ae5c 
* [HUDI-482] Fix missing @OverRide annotation on methods
@hejinbiao123 @yanghua
[HUDI-455] Redo hudi-client log statements using SLF4J (apache#1145)
e637d9e 
* [HUDI-455] Redo hudi-client log statements using SLF4J
@Guru107
Merge branch 'master' into hive11
5a426a7 
# Conflicts:
#	hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/SourceFormatAdapter.java
@lamberken
Clean up code
619f501
@smarthi
Merge pull request apache#1143 from BigDataArtisans/outoflimit
add4b1e 
[MINOR] Fix out of limits for results
@smarthi
[HUDI-343]: Create a DOAP file for Hudi
47c1f74
@smarthi
Merge pull request apache#1160 from smarthi/HUDI-343
98c0d8c 
[HUDI-343]: Create a DOAP file for Hudi
@Guru107
Merge branch 'master' into hive11
caf14e3
@vinothchandar
[HUDI-402]: code clean up in test cases
dde21e7
@lamberken @leesf
[MINOR] Fix error usage of String.format (apache#1169)
e1e5fe3
@hddong @n3nash
[HUDI-492]Fix show env all in hudi-cli
ff1113f
@n3nash
[HUDI-118]: Options provided for passing properties to Cleaner, compa…
290278f 
…ctor and importer commands
@SteNicholas @vinothchandar
[MINOR] Optimize hudi-cli module (apache#1136)
a733f4e
@SteNicholas @vinothchandar
[MINOR]Optimize hudi-client module (apache#1139)
726ae47
@nsivabalan @vinothchandar
[HUDI-377] Adding Delete() support to DeltaStreamer (apache#1073)
7031445 
- Provides ability to perform hard deletes by writing delete marker records into the source data
- if the record contains a special field _hoodie_delete_marker set to true, deletes are performed
@lamberken @vinothchandar
[HUDI-484] Fix NPE when reading IncrementalPull.sqltemplate in HiveIn…
28ccf8c 
…crementalPuller (apache#1167)
@hejinbiao123 @leesf
Revert "[HUDI-455] Redo hudi-client log statements using SLF4J (apach…
b9fab0b 
…e#1145)" (apache#1181)

This reverts commit e637d9e.
@hddong @leesf
[HUDI-438] Merge duplicated code fragment in HoodieSparkSqlWriter (ap…
2d5b79d 
…ache#1114)
@bvaradar
[HUDI-406]: added default partition path in TimestampBasedKeyGenerator
8f935e7
@yuehan124 @bvaradar
[HUDI-501] Execute docker/setup_demo.sh in any directory
c78092d
@lamberken @bvaradar
[HUDI-405] Remove HIVE_ASSUME_DATE_PARTITION_OPT_KEY config from Data…
75c3f63 
…Source
@modi95 @vinothchandar
[HUDI-464] Use Hive Exec Core for tests (apache#1125)
b5df672
@bvaradar @vinothchandar
[HUDI-417] Refactor HoodieWriteClient so that commit logic can be sha…
8306f74 
…reable by both bootstrap and normal write operations (apache#1166)
@Guru107
Merge branch 'master' into hive11
0894993 
# Conflicts:
#	pom.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.