Compatibility issue between Hadoop and Hive (Hive not working)

[nashugame]

I was trying to configure Hadoop and Hive. Hadoop is working fine. But for hive to work with current version of Hadoop, it should be >= 3.1.3.

Current version of hive in Onyxia setup: 2.3.9
Also not able to configure hive-site.xml (Edit/delete/change permission) even with root privilege.

[olevitt]

Hi !

Thanks for your feedback !
I transfered the issue to this project as it's not related to Onyxia itself but rather to the images used by it.
Maybe @fcomte @avouacr have any thoughts on this issue ?

[fcomte]

Hello !

Thx for the report
We should :

• build spark with hive.version=3.1.3 in stead of 2.3.9
• separate our spark image into two distincts docker images : one for the hive-metastore server and one for the spark environnement

[nashugame]

Thnx @fcomte @olevitt for all the help.
I also request you to make hive-site.xml file in /hive/conf editable, so that we can customise the configurations according to our requirements, currently it's read-only and can't be modified even with root privileges.

[fcomte]

yes this part will be done in our helm-charts :
Can you write an issue to track evolution there ?

https://github.com/InseeFrLab/helm-charts-interactive-services/issues

[nashugame]

Sure