Minio S3 custom certificate to hive metastore and secret values

[deebify]

I've setup hive metastore using hive operator. I want to use a custom S3 conenction like the minio in the examples, however the object store we're using is minio with custom certificate.

How can I include that custom certificate to hive operator or skip certificate check for s3?

apiVersion: s3.stackable.tech/v1alpha1
kind: S3Connection
metadata:
  name: prodminio
spec:
  host: minio-prod.data.io
  port: 443
  accessStyle: Path
  credentials:
    secretClass: hive-s3-secret-class

the second concern is how to store password values into secrets, can we mount the database section as secret?

apiVersion: hive.stackable.tech/v1alpha1
kind: HiveCluster
metadata:
  name: hive-postgres-s3
spec:
  image:
    productVersion: 3.1.3
  clusterConfig:
    database:
      connString: jdbc:postgresql://postgres-instance.data.io:5432/metastore_db
      user: admin
      password: password123 << encrypt this value
      dbType: postgres
    s3:
      reference: prodminio
  metastore:
    roleGroups:
      default:
        replicas: 1

[maltesander]

Hi @deebify,

we are aware of that problem and fixed it for the next release. You can have a look at the nighly / dev docs for how it is done https://docs.stackable.tech/home/nightly/hive/getting_started/first_steps here.

You can switch to the 0.0.0-dev operator that should support this already. Please make sure to manually update the CRDs (or remove the old Hive CRD due to the schema changes before testing).

You can provide a custom certificate via the SecretClass as documented here https://docs.stackable.tech/home/nightly/concepts/tls-server-verification.

Cheers,
Malte

[sbernauer]

Just to add to @maltesander's answer: We also have docs on S3 and tls verification specifically: https://docs.stackable.tech/home/nightly/concepts/s3#_tls
And because of stackabletech/secret-operator#320 you currently might need to provide some bogus tls.key and tls.crt as well - contents shouldn't matter as long as they are valid certificates