Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/rook ceph #11

Merged
merged 2 commits into from
Feb 25, 2024
Merged

Feature/rook ceph #11

merged 2 commits into from
Feb 25, 2024

Conversation

jgilfoil
Copy link
Owner

No description provided.

running duplicate isn't needed here i think.
this time with lower resources limits and requests
Copy link

--- HelmRelease: rook-ceph/rook-ceph-cluster StorageClass: rook-ceph/ceph-filesystem

+++ HelmRelease: rook-ceph/rook-ceph-cluster StorageClass: rook-ceph/ceph-filesystem

@@ -1,23 +0,0 @@

----
-apiVersion: storage.k8s.io/v1
-kind: StorageClass
-metadata:
-  name: ceph-filesystem
-  annotations:
-    storageclass.kubernetes.io/is-default-class: 'false'
-provisioner: rook-ceph.cephfs.csi.ceph.com
-parameters:
-  fsName: ceph-filesystem
-  pool: ceph-filesystem-data0
-  clusterID: rook-ceph
-  csi.storage.k8s.io/controller-expand-secret-name: rook-csi-cephfs-provisioner
-  csi.storage.k8s.io/controller-expand-secret-namespace: rook-ceph
-  csi.storage.k8s.io/fstype: ext4
-  csi.storage.k8s.io/node-stage-secret-name: rook-csi-cephfs-node
-  csi.storage.k8s.io/node-stage-secret-namespace: rook-ceph
-  csi.storage.k8s.io/provisioner-secret-name: rook-csi-cephfs-provisioner
-  csi.storage.k8s.io/provisioner-secret-namespace: rook-ceph
-reclaimPolicy: Delete
-allowVolumeExpansion: true
-volumeBindingMode: Immediate
-
--- HelmRelease: rook-ceph/rook-ceph-cluster StorageClass: rook-ceph/ceph-bucket

+++ HelmRelease: rook-ceph/rook-ceph-cluster StorageClass: rook-ceph/ceph-bucket

@@ -1,13 +0,0 @@

----
-apiVersion: storage.k8s.io/v1
-kind: StorageClass
-metadata:
-  name: ceph-bucket
-provisioner: rook-ceph.ceph.rook.io/bucket
-reclaimPolicy: Delete
-volumeBindingMode: Immediate
-parameters:
-  objectStoreName: ceph-objectstore
-  objectStoreNamespace: rook-ceph
-  region: us-east-1
-
--- HelmRelease: rook-ceph/rook-ceph-cluster CephFilesystem: rook-ceph/ceph-filesystem

+++ HelmRelease: rook-ceph/rook-ceph-cluster CephFilesystem: rook-ceph/ceph-filesystem

@@ -1,27 +0,0 @@

----
-apiVersion: ceph.rook.io/v1
-kind: CephFilesystem
-metadata:
-  name: ceph-filesystem
-  namespace: rook-ceph
-spec:
-  dataPools:
-  - failureDomain: host
-    name: data0
-    replicated:
-      size: 3
-  metadataPool:
-    replicated:
-      size: 3
-  metadataServer:
-    activeCount: 1
-    activeStandby: true
-    priorityClassName: system-cluster-critical
-    resources:
-      limits:
-        cpu: 2000m
-        memory: 4Gi
-      requests:
-        cpu: 1000m
-        memory: 4Gi
-
--- HelmRelease: rook-ceph/rook-ceph-cluster CephFilesystemSubVolumeGroup: rook-ceph/ceph-filesystem-csi

+++ HelmRelease: rook-ceph/rook-ceph-cluster CephFilesystemSubVolumeGroup: rook-ceph/ceph-filesystem-csi

@@ -1,12 +0,0 @@

----
-apiVersion: ceph.rook.io/v1
-kind: CephFilesystemSubVolumeGroup
-metadata:
-  name: ceph-filesystem-csi
-  namespace: rook-ceph
-spec:
-  name: csi
-  filesystemName: ceph-filesystem
-  pinning:
-    distributed: 1
-
--- HelmRelease: rook-ceph/rook-ceph-cluster CephObjectStore: rook-ceph/ceph-objectstore

+++ HelmRelease: rook-ceph/rook-ceph-cluster CephObjectStore: rook-ceph/ceph-objectstore

@@ -1,29 +0,0 @@

----
-apiVersion: ceph.rook.io/v1
-kind: CephObjectStore
-metadata:
-  name: ceph-objectstore
-  namespace: rook-ceph
-spec:
-  dataPool:
-    erasureCoded:
-      codingChunks: 1
-      dataChunks: 2
-    failureDomain: host
-  gateway:
-    instances: 1
-    port: 80
-    priorityClassName: system-cluster-critical
-    resources:
-      limits:
-        cpu: 2000m
-        memory: 2Gi
-      requests:
-        cpu: 1000m
-        memory: 1Gi
-  metadataPool:
-    failureDomain: host
-    replicated:
-      size: 3
-  preservePoolsOnDelete: true
-

Copy link

--- kubernetes/apps Kustomization: flux-system/cluster-apps Kustomization: flux-system/rook-ceph

+++ kubernetes/apps Kustomization: flux-system/cluster-apps Kustomization: flux-system/rook-ceph

@@ -0,0 +1,40 @@

+---
+apiVersion: kustomize.toolkit.fluxcd.io/v1
+kind: Kustomization
+metadata:
+  labels:
+    kustomize.toolkit.fluxcd.io/name: cluster-apps
+    kustomize.toolkit.fluxcd.io/namespace: flux-system
+  name: rook-ceph
+  namespace: flux-system
+spec:
+  commonMetadata:
+    labels:
+      app.kubernetes.io/name: rook-ceph
+  decryption:
+    provider: sops
+    secretRef:
+      name: sops-age
+  interval: 30m
+  path: ./kubernetes/apps/rook-ceph/app
+  postBuild:
+    substituteFrom:
+    - kind: ConfigMap
+      name: cluster-settings
+    - kind: Secret
+      name: cluster-secrets
+    - kind: ConfigMap
+      name: cluster-settings-user
+      optional: true
+    - kind: Secret
+      name: cluster-secrets-user
+      optional: true
+  prune: true
+  retryInterval: 5m30s
+  sourceRef:
+    kind: GitRepository
+    name: home-kubernetes
+  targetNamespace: rook-ceph
+  timeout: 5m
+  wait: false
+
--- kubernetes/apps Kustomization: flux-system/cluster-apps Kustomization: flux-system/rook-ceph-cluster

+++ kubernetes/apps Kustomization: flux-system/cluster-apps Kustomization: flux-system/rook-ceph-cluster

@@ -0,0 +1,40 @@

+---
+apiVersion: kustomize.toolkit.fluxcd.io/v1
+kind: Kustomization
+metadata:
+  labels:
+    kustomize.toolkit.fluxcd.io/name: cluster-apps
+    kustomize.toolkit.fluxcd.io/namespace: flux-system
+  name: rook-ceph-cluster
+  namespace: flux-system
+spec:
+  commonMetadata:
+    labels:
+      app.kubernetes.io/name: rook-ceph-cluster
+  decryption:
+    provider: sops
+    secretRef:
+      name: sops-age
+  interval: 30m
+  path: ./kubernetes/apps/rook-ceph/cluster
+  postBuild:
+    substituteFrom:
+    - kind: ConfigMap
+      name: cluster-settings
+    - kind: Secret
+      name: cluster-secrets
+    - kind: ConfigMap
+      name: cluster-settings-user
+      optional: true
+    - kind: Secret
+      name: cluster-secrets-user
+      optional: true
+  prune: true
+  retryInterval: 5m30s
+  sourceRef:
+    kind: GitRepository
+    name: home-kubernetes
+  targetNamespace: rook-ceph
+  timeout: 15m
+  wait: false
+
--- kubernetes/apps/rook-ceph/cluster Kustomization: flux-system/rook-ceph-cluster HelmRelease: rook-ceph/rook-ceph-cluster

+++ kubernetes/apps/rook-ceph/cluster Kustomization: flux-system/rook-ceph-cluster HelmRelease: rook-ceph/rook-ceph-cluster

@@ -156,12 +156,14 @@

           name: odroid-02
         - devices:
           - name: /dev/sda
           name: odroid-03
         useAllDevices: false
         useAllNodes: false
+    cephFileSystems: []
+    cephObjectStores: []
     configOverride: |
       [global]
       bdev_enable_discard = true
       bdev_async_discard = true
       osd_class_update_on_start = false
     ingress:

@jgilfoil jgilfoil merged commit 65ed7d5 into main Feb 25, 2024
5 checks passed
@jgilfoil jgilfoil deleted the feature/rook-ceph branch February 25, 2024 08:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant