Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kahu: Requirement analysis for Job based data protection framework #6

Open
AmitRoushan opened this issue Jan 17, 2023 · 0 comments · May be fixed by #8
Open

Kahu: Requirement analysis for Job based data protection framework #6

AmitRoushan opened this issue Jan 17, 2023 · 0 comments · May be fixed by #8
Assignees
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@AmitRoushan
Copy link
Collaborator

Issue/Feature Description:
KAHU project under the soda-cdm organisation deals with data protection aspects of container data management on Kubernetes .
Currently Kahu supports different volume backup and backup location with Provider framework. The framework provides a plugin approach to integrated Volume/BackupLocation driver in runtime itself.

Currently Volume/BackupLocation drivers are deployed either as “Deployment” or “Statefulset”. The solution works perfectly if the drive uses APIs to connect with respective servers. But it would not work

  • If backup/restore drivers are data movers (like Restic).
  • If volumes are topologically distributed
  • Currently Kubernetes does not support hot mount functionality, So if any Volume backup driver needs “Volume” mount for backup/restore. Current approach will be failure

Why this issue to fixed / feature is needed(give scenarios or use cases):
Data protection is a scheduled operation. So running a driver process and waiting for a backup/restore request to process is a waste of memory and CPU cycles.

An alternative approach is to make accept volume backup driver and backup location driver as Pod template and schedule a Kubernetes job to process backup/restore request

The issue is submitted to discuss an alternate approach (Job based data protection) to handle data protection.

How to reproduce, in case of a bug:
NA
Other Notes / Environment Information: (Please give the env information, log link or any useful information for this issue)

Initial draft is compiled here

@AmitRoushan AmitRoushan self-assigned this Jan 17, 2023
@AmitRoushan AmitRoushan added documentation Improvements or additions to documentation enhancement New feature or request labels Jan 17, 2023
@AmitRoushan AmitRoushan changed the title Kahu: Job based data protection framework Kahu: Requirement analysis for Job based data protection framework Jan 23, 2023
@AmitRoushan AmitRoushan moved this to In Progress in v1.1.0 Feb 9, 2023
@skdwriting skdwriting moved this from In Progress to Done in v1.1.0 Feb 5, 2024
@skdwriting skdwriting moved this from Done to In Progress in v1.1.0 Feb 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
Status: In Progress
Development

Successfully merging a pull request may close this issue.

1 participant