Repository navigation
Data Protection Working Group #4301
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,35 @@ | ||
| <!--- | ||
| This is an autogenerated file! | ||
|
|
||
| Please do not edit this file directly, but instead make changes to the | ||
| sigs.yaml file in the project root. | ||
|
|
||
| To understand how this file is generated, see https://git.k8s.io/community/generator/README.md | ||
| ---> | ||
| # Data Protection Working Group | ||
|
|
||
| A Working Group dedicated to promoting data protection support in Kubernetes, identifying missing functionality and working together to design features to enable data protection support. Involves collaboration with multiple SIGs such as Apps and Storage. | ||
|
|
||
| The [charter](charter.md) defines the scope and governance of the Data Protection Working Group. | ||
|
|
||
| ## Stakeholder SIGs | ||
| * SIG Apps | ||
| * SIG Storage | ||
|
|
||
| ## Meetings | ||
| * Regular WG Meeting: [Mondays at 9:00 PT (Pacific Time)](https://docs.google.com/document/d/15tLCV3csvjHbKb16DVk-mfUmFry_Rlwo-2uG6KNGsfw/edit) (bi-weekly). [Convert to your timezone](http://www.thetimezoneconverter.com/?t=9:00&tz=PT%20%28Pacific%20Time%29). | ||
| * [Meeting notes and Agenda](http://bit.ly/wg-data-protection-notes). | ||
| * [Meeting recordings](http://bit.ly/data-protection-playlist). | ||
|
|
||
| ## Organizers | ||
|
|
||
| * Xing Yang (**[@xing-yang](https://github.com/xing-yang)**), VMware | ||
| * Xiangqian Yu (**[@yuxiangqian](https://github.com/yuxiangqian)**), Google | ||
|
|
||
| ## Contact | ||
| - Slack: [#wg-data-protection](https://kubernetes.slack.com/messages/wg-data-protection) | ||
| - [Mailing list](https://groups.google.com/forum/#!forum/kubernetes-data-protection) | ||
| - [Open Community Issues/PRs](https://github.com/kubernetes/community/labels/wg%2Fdata-protection) | ||
| <!-- BEGIN CUSTOM CONTENT --> | ||
|
|
||
| <!-- END CUSTOM CONTENT --> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,84 @@ | ||
| # WG Data Protection Charter | ||
|
|
||
| This charter adheres to the [wg-governance] guidance as well as | ||
| the general conventions described in the [Kubernetes Charter README] and | ||
| the Roles and Organization Management outlined in [sig-governance], where | ||
| applicable to a Working Group. | ||
|
|
||
|
|
||
| ## Scope | ||
|
|
||
| The purpose of Data Protection is to ensure that application and its associated | ||
| data can be restored quickly after any corruption or loss. | ||
|
|
||
| Data protection in Kubernetes context typically involves backup and recovery | ||
| of two types of entities: | ||
| * Kubernetes API object resources | ||
|
xing-yang marked this conversation as resolved.
|
||
| * Persistent volume data | ||
| We consider it a complicated and layered problem, including backup and recovery | ||
| at persistent volume level, application level, and cluster level. Part of the | ||
|
xing-yang marked this conversation as resolved.
|
||
| working group’s charter is to define what Kubernetes native constructs are | ||
| required to achieve these goals. | ||
|
|
||
| The Data Protection Working Group is organized with the goal of providing | ||
| a cross SIG forum to discuss how to support data protection in Kubernetes, | ||
| identify missing functionality, and work together to design features that | ||
| are needed to achieve the goal. | ||
|
|
||
| ### In scope | ||
|
|
||
| * High level discussions on what it means to support data protection in Kubernetes at different levels and how to do it. | ||
| * Design discussions on specific topics related to data protection and disaster recovery support. | ||
| * Document results of discussions and investigations in a linkable medium. | ||
|
|
||
| Potential design topics include, but are not limited to the following: | ||
| * Read data from a snapshot without creating a new volume. | ||
| * Volume backups | ||
| * Data populator | ||
| * Retrieve diffs between two snapshots (block and file level) | ||
|
xing-yang marked this conversation as resolved.
|
||
| * Consistency volume groups (group snapshot) | ||
|
xing-yang marked this conversation as resolved.
|
||
| * Application snapshot, backup, and recovery | ||
|
xing-yang marked this conversation as resolved.
|
||
| * Data protection policy (Data protection policy usually means we can set up a schedule to do | ||
|
xing-yang marked this conversation as resolved.
|
||
| periodic backups, set a backup retention policy to automatically clean up old backups, set a | ||
| topology to specify a backup location, etc. It can also possibly include policies such as | ||
| `backups must be encrypted` and `secrets must be encrypted at rest and in transit`.) | ||
| * Data protection workflows | ||
|
|
||
| ### Out of Scope | ||
|
|
||
| * Design discussions not related to data protection is out of scope. For example, | ||
|
xing-yang marked this conversation as resolved.
|
||
| how to migrate in-tree drivers to CSI drivers and how to report volume health | ||
| belong to SIG Storage and would not be a focus area of this WG. Workload API designs | ||
| for StatefulSet and Deployment belong to SIG Apps, however, this WG would be interested | ||
| in figuring out how to backup and recover a StatefulSet or Deployment. | ||
| * This is a working group so it does not own code. Design discussions for | ||
| a specific feature including KEP reviews can happen in the working group | ||
| but KEP approvals and code implementation will be owned by SIG-Apps or | ||
| SIG-Storage. | ||
| * Security and privacy protection is an important aspect but not a focus of this WG. This WG will consult with [CNCF SIG-Security](https://github.com/cncf/sig-security) for those issues. | ||
|
|
||
|
|
||
| ## Stakeholders | ||
|
|
||
| Stakeholders for this working group include members in the following SIGs: | ||
| * SIG Apps | ||
| * SIG Storage | ||
|
|
||
| We will also consult SIG Auth from security aspect. Stakeholders also include | ||
| backup vendors who want to provide data protection support in Kubernetes and | ||
| end users who want to use data protection applications. | ||
|
|
||
|
|
||
| ## Disband criteria | ||
|
|
||
| This WG will be producing documents as described in the `In Scope` section. If stakeholder SIGs and the WG decide all documents described in the `In Scope` section are complete and no more discussions and investigations are needed in this WG, they may determine to disband this WG. | ||
|
|
||
|
|
||
| [sig-governance]: https://github.com/kubernetes/community/blob/master/committee-steering/governance/sig-governance.md | ||
| [wg-governance]: https://github.com/kubernetes/community/blob/master/committee-steering/governance/wg-governance.md | ||
| [Kubernetes Charter README]: https://github.com/kubernetes/community/blob/master/committee-steering/governance/README.md | ||
| [lazy consensus]: http://en.osswiki.info/concepts/lazy_consensus | ||
|
|
||
| [kubernetes-dev@]: https://groups.google.com/forum/#!forum/kubernetes-dev | ||
| [wg-data-protection@]: https://groups.google.com/forum/#!forum/kubernetes-wg-data-protection | ||
| [kubernetes/k8s.io]: https://git.k8s.io/k8s.io | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.