Skip to content

Commit

Permalink
wg-manifests: Introduce WG Manifests (#435)
Browse files Browse the repository at this point in the history
* Add wg-manifests

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* wg-manifests: Autogenerate files

Run `make WHAT=wg-manifests` to generate files for the control plane
working group.

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* wgs: Fix broken references to WG Control Plane

The WG responsible for the manifests is called is the WG Manifests. Fix
references in chapters of other WGs and SIGs and re-gerenate files.

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>
  • Loading branch information
yanniszark authored Nov 3, 2020
1 parent a7e72a4 commit 0744fa0
Show file tree
Hide file tree
Showing 9 changed files with 191 additions and 3 deletions.
7 changes: 7 additions & 0 deletions OWNERS_ALIASES
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,13 @@ aliases:
- andreyvelich
- gaocegege
- johnugeorge
wg-manifests-leads:
- Jeffwan
- PatrickXYS
- StefanoFioravanzo
- elikatsis
- vkoukis
- yanniszark
wg-notebooks-leads:
- StefanoFioravanzo
- elikatsis
Expand Down
1 change: 1 addition & 0 deletions sig-feature-store/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,7 @@ subprojects, and resolve cross-subproject technical issues and decisions.
- GitHub Teams:
- [@kubeflow/sig-feature-store](https://github.com/orgs/kubeflow/teams/sig-feature-store) - Feature store development and roadmap

[subproject-definition]: https://github.com/kubeflow/community/blob/master/governance.md#subprojects
<!-- BEGIN CUSTOM CONTENT -->

<!-- END CUSTOM CONTENT -->
2 changes: 1 addition & 1 deletion sig-feature-store/charter.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ This SIG aims to coordinate projects and technologies necessary to enable the co
- Coordinating with Pipelines/KFData WG to ensure both datasets and streams can be ingested, persisted, and served.
- Coordinating with Training WG to make sure that its possible to create training datasets using the feature store.
- Coordinating with Serving WG to make sure that its possible to retrieve online feature data from the feature store.
- Coordinating with Control Plane WG to ensure that feature store manifests are properly deployed with Kubeflow.
- Coordinating with Manifests WG to ensure that feature store manifests are properly deployed with Kubeflow.
- Coordinating with release teams to ensure that the feature store functionality can be released properly.

### Out of scope
Expand Down
2 changes: 1 addition & 1 deletion wg-automl/charter.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ The WG covers researching, developing and operating various targets of ML automa
#### Cross-cutting and Externally Facing Processes

- Coordinating with Training WG to make sure that all distributed training jobs can be used in AutoML experiments.
- Coordinating with Control Plane WG to ensure that AutoML manifests are properly deployed with Kubeflow.
- Coordinating with Manifests WG to ensure that AutoML manifests are properly deployed with Kubeflow.
- Coordinating with Central Dashboard WG to correct integration with AutoML UI.
- Coordinating with release teams to ensure that the AutoML features can be released properly.

Expand Down
2 changes: 2 additions & 0 deletions wg-list.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ When the need arises, a [new WG can be created](wgs/wg-lifecycle.md)
| Name | Label | Chairs | Contact | Meetings |
|------|-------|--------|---------|----------|
|[AutoML](wg-automl/README.md)|area/wg-automl|* [Andrey Velichkevich](https://github.com/andreyvelich), Cisco<br>* [Ce Gao](https://github.com/gaocegege), Caicloud<br>* [Johnu George](https://github.com/johnugeorge), Cisco<br>|* [Slack](https://kubeflow.slack.com/messages/wg-automl)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Kubeflow AutoML Working Group Meeting (Asia & Europe friendly): [Wednesdays at 10:00am UTC (Coordinated Universal Time) (monthly - second Wednesday every month)]()<br>* Kubeflow AutoML Working Group Meeting (US friendly): [Wednesdays at 4:00pm UTC (Coordinated Universal Time) (monthly - fourth Wednesday every month)]()<br>
|[Manifests](wg-manifests/README.md)|area/wg-manifests|* [Yao Xiao](https://github.com/PatrickXYS), AWS<br>* [Vangelis Koukis](https://github.com/vkoukis), Arrikto<br>* [Yannis Zarkadas](https://github.com/yanniszark), Arrikto<br>|* [Slack](https://kubeflow.slack.com/messages/wg-manifests)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Regular WG Meeting (Pacific AM): [Tuesdays at 08:00 PT (Pacific Time) (biweekly - every other Tuesday)]()<br>
|[Notebooks](wg-notebooks/README.md)|area/wg-notebooks|* [Stefano Fioravanzo](https://github.com/StefanoFioravanzo), Arrikto<br>* [Ilias Katsakioris](https://github.com/elikatsis), Arrikto<br>* [Kimonas Sotirchos](https://github.com/kimwnasptd), Arrikto<br>* [Mathew Wicks](https://github.com/thesuperzapper)<br>* [Yannis Zarkadas](https://github.com/yanniszark), Arrikto<br>|* [Slack](https://kubeflow.slack.com/messages/wg-notebooks)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Regular Notebooks Meeting (Asia & Europe friendly): [Thursdays at 10:00 am UTC (Coordinated Universal Time) (monthly - second Thursday every month)]()<br>* Regular Notebooks Meeting (US friendly): [Thursdays at 4:00 pm UTC (Coordinated Universal Time) (monthly - fourth Thursday every month)]()<br>
|[Pipelines](wg-pipelines/README.md)|area/wg-pipelines|* [James Wu](https://github.com/james-jwu), Google<br>* [Karthik Ramachandran](https://github.com/kramachandran), Google<br>* [Pavel Dournov](https://github.com/paveldournov), Google<br>|* [Slack](https://kubeflow.slack.com/messages/)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|
|[Serving](wg-serving/README.md)|area/wg-serving|* [Animesh Singh](https://github.com/animeshsingh), IBM<br>* [Clive Cox](https://github.com/cliveseldon), Seldon<br>* [Ellis Tarn](https://github.com/ellistarn), AWS<br>* [Rakesh Kalekar](https://github.com/rakelkar), Microsoft<br>* [Dan Sun](https://github.com/yuzisun), Bloomberg<br>|* [Slack](https://kubeflow.slack.com/messages/kfserving)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Regular WG Meeting: [Wednesdays at 09:00 PT (Pacific Time) (biweekly)]()<br>
Expand All @@ -33,6 +34,7 @@ When the need arises, a [new WG can be created](wgs/wg-lifecycle.md)
| Name | Organizers | Contact | Meetings |
|------|------------------|-----------|---------|
|[AutoML](wg-automl/README.md)|* [Andrey Velichkevich](https://github.com/andreyvelich), Cisco<br>* [Ce Gao](https://github.com/gaocegege), Caicloud<br>* [Johnu George](https://github.com/johnugeorge), Cisco<br>|* [Slack](https://kubeflow.slack.com/messages/wg-automl)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Kubeflow AutoML Working Group Meeting (Asia & Europe friendly): [Wednesdays at 10:00am UTC (Coordinated Universal Time) (monthly - second Wednesday every month)]()<br>* Kubeflow AutoML Working Group Meeting (US friendly): [Wednesdays at 4:00pm UTC (Coordinated Universal Time) (monthly - fourth Wednesday every month)]()<br>
|[Manifests](wg-manifests/README.md)|* [Yao Xiao](https://github.com/PatrickXYS), AWS<br>* [Vangelis Koukis](https://github.com/vkoukis), Arrikto<br>* [Yannis Zarkadas](https://github.com/yanniszark), Arrikto<br>|* [Slack](https://kubeflow.slack.com/messages/wg-manifests)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Regular WG Meeting (Pacific AM): [Tuesdays at 08:00 PT (Pacific Time) (biweekly - every other Tuesday)]()<br>
|[Notebooks](wg-notebooks/README.md)|* [Stefano Fioravanzo](https://github.com/StefanoFioravanzo), Arrikto<br>* [Ilias Katsakioris](https://github.com/elikatsis), Arrikto<br>* [Kimonas Sotirchos](https://github.com/kimwnasptd), Arrikto<br>* [Mathew Wicks](https://github.com/thesuperzapper)<br>* [Yannis Zarkadas](https://github.com/yanniszark), Arrikto<br>|* [Slack](https://kubeflow.slack.com/messages/wg-notebooks)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Regular Notebooks Meeting (Asia & Europe friendly): [Thursdays at 10:00 am UTC (Coordinated Universal Time) (monthly - second Thursday every month)]()<br>* Regular Notebooks Meeting (US friendly): [Thursdays at 4:00 pm UTC (Coordinated Universal Time) (monthly - fourth Thursday every month)]()<br>
|[Pipelines](wg-pipelines/README.md)|* [James Wu](https://github.com/james-jwu), Google<br>* [Karthik Ramachandran](https://github.com/kramachandran), Google<br>* [Pavel Dournov](https://github.com/paveldournov), Google<br>|* [Slack](https://kubeflow.slack.com/messages/)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|
|[Serving](wg-serving/README.md)|* [Animesh Singh](https://github.com/animeshsingh), IBM<br>* [Clive Cox](https://github.com/cliveseldon), Seldon<br>* [Ellis Tarn](https://github.com/ellistarn), AWS<br>* [Rakesh Kalekar](https://github.com/rakelkar), Microsoft<br>* [Dan Sun](https://github.com/yuzisun), Bloomberg<br>|* [Slack](https://kubeflow.slack.com/messages/kfserving)<br>* [Mailing List](https://groups.google.com/forum/#!forum/kubeflow-discuss)|* Regular WG Meeting: [Wednesdays at 09:00 PT (Pacific Time) (biweekly)]()<br>
Expand Down
35 changes: 35 additions & 0 deletions wg-manifests/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
<!---
This is an autogenerated file!
Please do not edit this file directly, but instead make changes to the
sigs.yaml file in the project root.
To understand how this file is generated, see https://github.com/kubeflow/community/generator/README.md
--->
# Manifests Working Group

WG Manifests maintains a centralized repository of manifests.

The [charter](charter.md) defines the scope and governance of the Manifests Working Group.

## Meetings
* Regular WG Meeting (Pacific AM): [Tuesdays at 08:00 PT (Pacific Time)]() (biweekly - every other Tuesday). [Convert to your timezone](http://www.thetimezoneconverter.com/?t=08:00&tz=PT%20%28Pacific%20Time%29).
* [Meeting notes and Agenda](http://bit.ly/kf-meeting-notes).

## Organizers

* Yao Xiao (**[@PatrickXYS](https://github.com/PatrickXYS)**), AWS
* Vangelis Koukis (**[@vkoukis](https://github.com/vkoukis)**), Arrikto
* Yannis Zarkadas (**[@yanniszark](https://github.com/yanniszark)**), Arrikto

## Contact
- Slack: [#wg-manifests](https://kubeflow.slack.com/messages/wg-manifests)
- [Mailing list](https://groups.google.com/forum/#!forum/kubeflow-discuss)
- [Open Community Issues/PRs](https://github.com/kubeflow/community/labels/wg%2Farea/wg-manifests)
- GitHub Teams:
- [@kubeflow/wg-manifests-bugs](https://github.com/orgs/kubeflow/teams/wg-manifests-bugs) - Bug Triage and Troubleshooting
- [@kubeflow/wg-manifests-misc](https://github.com/orgs/kubeflow/teams/wg-manifests-misc) - General Discussion
- [@kubeflow/wg-manifests-reviews](https://github.com/orgs/kubeflow/teams/wg-manifests-reviews) - Changes and Reviews
<!-- BEGIN CUSTOM CONTENT -->

<!-- END CUSTOM CONTENT -->
76 changes: 76 additions & 0 deletions wg-manifests/charter.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
# WG Manifests Charter

This charter adheres to the conventions, roles and organization management
outlined in [wg-governance].

## Scope

- Provide a catalog (centralized repository) of Kubeflow application manifests.
- Provide a catalog of third-party apps for common services.

### In scope

#### Code, Binaries and Services

- Maintain tooling to automate copying manifests from upstream app repos.
- Maintain a catalog that will allow users to install Kubeflow apps and
common services easily on Kubernetes, either on the cloud or on-prem, without
depending on external cloud services or closed source solutions. Those
manifests are deployed using `kubectl` and `kustomize` and include:
1. A common set of manifests for the current official Kubeflow applications:
- Training Operators
- Kubeflow Pipelines (KFP)
- Notebooks
- KFServing
- Katib
- Central Dashboard
- Profile Controller
- PodDefaults Controller
1. Manifests for a set of specific common services:
- Istio
- KNative
- Dex
- Cert-Manager

#### Cross-cutting and Externally Facing Processes

##### With Application Owners

- Aid applications owners in creating kustomize manifests for their application,
inside the app repo, if those don't exist already.
- Communicate with application owners to agree upon the version they want to be
included in the next Kubeflow release.

##### With Distribution Owners

- Coordinate with distribution owners, to make sure they are in-sync about the
release schedule and have time to test and bring their distributions
up-to-date.

### Out of scope

This WG is NOT going to:
- Maintain deployment-specific tools like `kfctl`.
- Maintain distribution-specific manifests.
- Decide which applications to include in Kubeflow.
- Decide which variant of an application to include (e.g., KFP Standalone vs
KFP with Istio).
- Create and maintain one or more Kubeflow distributions.
- Support configurations with environment-specific requirements, like special
hardware, different versions of third-party apps (e.g., Istio, KNative, etc.)
or custom OIDC providers.
- Support and promote a specific deployment tool (e.g., `kfctl`). Opinionated
deployment tools can extend the base kustomizations to create manifests that
support their methods.
- For example, people invested in `kfctl` can create overlays that enable
the use of `kfctl`'s parameter substitution, which expects a specific
folder structure (`params.env`).

## Roles and Organization Management

This WG adheres to the Roles and Organization Management outlined in
[wg-governance] and opts-in to updates and modifications to [wg-governance].

[wg-governance]: ../wg-governance.md
[wg-subprojects]: https://github.com/Kubeflow/community/blob/master/wg-YOURWG/README.md#subprojects
[Kubeflow Charter README]: https://github.com/Kubeflow/community/blob/master/committee-steering/governance/README.md
2 changes: 1 addition & 1 deletion wg-notebooks/charter.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ WG Notebooks is responsible for the user experience around Notebooks and their i

#### Cross-cutting and Externally Facing Processes

- Coordinating with Control Plane WG to ensure that Notebooks manifests are properly deployed with Kubeflow.
- Coordinating with Manifests WG to ensure that Notebooks manifests are properly deployed with Kubeflow.
- Coordinating with Central Dashboard WG to ensure the integration with the Notebook Manager UI is up-to-date.
- Coordinating with Training and AutoML WG to ensure that corresponding SDK is properly working in Kubeflow Notebooks
- Ensuring that Kubeflow's Notebook images are continuously built and released.
Expand Down
67 changes: 67 additions & 0 deletions wgs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -96,6 +96,73 @@ workinggroups:
- name: katib
owners:
- https://raw.githubusercontent.com/kubeflow/katib/master/OWNERS
- dir: wg-manifests
name: Manifests
mission_statement: >
WG Manifests maintains a centralized repository of manifests.
charter_link: charter.md
label: area/wg-manifests
leadership:
chairs:
- github: PatrickXYS
name: Yao Xiao
company: AWS
- github: vkoukis
name: Vangelis Koukis
company: Arrikto
- github: yanniszark
name: Yannis Zarkadas
company: Arrikto
tech_leads:
- github: Jeffwan
name: Jiaxin Shan
company: Amazon Web Services
- github: PatrickXYS
name: Yao Xiao
company: AWS
- github: StefanoFioravanzo
name: Stefano Fioravanzo
company: Arrikto
- github: elikatsis
name: Ilias Katsakioris
company: Arrikto
- github: vkoukis
name: Vangelis Koukis
company: Arrikto
- github: yanniszark
name: Yannis Zarkadas
company: Arrikto
meetings:
- description: Regular WG Meeting (Pacific AM)
day: Tuesday
time: "08:00"
tz: PT (Pacific Time)
frequency: biweekly - every other Tuesday
archive_url: http://bit.ly/kf-meeting-notes
contact:
slack: wg-manifests
mailing_list: https://groups.google.com/forum/#!forum/kubeflow-discuss
teams:
- name: wg-manifests-bugs
description: Bug Triage and Troubleshooting
- name: wg-manifests-misc
description: General Discussion
- name: wg-manifests-reviews
description: Changes and Reviews
subprojects:
- name: central-dashboard
owners:
- https://github.com/kubeflow/kubeflow/blob/master/components/centraldashboard/OWNERS
- name: manifests
owners:
- https://raw.githubusercontent.com/kubeflow/manifests/master/OWNERS
- name: poddefaults-webhook
owners:
- https://github.com/kubeflow/kubeflow/blob/master/components/admission-webhook/OWNERS
- name: profile-controller
owners:
- https://github.com/kubeflow/kubeflow/blob/master/components/profile-controller/OWNERS
- dir: wg-notebooks
name: Notebooks
mission_statement: >
Expand Down

0 comments on commit 0744fa0

Please sign in to comment.