Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PVC for dev.kubeflow.org #139

Merged
merged 1 commit into from
May 25, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
# pkg and bin directories currently contain build artifacts
# only so we exclude them.
bin/
vendor/

.vscode/

Expand Down
2 changes: 1 addition & 1 deletion .pylintrc
Original file line number Diff line number Diff line change
Expand Up @@ -401,4 +401,4 @@ exclude-protected=_asdict,_fields,_replace,_source,_make

# Exceptions that will emit a warning when being caught. Defaults to
# "Exception"
overgeneral-exceptions=Exception
overgeneral-exceptions=Exception
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
apiVersion: 0.1.0
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 0f0cb1c9deeb8b05965dd870bf9b4625b7666d92
refSpec: master
kind: ksonnet.io/registry
libraries:
Expand Down
10 changes: 5 additions & 5 deletions dev-kubeflow-org/ks-app/app.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,25 +10,25 @@ kind: ksonnet.io/app
libraries:
core:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 0f0cb1c9deeb8b05965dd870bf9b4625b7666d92
refSpec: master
name: core
registry: kubeflow
seldon:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 0f0cb1c9deeb8b05965dd870bf9b4625b7666d92
refSpec: master
name: seldon
registry: kubeflow
tf-job:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 0f0cb1c9deeb8b05965dd870bf9b4625b7666d92
refSpec: master
name: tf-job
registry: kubeflow
tf-serving:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 0f0cb1c9deeb8b05965dd870bf9b4625b7666d92
refSpec: master
name: tf-serving
registry: kubeflow
Expand All @@ -42,7 +42,7 @@ registries:
uri: github.com/ksonnet/parts/tree/master/incubator
kubeflow:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 0f0cb1c9deeb8b05965dd870bf9b4625b7666d92
refSpec: master
protocol: github
uri: github.com/kubeflow/kubeflow/tree/master/kubeflow
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,5 +14,6 @@ local image = params.image;
local namespace = updatedParams.namespace;
local replicas = params.replicas;
local endpoint = params.endpoint;
local pvcName = params.pvcName;

k.core.v1.list.new(serve.parts(namespace).serve(name, image, replicas, endpoint))
k.core.v1.list.new(serve.parts(namespace).serve(name, image, replicas, endpoint, pvcName))
4 changes: 3 additions & 1 deletion dev-kubeflow-org/ks-app/components/params.libsonnet
Original file line number Diff line number Diff line change
Expand Up @@ -12,14 +12,15 @@
jupyterHubAuthenticator: "iap",
jupyterHubImage: "gcr.io/kubeflow/jupyterhub-k8s:1.0.1",
jupyterHubServiceType: "ClusterIP",
jupyterNotebookPVCMount: "null",
jupyterNotebookPVCMount: "/home/jovyan",
name: "kubeflow-core",
namespace: "null",
reportUsage: "true",
tfAmbassadorServiceType: "ClusterIP",
tfDefaultImage: "null",
tfJobImage: "gcr.io/kubeflow-images-public/tf_operator:v20180329-a7511ff",
tfJobUiServiceType: "ClusterIP",
tfJobVersion: "v1alpha1",
usageId: "f85740a3-5f60-4146-91b6-2ab7089cf01c",
},
"cert-manager": {
Expand Down Expand Up @@ -56,6 +57,7 @@
image: "gcr.io/kubeflow-images-public/issue-summarization:0.1",
name: "issue-summarization",
namespace: "kubeflow",
pvcName: "github-issues-data",
replicas: 1,
},
"issue-summarization-ui": {
Expand Down
216 changes: 108 additions & 108 deletions dev-kubeflow-org/ks-app/lib/v1.7.0/k8s.libsonnet

Large diffs are not rendered by default.

72 changes: 72 additions & 0 deletions dev-kubeflow-org/ks-app/vendor/kubeflow/core/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
**Table of Contents** *generated with [DocToc](https://github.com/thlorenz/doctoc)*

- [core](#core)
- [Quickstart](#quickstart)
- [Using the library](#using-the-library)
- [io.ksonnet.pkg.kubeflow-core](#ioksonnetpkgkubeflow-core)
- [Example](#example)
- [Parameters](#parameters)

<!-- END doctoc generated TOC please keep comment here to allow auto update -->

# core

> Core components of Kubeflow.


* [Quickstart](#quickstart)
* [Using Prototypes](#using-prototypes)
* [io.ksonnet.pkg.kubeflow-core](#io.ksonnet.pkg.kubeflow-core)

## Quickstart

*The following commands use the `io.ksonnet.pkg.kubeflow` prototype to generate Kubernetes YAML for core, and then deploys it to your Kubernetes cluster.*

First, create a cluster and install the ksonnet CLI (see root-level [README.md](rootReadme)).

If you haven't yet created a [ksonnet application](linkToSomewhere), do so using `ks init <app-name>`.

Finally, in the ksonnet application directory, run the following:

```shell
# Expand prototype as a Jsonnet file, place in a file in the
# `components/` directory. (YAML and JSON are also available.)
$ ks prototype use io.ksonnet.pkg.kubeflow-core \
--name core \
--namespace default \
--disks

# Apply to server.
$ ks apply -f core.jsonnet
```

## Using the library

The library files for core define a set of relevant *parts* (_e.g._, deployments, services, secrets, and so on) that can be combined to configure core for a wide variety of scenarios. For example, a database like Redis may need a secret to hold the user password, or it may have no password if it's acting as a cache.

This library provides a set of pre-fabricated "flavors" (or "distributions") of core, each of which is configured for a different use case. These are captured as ksonnet *prototypes*, which allow users to interactively customize these distributions for their specific needs.

These prototypes, as well as how to use them, are enumerated below.

### io.ksonnet.pkg.kubeflow-core

Kubeflow core components
#### Example

```shell
# Expand prototype as a Jsonnet file, place in a file in the
# `components/` directory. (YAML and JSON are also available.)
$ ks prototype use io.ksonnet.pkg.kubeflow-core core \
--name YOUR_NAME_HERE
```

#### Parameters

The available options to pass prototype are:

* `--name=<name>`: Name to give to each of the components [string]


[rootReadme]: https://github.com/ksonnet/mixins
19 changes: 19 additions & 0 deletions dev-kubeflow-org/ks-app/vendor/kubeflow/core/all.libsonnet
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
{
parts(params):: {
local ambassador = import "kubeflow/core/ambassador.libsonnet",
local jupyterhub = import "kubeflow/core/jupyterhub.libsonnet",
local nfs = import "kubeflow/core/nfs.libsonnet",
local tfjob = import "kubeflow/core/tf-job-operator.libsonnet",
local spartakus = import "kubeflow/core/spartakus.libsonnet",
local centraldashboard = import "kubeflow/core/centraldashboard.libsonnet",
local version = import "kubeflow/core/version.libsonnet",

all:: jupyterhub.all(params)
+ tfjob.all(params)
+ ambassador.all(params)
+ nfs.all(params)
+ spartakus.all(params)
+ centraldashboard.all(params)
+ version.all(params),
},
}
Loading