V1.3 aws single cmd install

[rrrkharse]

Description of your changes:

• Provide single command installation file to install all supported KF components with AWS integrations
  • Created a new Katib manifest folder to achieve this
• Clean up README:
  • Move AWS integrated component installation instructions with the existing KF individual component installation section
  • Format with regard to vanilla Kubeflow manifests README instructions

Testing

• For testing KF installation
  • For testing pipelines ran the following experiment:
    • [Demo] TFX - Taxi tip prediction model trainer ([Demo] TFX - Taxi tip prediction model trainer)
  • For testing katib ran:
    • https://raw.githubusercontent.com/kubeflow/katib/master/examples/v1beta1/kubeflow-training-operator/tfjob-mnist-with-summaries.yaml
• Tested new single command installations

while ! kustomize build examples/base-install | kubectl apply -f -; do echo "Retrying to apply resources"; sleep 10; done

while ! kustomize build examples/aws-install | kubectl apply -f -; do echo "Retrying to apply resources"; sleep 10; done

• Tested individual component installations for Katib and KFP with RDS+S3

while ! kustomize build examples/base-install | kubectl apply -f -; do echo "Retrying to apply resources"; sleep 10; done

...

kustomize build apps/pipeline/upstream/env/aws/ | kubectl apply -f -
kustomize build /apps/katib/upstream/installs/katib-external-db-with-kubeflow | kubectl apply -f - 

• Tested delete

[surajkota]

We discussed the following to keep the README manageable as we add new features:

• Leave the main README and example/kustomization.yaml as is
• create example/aws/rds-s3 directory, in future there will be example/aws/cognito directory
• create a README in example/aws directory for general pre-requisites like cluster, tools etc.
• create README in child folder for specific instructions and deploying kubeflow
• if needed add a one-liner pointer to this directory in main README