Improve observability of universal operator

[Jeffwan]

Part of #1318

1. We are currently using default liveness/readiness from kubebuilder. It would be great to double check if that's enough for our case

2. Job metrics are not unified. TensorFlow has best support and same prometheus metrics should be observed for rest of the frameworks.

/help

[google-oss-robot]

@Jeffwan:
This request has been marked as needing help from a contributor.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

Part of #1318

1. We are currently using default liveness/readiness from kubebuilder. It would be great to double check if that's enough for our case

2. Job metrics are not unified. TensorFlow has best support and same prometheus metrics should be observed for rest of the frameworks.

/help

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[Jeffwan]

/good-first-issue

[google-oss-robot]

@Jeffwan:
This request has been marked as suitable for new contributors.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-good-first-issue command.

In response to this:

/good-first-issue

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[deepak-muley]

I am working on this issue and will have a PR early next week.

[Jeffwan]

@deepak-muley Thanks! I assign to you

[Jeffwan]

/priority p1

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.