Brainstorm enhancing UX

[ahg-g]

We are adding more information to statuses of the various APIs we have (#7 and #5); but I am wondering what other UX-related enhancements we should pursue for the two personas: batch admin and batch user.

UX gets users excited about the system and I think should be a focal point as Kueue evolves.

[ArangoGutierrez]

• Prometheus integration for resource consumption of QueuedWorkloads / Queues

[ahg-g]

A kubectl plugin will be quite useful here for both admins and users.

[alculquicondor]

I think we should update the QueuedWorkloadAdmitted condition to True in a best-effort basis.

This means that we don't need to do it in the scheduling cycle. But we can do it in the controller (we will get an event for the addition of the .spec.admission field).

[ahg-g]

Created #201 and #199 to track updating the workload condition and adding metrics. Closing this one.