Sync from upstream master

[VedantMahabaleshwarkar]

What this PR does / why we need it:

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes # https://issues.redhat.com/browse/RHOAIENG-19207

• cherry-picked commits from upstream up to kserve@5aedc95
• further commits include the kserve gatewayapi changes which include a lot of conflicts with ODH kserve raw logic, we need working e2e tests to verify those changes so I have not included them in this PR.

Feature/Issue validation/testing:

Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

unit and e2e tests

Special notes for your reviewer:

Re-running failed tests

• /rerun-all - rerun all failed workflows.
• /rerun-workflow <workflow name> - rerun a specific failed workflow. Only one workflow name can be specified. Multiple /rerun-workflow commands are allowed per comment.

[spolti]

did you break this sync into smaller chunks?

[spolti]

@israel-hdez @Jooho do you want to take a look before merging?

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: spolti, VedantMahabaleshwarkar

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [VedantMahabaleshwarkar,spolti]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[VedantMahabaleshwarkar]

did you break this sync into smaller chunks?

@spolti Yes, I sent this on slack

for the sync from upstream, the gatewayapi changes are leading to some unit and e2e test failures that I was unable to get to in time, I have replaced the original PR with #506, which syncs commits up to (but not including) the gateway api commits. At least we can merge this during this sprint, and next sprint we can do a further sync to include the gatewayapi changes

[Jooho]

Vedant confirmed he did e2e test on this PR and passed all except raw. He will follow up the raw e2e test issue so I am ok to merge this PR.

[openshift-ci]

@VedantMahabaleshwarkar: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-path-based-routing	3c57909	link	true	/test e2e-path-based-routing
ci/prow/e2e-predictor	3c57909	link	true	/test e2e-predictor
ci/prow/e2e-graph	3c57909	link	true	/test e2e-graph

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.