[serve] Cherry-pick queue length deadline configuration changes#42176

Merged

can-anyscale merged 2 commits intoray-project:releases/2.9.1from edoakes:cp-queue-len-config

Jan 5, 2024

+125-12

Commits on Jan 4, 2024

[serve] Enable setting queue length response deadline via environment variable (ray-project#42001 )
edoakes
committed
[serve] Add exponential backoff for queue_len_response_deadline_s (ray-project#42041 )
edoakes
committed