ChatFeed tests are a bit flaky

[ahuang11]

Noting it down from #5875

FAILED panel/tests/chat/test_feed.py::TestChatFeed::test_send_with_respond - TimeoutError: wait_until timed out in 5000 milliseconds
FAILED panel/tests/chat/test_feed.py::TestChatFeedCallback::test_yield_chat_message_stream[None-None] - TimeoutError: wait_until timed out in 5000 milliseconds
FAILED panel/tests/chat/test_feed.py::TestChatFeedCallback::test_yield_chat_message_stream[C-Bob] - TimeoutError: wait_until timed out in 5000 milliseconds

[hoxbro]

Also some here https://github.com/holoviz/panel/actions/runs/6877056029/job/18703963441?pr=5866

FAILED panel/tests/chat/test_feed.py::TestChatFeed::test_respond_callback_returns_none - AssertionError: assert 'Testing!' == 'Mutated'
  - Mutated
  + Testing!
FAILED panel/tests/chat/test_feed.py::TestChatFeedCallback::test_return_chat_message[C-Bob] - TimeoutError: wait_until timed out in 5000 milliseconds
FAILED panel/tests/chat/test_feed.py::TestChatFeedCallback::test_yield - TimeoutError: wait_until timed out in 5000 milliseconds
FAILED panel/tests/chat/test_feed.py::TestChatFeedCallback::test_callback_exception_raise - Failed: DID NOT RAISE <class 'ZeroDivisionError'>
FAILED panel/tests/io/test_cache.py::test_per_session_cache - ValueError: Callback functions must have signature func(session_context), got func(session_context=None)

[ahuang11]

I wonder if we can just make timeout mseconds to 10000?

[ahuang11]

If I had to take a guess, I suspect it's this that makes it flake:
https://github.com/holoviz/panel/blob/main/panel/chat/feed.py#L437-L439
https://github.com/holoviz/panel/blob/main/panel/chat/feed.py#L416-L418

[hoxbro]

I wonder if we can just make timeout mseconds to 10000?

It shouldn't take 5 seconds for a chat message to be updated. I think something is not being triggered, if that is the case, we will see the same thing when changing it to 10 seconds.

Running pytest panel/tests/chat -n logical --dist loadgroup:

I sometimes get this problem:
task: <Task pending name='Task-4' coro=<ChatFeed._prepare_response() running at /home/shh/Repos/holoviz/panel/panel/chat/feed.py:438> wait_for=<Future pending cb=[Task.task_wakeup()]> cb=[IOLoop.add_future.<locals>.<lambda>() at /home/shh/miniconda3/envs/holoviz/lib/python3.11/site-packages/tornado/ioloop.py:685]>

[ahuang11]

I think this should be fixed now so closing. Please re-open if not the case.