Update `rasa-sdk` dependencies to align with those of `rasa` #592

ancalita · 2021-11-12T09:15:01Z

Description of Problem:

Installing editable version of rasa-sdk after having installed editable version of rasa in the same venv causes the bot to crash when running rasa shell, full stack trace below:

Bot loaded. Type a message and press enter (use '/stop' to exit): 
2021-11-11 13:26:28 ERROR    asyncio  - Task exception was never retrieved
future: <Task finished name='Task-6' coro=<SignalRouter._dispatch() done, defined at /Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/signals.py:102> exception=RuntimeError('this event loop is already running.') created at /Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/signals.py:165>
source_traceback: Object created at (most recent call last):
  File "/Users/ancalita/rasa-projects/rasa-oss-09/bin/rasa", line 5, in <module>
    main()
  File "/Users/ancalita/rasa-projects/rasa/rasa/__main__.py", line 121, in main
    cmdline_arguments.func(cmdline_arguments)
  File "/Users/ancalita/rasa-projects/rasa/rasa/cli/shell.py", line 125, in shell
    rasa.cli.run.run(args)
  File "/Users/ancalita/rasa-projects/rasa/rasa/cli/run.py", line 126, in run
    rasa.run(**vars(args))
  File "/Users/ancalita/rasa-projects/rasa/rasa/api.py", line 56, in run
    rasa.core.run.serve_application(
  File "/Users/ancalita/rasa-projects/rasa/rasa/core/run.py", line 221, in serve_application
    app.run(
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/app.py", line 1051, in run
    serve_single(server_settings)
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/server/runners.py", line 199, in serve_single
    serve(**server_settings)
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/server/runners.py", line 146, in serve
    loop.run_until_complete(app._server_event("init", "after"))
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/app.py", line 1496, in _server_event
    await self.dispatch(
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/signals.py", line 163, in dispatch
    return await dispatch
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/signals.py", line 133, in _dispatch
    retval = await maybe_coroutine
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/app.py", line 1382, in _listener
    await maybe_coro
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/app.py", line 1368, in dispatch_delayed_tasks
    await app.dispatch(name, context={"app": app, "loop": loop})
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/signals.py", line 165, in dispatch
    task = asyncio.get_running_loop().create_task(dispatch)
Traceback (most recent call last):
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/signals.py", line 133, in _dispatch
    retval = await maybe_coroutine
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/sanic/app.py", line 1374, in run_delayed_task
    await prepped
  File "/Users/ancalita/rasa-projects/rasa/rasa/core/run.py", line 134, in run_cmdline_io
    await console.record_messages(
  File "/Users/ancalita/rasa-projects/rasa/rasa/core/channels/console.py", line 175, in record_messages
    text = _get_user_input(previous_response)
  File "/Users/ancalita/rasa-projects/rasa/rasa/core/channels/console.py", line 108, in _get_user_input
    response = questionary.text(
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/questionary/question.py", line 50, in ask
    return self.unsafe_ask(patch_stdout)
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/questionary/question.py", line 64, in unsafe_ask
    return self.application.run()
  File "/Users/ancalita/rasa-projects/rasa-oss-09/lib/python3.8/site-packages/prompt_toolkit/application/application.py", line 890, in run
    return loop.run_until_complete(
  File "uvloop/loop.pyx", line 1450, in uvloop.loop.Loop.run_until_complete
  File "uvloop/loop.pyx", line 1443, in uvloop.loop.Loop.run_until_complete
  File "uvloop/loop.pyx", line 1351, in uvloop.loop.Loop.run_forever
  File "uvloop/loop.pyx", line 480, in uvloop.loop.Loop._run

This forum thread seems to pin the cause of this issue to the version of questionary which I noticed rasa-sdk downgrades from 1.10 to 1.8 when running make install.

Definition of Done:

questionary version in rasa-sdk is pinned to the higher version as in rasa-oss
double-check all dependencies are pinned to the higher version pinned in rasa-oss
you are able to run rasa shell without issues when both projects are installed as editable in the same venv

The text was updated successfully, but these errors were encountered:

carlad · 2022-01-06T13:08:46Z

I'm unable to replicate this issue after following the steps provided in the same virtualenv:

make install rasa
make install rasa-sdk
rasa init a new project
rasa shell
I'm wondering if this is still an issue and which version of python you were using @ancalita.

ancalita · 2022-01-10T15:31:04Z

@carlad So sorry, just saw your q on Python version, I was using python 3.8.6.
Related to the dependencies' diff: are you comparing 3.0.x or 2.8.x?

carlad · 2022-01-10T15:52:04Z

@ancalita

Related to the dependencies' diff: are you comparing 3.0.x or 2.8.x?

I'm doing both, ~~though it seems the dependencies are similar...~~

* Update documentation workflow to only publish one version per major * remove python classifiers from pyproject.toml * bump development status classifier * prepared release of version 3.0.2 * Fix a changelog entry * comform toml to rasa 3.0.x * use black 21.7b0 * pin requests to ^2.23 * support python 3.9 Co-authored-by: tczekajlo <t.czekajlo@rasa.com> Co-authored-by: m-vdb <m.verger@rasa.com>

ancalita · 2022-01-24T16:27:46Z

@carlad I'm seeing this issue again just now in a fresh venv with rasa and rasa-sdk installed via make install 🙈
questionary is version 1.10, and the project I'm using has a custom action defined and runs the actions server in a separate tab too.
When you have some time, could you please check with a similar project to see if rasa shell crashes for you too?

(oss-0122) ➜  required_slots_formvalidationaction rasa shell
2022-01-24 16:19:36 INFO     root  - Connecting to channel 'cmdline' which was specified by the '--connector' argument. Any other channels will be ignored. To connect to all given channels, omit the '--connector' argument.
2022-01-24 16:19:36 INFO     root  - Starting Rasa server on http://0.0.0.0:5005
2022-01-24 16:19:37 INFO     rasa.core.processor  - Loading model models/20220124-161441-humid-duplet.tar.gz...
2022-01-24 16:19:50 WARNING  rasa.shared.utils.common  - The UnexpecTED Intent Policy is currently experimental and might change or be removed in the future 🔬 Please share your feedback on it in the forum (https://forum.rasa.com) to help us make this feature ready for production.
2022-01-24 16:19:56 INFO     root  - Rasa server is up and running.
Bot loaded. Type a message and press enter (use '/stop' to exit): 
2022-01-24 16:19:57 ERROR    asyncio  - Task exception was never retrieved
future: <Task finished name='Task-6' coro=<SignalRouter._dispatch() done, defined at /Users/ancalita/rasa-projects/oss-0122/lib/python3.8/site-packages/sanic/signals.py:102> exception=RuntimeError('this event loop is already running.')>
Traceback (most recent call last):
  File "/Users/ancalita/rasa-projects/oss-0122/lib/python3.8/site-packages/sanic/signals.py", line 133, in _dispatch
    retval = await maybe_coroutine
  File "/Users/ancalita/rasa-projects/oss-0122/lib/python3.8/site-packages/sanic/app.py", line 1374, in run_delayed_task
    await prepped
  File "/Users/ancalita/rasa-projects/rasa/rasa/core/run.py", line 134, in run_cmdline_io
    await console.record_messages(
  File "/Users/ancalita/rasa-projects/rasa/rasa/core/channels/console.py", line 175, in record_messages
    text = _get_user_input(previous_response)
  File "/Users/ancalita/rasa-projects/rasa/rasa/core/channels/console.py", line 108, in _get_user_input
    response = questionary.text(
  File "/Users/ancalita/rasa-projects/oss-0122/lib/python3.8/site-packages/questionary/question.py", line 70, in ask
    return self.unsafe_ask(patch_stdout)
  File "/Users/ancalita/rasa-projects/oss-0122/lib/python3.8/site-packages/questionary/question.py", line 92, in unsafe_ask
    return self.application.run()
  File "/Users/ancalita/rasa-projects/oss-0122/lib/python3.8/site-packages/prompt_toolkit/application/application.py", line 890, in run
    return loop.run_until_complete(
  File "uvloop/loop.pyx", line 1450, in uvloop.loop.Loop.run_until_complete
  File "uvloop/loop.pyx", line 1443, in uvloop.loop.Loop.run_until_complete
  File "uvloop/loop.pyx", line 1351, in uvloop.loop.Loop.run_forever
  File "uvloop/loop.pyx", line 480, in uvloop.loop.Loop._run
RuntimeError: this event loop is already running.

ancalita · 2022-01-24T16:31:53Z

Could it be related to this issue: RasaHQ/rasa#10632?

carlad · 2022-01-26T16:01:52Z

So, without make installing anything, I wasn't able to replicate this working inside rasa-x-demo directory.
I was able to run rasa shell with no issues on either a rasa 2.8.x or 3.0.x virtualenv.

Rasa Version      :         2.8.15
Minimum Compatible Version: 2.8.9
Rasa SDK Version  :         2.8.2
Rasa X Version    :         1.0.1
Python Version    :         3.7.12

With rasa 3.0.x I'm also able to execute rasa shell ok.

Rasa Version      :         3.0.0
Minimum Compatible Version: 3.0.0
Rasa SDK Version  :         3.0.3
Rasa X Version    :         1.0.1
Python Version    :         3.8.6

However

After I ran make install in the rasa-sdk directory (following Anca's flow).
And then running rasa shell in rasa-x-demo I saw similar issues on 2.8.x and 3.0.x

At first I thought it was the questionary library version. There were several posts online from last year stating a rollback to v1.4.x fixed the issue. But after trying different questionary versions, settling finally on v1.8.1, I noticed that any time I ran make install in the rasa directory last, then ran rasa shell, it would launch fine. But anytime I ran make install in the rasa-sdk directory, then ran rasa shell, it would produce this error.

I've since updated questionary to v1.10.0 (i.e. using what is currently specified in the released projects) and the same behaviour happens.

So I'm thinking it's not about dependency conflicts, but about a loop process in the rasa-sdk make install task that doesn't end/close properly, but somehow gets reset when rasa is make installed .

carlad · 2022-01-28T15:12:56Z

So it turns out the issue was with the version of prompt-toolkit we were installing. Previously we had the version tied to '^2.0' in the .toml file, but I must have changed it to a range, which ended up installing the latest version (3.something).
Rolling back to '^2.0' solves the problem.

carlad · 2022-01-31T10:05:17Z

The fix now released in rasa 3.0.6

https://github.com/RasaHQ/rasa/releases/tag/3.0.6

and rasa-sdk 3.0.4

https://github.com/RasaHQ/rasa-sdk/blob/3.0.4/CHANGELOG.mdx

ancalita added type:dependencies Pull requests that update a dependency file area:rasa-sdk 🧑‍💻 Everything that touches our python Rasa SDK type:maintenance 🔧 Improvements to tooling, testing, deployments, infrastructure, code style. labels Nov 12, 2021

TyDunn added the effort:enable-squad/2 Label which is used by the Rasa Enable squad to do internal estimation of task sizes. label Dec 17, 2021

m-vdb assigned carlad Dec 20, 2021

This was referenced Jan 11, 2022

Update dependencies in 3.0 to align with rasa-sdk RasaHQ/rasa#10667

Merged

Update dependencies in 3.0.x branch to match those in rasa 3.0.x #648

Merged

Adjust dependencies in 2.8.x to conform to those in rasa 2.8.x #651

Merged

carlad mentioned this issue Jan 19, 2022

prepare release of version 3.0.5 RasaHQ/rasa#10706

Merged

This was referenced Jan 27, 2022

Use prompt_toolkit ^2.0 RasaHQ/rasa#10761

Merged

Use prompt toolkit ^2.0 #668

Merged

carlad closed this as completed Jan 31, 2022

carlad removed their assignment Jan 31, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update `rasa-sdk` dependencies to align with those of `rasa` #592

Update `rasa-sdk` dependencies to align with those of `rasa` #592

ancalita commented Nov 12, 2021 •

edited

Loading

carlad commented Jan 6, 2022 •

edited

Loading

ancalita commented Jan 10, 2022

carlad commented Jan 10, 2022 •

edited

Loading

ancalita commented Jan 24, 2022

ancalita commented Jan 24, 2022

carlad commented Jan 26, 2022 •

edited

Loading

carlad commented Jan 28, 2022

carlad commented Jan 31, 2022

Update rasa-sdk dependencies to align with those of rasa #592

Update rasa-sdk dependencies to align with those of rasa #592

Comments

ancalita commented Nov 12, 2021 • edited Loading

carlad commented Jan 6, 2022 • edited Loading

ancalita commented Jan 10, 2022

carlad commented Jan 10, 2022 • edited Loading

ancalita commented Jan 24, 2022

ancalita commented Jan 24, 2022

carlad commented Jan 26, 2022 • edited Loading

carlad commented Jan 28, 2022

carlad commented Jan 31, 2022

Update `rasa-sdk` dependencies to align with those of `rasa` #592

Update `rasa-sdk` dependencies to align with those of `rasa` #592

ancalita commented Nov 12, 2021 •

edited

Loading

carlad commented Jan 6, 2022 •

edited

Loading

carlad commented Jan 10, 2022 •

edited

Loading

carlad commented Jan 26, 2022 •

edited

Loading