failed saving scheduler state

[simonm3]

Since upgrading (now on 2.8.2), I get this warning at the end of every pipeline:

WARNING:luigi.scheduler:Failed saving scheduler state
Traceback (most recent call last):
File "/anaconda3/lib/python3.7/site-packages/luigi/scheduler.py", line 458, in dump
with open(self._state_path, 'wb') as fobj:
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/luigi-server/s tate.pickle'
WARNING:luigi.scheduler:Failed saving scheduler state
Traceback (most recent call last):
File "/anaconda3/lib/python3.7/site-packages/luigi/scheduler.py", line 458, in dump
with open(self._state_path, 'wb') as fobj:
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/luigi-server/s tate.pickle'

[Tarrasch]

Do you have a space character in your path???

'/var/lib/luigi-server/s tate.pickle'

Generally though the state.pickle file can safely be nuked after luigi upgrades.

[simonm3]

I am not trying to save the file. It seems to be happening automatically. However the folder does not exist. Obviously I can create the path manually and all is fine. However luigi should do the makedir before it creates the file.

…

On Wed, 9 Jan 2019 at 22:32, Arash Rouhani ***@***.***> wrote: Do you have a space character in your path??? '/var/lib/luigi-server/s tate.pickle' Generally though the state.pickle file can safely be nuked after luigi upgrades. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2611 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABJN6cIs6vkvbIz0_T4EMKvHtLsv2PZXks5vBl2LgaJpZM4ZZ2Zv> .

[simonm3]

When you mentioned the space I thought maybe that was the issue so removed my "mkdirs". However the error is still there and there is no space in the actual error message - not sure where it came from!

So there should be line to create the folder if it does not exist.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If closed, you may revisit when your time allows and reopen! Thank you for your contributions.

[parlad]

I am having this issue. I am running Luigi 3.0.3 @simonm3 Did you managed to solve this issue? if yes how ?

Note: I am running Luigi on Windows Server

luigid --port 8082 2021-08-07 11:27:56,983 luigi[11272] INFO: logging configured by default settings 2021-08-07 11:27:56,983 luigi.scheduler[11272] INFO: No prior state file exists at /var/lib/luigi-server/state.pickle. Starting with empty state Traceback (most recent call last): File "C:\name\AppData\Local\Programs\Python\Python39\Scripts\luigid-script.py", line 33, in <module> sys.exit(load_entry_point('luigi==3.0.3', 'console_scripts', 'luigid')()) File "c:\name\appdata\local\programs\python\python39\lib\site-packages\luigi\cmdline.py", line 37, in luigid luigi.server.run(api_port=opts.port, address=opts.address, unix_socket=opts.unix_socket) File "c:\name\appdata\local\programs\python\python39\lib\site-packages\luigi\server.py", line 343, in run _init_api( File "c:\name\appdata\local\programs\python\python39\lib\site-packages\luigi\server.py", line 327, in _init_api server.add_sockets(api_sockets) File "c:\name\appdata\local\programs\python\python39\lib\site-packages\tornado\tcpserver.py", line 157, in add_sockets self._handlers[sock.fileno()] = add_accept_handler( File "c:\users\appdata\local\programs\python\python39\lib\site-packages\tornado\netutil.py", line 268, in add_accept_handler io_loop.add_handler(sock, accept_handler, IOLoop.READ) File "c:\name\appdata\local\programs\python\python39\lib\site-packages\tornado\platform\asyncio.py", line 79, in add_handler self.asyncio_loop.add_reader( File "c:\name\appdata\local\programs\python\python39\lib\asyncio\events.py", line 504, in add_reader raise NotImplementedError NotImplementedError

[simonm3]

This is a different problem. Probably related to this:

tornadoweb/tornado#2608