You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
self._log.warn('function is not a PythonTask [%s] ', uid)
Two problems here:
The message of the get_func_attr is suppressed, and we just report a hard-coded message (we need to at least report the correct message, not the entire exception)
I tested it with a Python function with some module dependencies that were unavailable in the namespace where the function was deserialized, and I printed the exception. Something like this:
exceptExceptionase:
self._log.warn('function is not a PythonTask [%s] ', uid)
self._log.warn(e)
This is the modified output message from our raptor.worker:
1691803277.803 : master.000000.worker.0000 : 28773 : 140004894422784 : WARNING : function is not a PythonTask [task.000000]
1691803277.803 : master.000000.worker.0000 : 28773 : 140004894422784 : WARNING : No module named 'mpi_funcs'
1691803277.804 : master.000000.worker.0000 : 28777 : 139872066201344 : DEBUG : orig args: [] : {}
As you can see, the first line is what RAPTOR reported and marked this function as not PythonTask which is not correct as this task was serialized by our function serializer.
The 2nd line shows the actual error of why our serialization failed, and that is because No module named 'mpi_funcs' which my function requires during the execution.
The text was updated successfully, but these errors were encountered:
AymenFJA
changed the title
Misleading RAPTOR pyfuncs and suppressed error message.
Misleading RAPTOR message pyfuncs and suppressed error message.
Aug 14, 2023
The RAPTOR code, specifically in
radical.pilot/src/radical/pilot/raptor/worker.py
Line 358 in 9190fa3
If this line fails, our RAPTOR logger will print:
radical.pilot/src/radical/pilot/raptor/worker.py
Line 361 in 9190fa3
Two problems here:
get_func_attr
is suppressed, and we just report a hard-coded message (we need to at least report the correct message, not the entire exception)This is the modified output message from our
raptor.worker
:As you can see, the first line is what RAPTOR reported and marked this function as not
PythonTask
which is not correct as this task was serialized by our function serializer.The 2nd line shows the actual error of why our serialization failed, and that is because
No module named 'mpi_funcs'
which my function requires during the execution.The text was updated successfully, but these errors were encountered: