Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CI constantly fails for python_build / Python Build (Python 3.10 PyArrow latest) #1025

Closed
Tracked by #971
, #1035
...
iajoiner opened this issue Dec 18, 2022 · 2 comments
Closed
Tracked by #971
, #1035
...

CI constantly fails for python_build / Python Build (Python 3.10 PyArrow latest) #1025

iajoiner opened this issue Dec 18, 2022 · 2 comments
Labels
bug Something isn't working

Comments

@iajoiner
Copy link
Contributor

iajoiner commented Dec 18, 2022 •
edited
Loading

Environment

Delta-rs version:
Any
Binding:

Environment:

  • Cloud provider:
  • OS:
  • Other:

Bug

What happened fails for python_build / Python Build (Python 3.10 PyArrow latest) (pull_request).
What you expected to happen:
It should pass.
How to reproduce it:
Filing any trivial PR.
More details:
Here is a sample error message (from https://github.com/delta-io/delta-rs/actions/runs/3716554180/jobs/6306719741):

Run source venv/bin/activate
============================= test session starts ==============================
platform linux -- Python 3.10.9, pytest-7.2.0, pluggy-1.0.0 -- /home/runner/work/delta-rs/delta-rs/python/venv/bin/python
cachedir: .pytest_cache
rootdir: /home/runner/work/delta-rs/delta-rs/python, configfile: pyproject.toml, testpaths: tests
plugins: timeout-2.1.0, mock-3.10.0, cov-4.0.0
collecting ... collected 95 items / 6 deselected / 89 selected

tests/test_file_system_handler.py::test_file_info PASSED [ 1%]
tests/test_file_system_handler.py::test_get_file_info_selector PASSED [ 2%]
tests/test_file_system_handler.py::test_open_input_file PASSED [ 3%]
tests/test_file_system_handler.py::test_read_table PASSED [ 4%]
tests/test_file_system_handler.py::test_read_dataset PASSED [ 5%]
tests/test_file_system_handler.py::test_write_table PASSED [ 6%]
tests/test_file_system_handler.py::test_write_partitioned_dataset PASSED [ 7%]

+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++

  File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pytest/__main__.py", line 5, in <module>
    raise SystemExit(pytest.console_main())
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/config/__init__.py", line 190, in console_main
    code = main()
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/config/__init__.py", line 167, in main
    ret: Union[ExitCode, int] = config.hook.pytest_cmdline_main(
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line 317, in pytest_cmdline_main
    return wrap_session(config, _main)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line 270, in wrap_session
    session.exitstatus = doit(config, session) or 0
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line 324, in _main
    config.hook.pytest_runtestloop(session=session)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line 349, in pytest_runtestloop
    item.config.hook.pytest_runtest_protocol(item=item, nextitem=nextitem)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line [11](https://github.com/delta-io/delta-rs/actions/runs/3716554180/jobs/6306719741#step:8:12)2, in pytest_runtest_protocol
    runtestprotocol(item, nextitem=nextitem)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 131, in runtestprotocol
    reports.append(call_and_report(item, "call", log))
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 220, in call_and_report
    call = call_runtest_hook(item, when, **kwds)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 259, in call_runtest_hook
    return CallInfo.from_call(
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 339, in from_call
    result: Optional[TResult] = func()
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 260, in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 167, in pytest_runtest_call
    item.runtest()
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/python.py", line 1789, in runtest
    self.ihook.pytest_pyfunc_call(pyfuncitem=self)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/python.py", line 195, in pytest_pyfunc_call
    result = testfunction(**testargs)
  File "/home/runner/work/delta-rs/delta-rs/python/tests/test_fs.py", line 25, in test_read_files
    table = pq.read_table(f_)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pyarrow/parquet/core.py", line 2824, in read_table
    dataset = _ParquetDatasetV2(
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pyarrow/parquet/core.py", line 24[12](https://github.com/delta-io/delta-rs/actions/runs/3716554180/jobs/6306719741#step:8:13), in __init__
    [fragment], schema=schema or fragment.physical_schema,

Here is an instance of the failure with a different message(https://github.com/delta-io/delta-rs/actions/runs/3714849591/jobs/6299296889)

File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pytest/__main__.py", line 5, in <module>
    raise SystemExit(pytest.console_main())
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/config/__init__.py", line 190, in console_main
    code = main()
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/config/__init__.py", line 167, in main
    ret: Union[ExitCode, int] = config.hook.pytest_cmdline_main(
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line 317, in pytest_cmdline_main
    return wrap_session(config, _main)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line 270, in wrap_session
    session.exitstatus = doit(config, session) or 0
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line 324, in _main
    config.hook.pytest_runtestloop(session=session)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/main.py", line [34](https://github.com/delta-io/delta-rs/actions/runs/3713806411/jobs/6296904311#step:8:35)9, in pytest_runtestloop
    item.config.hook.pytest_runtest_protocol(item=item, nextitem=nextitem)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line [39](https://github.com/delta-io/delta-rs/actions/runs/3713806411/jobs/6296904311#step:8:40), in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 112, in pytest_runtest_protocol
    runtestprotocol(item, nextitem=nextitem)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 125, in runtestprotocol
    rep = call_and_report(item, "setup", log)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 220, in call_and_report
    call = call_runtest_hook(item, when, **kwds)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 259, in call_runtest_hook
    return CallInfo.from_call(
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 339, in from_call
    result: Optional[TResult] = func()
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 260, in <lambda>
    lambda: ihook(item=item, **kwds), when=when, reraise=reraise
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 155, in pytest_runtest_setup
    item.session._setupstate.setup(item)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/runner.py", line 492, in setup
    col.setup()
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/python.py", line 1792, in setup
    self._request._fillfixtures()
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/fixtures.py", line 549, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/fixtures.py", line 568, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/fixtures.py", line 590, in _get_active_fixturedef
    self._compute_fixture_value(fixturedef)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/fixtures.py", line 676, in _compute_fixture_value
    fixturedef.execute(request=subrequest)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/fixtures.py", line 1074, in execute
    result = ihook.pytest_fixture_setup(fixturedef=self, request=request)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/fixtures.py", line 1128, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/home/runner/work/delta-rs/delta-rs/python/venv/lib/python3.10/site-packages/_pytest/fixtures.py", line 900, in call_fixture_func
    fixture_result = next(generator)
  File "/home/runner/work/delta-rs/delta-rs/python/tests/conftest.py", line 114, in azurite_creds
    subprocess.run(
  File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/subprocess.py", line 505, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
  File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/subprocess.py", line 1146, in communicate
    self.wait()
  File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/subprocess.py", line 1209, in wait
    return self._wait(timeout=timeout)
  File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/subprocess.py", line 19[43](https://github.com/delta-io/delta-rs/actions/runs/3713806411/jobs/6296904311#step:8:44), in _wait
    (pid, sts) = self._try_wait(0)
  File "/opt/hostedtoolcache/Python/3.10.9/x[64](https://github.com/delta-io/delta-rs/actions/runs/3713806411/jobs/6296904311#step:8:65)/lib/python3.10/subprocess.py", line 1[90](https://github.com/delta-io/delta-rs/actions/runs/3713806411/jobs/6296904311#step:8:91)1, in _try_wait
    (pid, sts) = os.waitpid(self.pid, wait_flags)

+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
tests/test_fs.py::test_roundtrip_azure_env
@iajoiner iajoiner added the bug Something isn't working label Dec 18, 2022
@iajoiner iajoiner mentioned this issue Dec 18, 2022
Closed
11 tasks
@wjones127
Copy link
Collaborator

Sorry it's taken a while to fix this. Almost finished fixing this in #979

@iajoiner iajoiner mentioned this issue Dec 21, 2022
Closed
9 tasks
@roeap
Copy link
Collaborator

roeap commented Jan 1, 2023

fixed in #979

@roeap roeap closed this as completed Jan 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@wjones127 @iajoiner @roeap