Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI][Packaging] Fix conda arrow-nightlies channel #41856

Open
amoeba opened this issue May 27, 2024 · 3 comments
Open

[CI][Packaging] Fix conda arrow-nightlies channel #41856

amoeba opened this issue May 27, 2024 · 3 comments

Comments

@amoeba
Copy link
Member

amoeba commented May 27, 2024

Describe the bug, including details regarding any error messages, version, and platform.

The Conda arrow-nightlies channel is empty, which means you can't install Arrow C++ or PyArrow nightlies from it at the moment. I noticed this in CI on apache/arrow-cookbook#352. It's my understanding that the jobs that upload artifacts to this channel are running but failing, see the failing builds at http://crossbow.voltrondata.com/.

From a quick look, the failures may just be due to Azure deprecations based on this error I see in a few Azure Pipelines logs:

The CondaEnvironment@1 (Conda environment) task has been deprecated since February 13, 2019 and will soon be retired. Use the Conda CLI ('conda') directly from a bash/pwsh/script task. Please visit https://aka.ms/azdo-deprecated-tasks to learn more about deprecated tasks.

Component(s)

Continuous Integration, Packaging

@raulcd
Copy link
Member

raulcd commented May 27, 2024

This one is related: #41791
I think this will be a first step but might not fix all the issues. As we usually synchronize those jobs with the upstream arrow-cpp-feedstocks from conda-forge and we haven't updated them in a while. We can sync them on a subsequent PR too.

@amoeba
Copy link
Member Author

amoeba commented May 29, 2024

Thanks @raulcd. It looks like by "synchronize" you are referring to the files in dev/tasks/conda-recipes/.ci_support/ which do look out of date. I'll work on #41791 and can follow that up with a PR updating those after.

@amoeba
Copy link
Member Author

amoeba commented Jun 12, 2024

I made an issue (#42111) and filed a PR (#42114). I think we should merge #41883 first so the Azure jobs can run so if you want to take a look at #41883 first @raulcd that'd be great.

amoeba added a commit to apache/arrow-cookbook that referenced this issue Oct 31, 2024
Closes #348

This PR:

- Updates versions from 15.0.0 to 16.0.0
- Updates the R cookbook to pass under 16.0.0
- Updates the C++ cookbook to pass under 16.0.0
- Changes `test_cpp_cookbook.yml` to now always test against stable libarrow.
  This is a workaround for not having an up-to-date
  conda-nightlies channel, see
  apache/arrow#41856
- Adds a note in the top-level README about the status of the dev cookbooks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants