Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support creating arrow-datafusion-python conda environment #122

Closed
jdye64 opened this issue Jan 12, 2023 · 1 comment · Fixed by #124
Closed

support creating arrow-datafusion-python conda environment #122

jdye64 opened this issue Jan 12, 2023 · 1 comment · Fixed by #124
Assignees
Labels
enhancement New feature or request

Comments

@jdye64
Copy link
Contributor

jdye64 commented Jan 12, 2023

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Development in arrow-datafusion-python is currently limited to pip environments. While nothing is wrong with that lots of people use Conda these days. The problem lies in that if a developer/maintainer/user has Conda installed on their environment they cannot run maturin develop with both a Python virtual environment and Conda on the path. This confuses maturin leading to issues.

I think a simple solution is to also include an environment.yml file for Conda developers to use instead of relying on pip. This addition is easier enough and there is tooling available for generating pip requirements files from conda environment files which also means keeping those environments in sync shouldn't be an issue.

Describe the solution you'd like
Introduce an environment.yml file for creating an arrow-datafusion-python environment and supporting documentation. Bonus for maintainer documentation about keeping the pip and anaconda environment files in sync.

Describe alternatives you've considered
Open issue with Maturin to address the issue. The workaround of having conda environment seems worth it however.

Additional context
None

@jdye64 jdye64 added the enhancement New feature or request label Jan 12, 2023
@andygrove
Copy link
Member

Thanks @jdye64 this sounds like a great idea

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
2 participants