Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

⚡️ Separate CI python deps from developer deps #43

Open
znatty22 opened this issue Jan 31, 2023 · 0 comments
Open

⚡️ Separate CI python deps from developer deps #43

znatty22 opened this issue Jan 31, 2023 · 0 comments
Assignees
Labels
devops Good for newcomers

Comments

@znatty22
Copy link
Owner

Right now all python dependencies are in one requirements.txt file - ingest library and anything needed for the python scripts run in the CI workflow. It takes about 45 sec to install everything because the ingest library has a lot of depedendencies.

Some CI jobs only need the Python deps that are required by the Python CI scripts. We should have two requirements.txt files so that we can separate the ingest developer requirements and the CI requirements. This will likely speed up the setup time for several jobs in the CI workflow

@znatty22 znatty22 added the devops Good for newcomers label Jan 31, 2023
@znatty22 znatty22 self-assigned this Jan 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant