-
Notifications
You must be signed in to change notification settings - Fork 196
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
disable sftp + delta test #2052
Conversation
✅ Deploy Preview for dlt-hub-docs canceled.
|
c0e65c7
to
ac9e6b0
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm pretty sure we reinstall arrow 17 too early. pls see my comment
@@ -118,6 +118,9 @@ jobs: | |||
- name: Install pyarrow | |||
run: poetry install --no-interaction -E duckdb -E cli -E parquet --with sentry-sdk | |||
|
|||
- name: Ensure pyarrow 15 | |||
run: poetry run pip install pyarrow==15.0.2 | |||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK! just make sure that this line:
poetry install --no-interaction -E duckdb -E cli -E parquet -E deltalake -E sql_database --with sentry-sdk,pipeline,sources
is not installing arrow 17 again. I see delta is being installed so probably that happens... maybe we should split testing of the lib
to a separate step where we install delta
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yeah good point. I think every call to poetry install has the potential to change this. I have updated the workflow not fix this, but I am not quite sure how you would set it up tbh.
e6a6feb
to
f2156d0
Compare
f2156d0
to
71931df
Compare
71931df
to
8250633
Compare
Description
The lancedb PR last week broke our CI. Fixes done here are: