Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Delta Lake #95

Merged
merged 12 commits into from
Apr 5, 2022
Merged

Add support for Delta Lake #95

merged 12 commits into from
Apr 5, 2022

Conversation

xiaoyongzhu
Copy link
Member

@xiaoyongzhu xiaoyongzhu commented Mar 28, 2022

Goal of this PR is to provide support for Delta Lake.

Currently one of the test will fail (reading the delta lake result from Azure Synapse) due to an error on the underlying library. (tracked here: delta-io/delta-rs#582)

@xiaoyongzhu xiaoyongzhu requested review from jaymo001 and hangfei March 28, 2022 19:24
feathr_project/feathr/_synapse_submission.py Outdated Show resolved Hide resolved
feathr_project/feathr/_synapse_submission.py Show resolved Hide resolved
feathr_project/feathr/job_utils.py Outdated Show resolved Hide resolved
feathr_project/feathr/job_utils.py Outdated Show resolved Hide resolved
@xiaoyongzhu xiaoyongzhu requested review from jaymo001 and hangfei April 3, 2022 06:12
jaymo001
jaymo001 previously approved these changes Apr 5, 2022
@xiaoyongzhu xiaoyongzhu merged commit f2cea49 into main Apr 5, 2022
@xiaoyongzhu xiaoyongzhu deleted the delta_table branch April 5, 2022 03:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants