Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Apache Beam >= 2.44.0 #5430

Closed
albertvillanova opened this issue Jan 17, 2023 · 1 comment · Fixed by #6283
Closed

Support Apache Beam >= 2.44.0 #5430

albertvillanova opened this issue Jan 17, 2023 · 1 comment · Fixed by #6283
Assignees
@albertvillanova
Labels
enhancement New feature or request

Comments

@albertvillanova
Copy link
Member

Once we find out the root cause of:

we should revert the temporary pin on apache-beam introduced by:
@albertvillanova albertvillanova added the enhancement New feature or request label Jan 17, 2023
@albertvillanova albertvillanova self-assigned this Jan 17, 2023
@albertvillanova
Copy link
Member Author

Some of the shard files now have 0 number of rows.

We have opened an issue in the Apache Beam repo:

@severo severo mentioned this issue Mar 28, 2023
Merged
@mariosasko mariosasko mentioned this issue Jan 31, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@albertvillanova albertvillanova

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix array cast/embed with null values huggingface/datasets
1 participant
@albertvillanova