Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

Do not write schema in shuffle writting #631

Closed
zhztheplayer opened this issue Dec 14, 2021 · 0 comments
Closed

Do not write schema in shuffle writting #631

zhztheplayer opened this issue Dec 14, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@zhztheplayer
Copy link
Collaborator

zhztheplayer commented Dec 14, 2021

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Writing schema can be time consuming within large partition number. Will try remove the schema writing and retrieve schema from Spark driver.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant