Richer export types (parquet, avro) #412
Labels
core
A change which affects the synth core
enhancement
New feature or request
help wanted
Extra attention is needed
integration
A change which affects or introduces an integration
Required Functionality
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
With the current functionality of synth, the output artifacts are all typeless. This causes there to be a necessity for auto type derivation downstream or an explicit redeclaration of the types of all the columns.
Proposed Solution
Add support for new uris,
parquet:
,avro:
. This will allow for richer importing and exporting where the explicitly defined types are preserved.Use case
I'd like to use synth to generate data and bulk load it into a big data ecosystem (ie. Hadoop, BigQuery)
The text was updated successfully, but these errors were encountered: