Releases: data-tools/big-data-types
Releases · data-tools/big-data-types
v0.3.0 - Conversion between modules
Big Data Types v0.3.0
- Spark: Added reverse conversion (From Spark schemas to generic SqlTypes)
- Added SqlDouble as a new type in
Core
andSpark
. (BigQuery does not have Doubles) - Added a new Type Class for conversions using instances in
Core
andBigQuery
- BigQuery: Now it accepts Spark schemas or anything implementing SqlTypeConversion as input
- New Examples module for cross types tests
Multiple Projects
Big Data Types v0.2.1
- Project split into multiple projects
- core
- bigquery
- spark
v0.1.1
Big Data Types v0.1.1
- Spark: Added SparkSchemas as a public interface for conversions.
- Spark: SparkSchemas accepts multiple case classes when generating schemas
- Core: Formats refactored, variables and class names have changed
Spark Schemas
- Spark: Added support for Spark Schemas (only Spark 2.12)
BigQuery - TypeClass for Case Classes instances
- BigQuery: TypeClass syntax for case classes instances.
Key field transformations
- BigQuery: JavaConverters for cross-version builds
- BigQuery: Formats object that allows different keys transformation like CamelCase -> snake_case for fields
v0.0.5
- Cross versions configuration
- Support for Scala 2.12
v0.0.4
- Cross versions configuration
- Support for Scala 2.12 added
v0.0.3
Sonatype plugin for releases
v0.0.2
First stable release.
Support for:
- Basic types conversions into Sql Generic types
- BigQuery Schema creations and types to field conversions
- BigQuery Create tables
- BigQuery time partitioned tables