Skip to content

Releases: data-tools/big-data-types

v0.3.0 - Conversion between modules

24 Feb 17:37
2c8cd56
Compare
Choose a tag to compare

Big Data Types v0.3.0

  • Spark: Added reverse conversion (From Spark schemas to generic SqlTypes)
  • Added SqlDouble as a new type in Core and Spark. (BigQuery does not have Doubles)
  • Added a new Type Class for conversions using instances in Core and BigQuery
  • BigQuery: Now it accepts Spark schemas or anything implementing SqlTypeConversion as input
  • New Examples module for cross types tests

Multiple Projects

17 Jan 11:38
533361f
Compare
Choose a tag to compare

Big Data Types v0.2.1

  • Project split into multiple projects
    • core
    • bigquery
    • spark

v0.1.1

14 Jan 20:01
ee528e8
Compare
Choose a tag to compare

Big Data Types v0.1.1

  • Spark: Added SparkSchemas as a public interface for conversions.
  • Spark: SparkSchemas accepts multiple case classes when generating schemas
  • Core: Formats refactored, variables and class names have changed

Spark Schemas

09 Jan 07:42
3043e2b
Compare
Choose a tag to compare
  • Spark: Added support for Spark Schemas (only Spark 2.12)

BigQuery - TypeClass for Case Classes instances

31 Dec 09:54
8691f3c
Compare
Choose a tag to compare
  • BigQuery: TypeClass syntax for case classes instances.

Key field transformations

29 Dec 12:29
562a6b4
Compare
Choose a tag to compare
  • BigQuery: JavaConverters for cross-version builds
  • BigQuery: Formats object that allows different keys transformation like CamelCase -> snake_case for fields

v0.0.5

26 Dec 15:10
Compare
Choose a tag to compare
  • Cross versions configuration
  • Support for Scala 2.12

v0.0.4

26 Dec 13:11
fa04117
Compare
Choose a tag to compare
  • Cross versions configuration
  • Support for Scala 2.12 added

v0.0.3

24 Dec 15:22
Compare
Choose a tag to compare

Sonatype plugin for releases

v0.0.2

23 Dec 22:42
Compare
Choose a tag to compare

First stable release.
Support for:

  • Basic types conversions into Sql Generic types
  • BigQuery Schema creations and types to field conversions
  • BigQuery Create tables
  • BigQuery time partitioned tables