Skip to content

PARQUET-12: Add format support for additional converted types.#3

Closed
jacques-n wants to merge 2 commits intoapache:masterfrom
jacques-n:PARQUET-12
Closed

PARQUET-12: Add format support for additional converted types.#3
jacques-n wants to merge 2 commits intoapache:masterfrom
jacques-n:PARQUET-12

Conversation

@jacques-n
Copy link
Contributor

No description provided.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is time always relative to midnight UTC, or is it based on the current timezone?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Time is disconnected from any timezone given that it is without a date context.

@julienledem
Copy link
Member

This looks good to me.
@nongli and @rdblue could you comment? This has been opened for a long time and we should converge.

@julienledem
Copy link
Member

+1 LGTM. I'll merge it later this week unless @nongli or @rdblue have other comments.
@rdblue feel free to merge it yourself.

@rdblue
Copy link
Contributor

rdblue commented Jul 29, 2014

Looks good to me. I'll merge tomorrow.

@nongli
Copy link
Contributor

nongli commented Jul 29, 2014

+1. Thanks Jacques!

@asfgit asfgit closed this in 090444c Jul 30, 2014
asfgit pushed a commit that referenced this pull request Aug 7, 2014
This adds the new logical types from #3 to the LogicalTypes.md specification.

Author: Ryan Blue <rblue@cloudera.com>

Closes #5 from rdblue/PARQUET-12-add-new-type-docs and squashes the following commits:

be414fe [Ryan Blue] PARQUET-12: Add specs for new logical types.
dvryaboy pushed a commit to dvryaboy/incubator-parquet-format that referenced this pull request Aug 24, 2014
Original from the old repo: Parquet/parquet-mr#410
JIRA: https://issues.apache.org/jira/browse/PARQUET-2

These changes allow primitive types to be requested as different types than what is stored in the file format using a flag to turn off strict type checking (default is on). Types are cast to the requested type where possible and will suffer precision loss for casting where necessary (e.g. requesting a double as an int).

No performance penalty is imposed for using the type defined in the file type.  A flag exists to

A 6x6 test case is provided to test conversion between the primitive types.

Author: Daniel Weeks <dweeks@netflix.com>

Closes apache#3 from dcw-netflix/type-persuasion and squashes the following commits:

97f4e9a [Daniel Weeks] Added documentation as suggested by code review
1c3c0c7 [Daniel Weeks] Fixed test with strict checking off
f3cb495 [Daniel Weeks] Added type persuasion for primitive types with a flag to control strict type checking for conflicting schemas, which is strict by default.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants