-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Closed
Description
I hit the following error when apply a filter predicate on a column with PrimitiveType = INT32 & OriginalType equal to INT_8.
java.lang.IllegalArgumentException: FilterPredicate column: c's declared type (java.lang.Integer) does not match the schema found in file metadata. Column c is of type: FullTypeDescriptor(PrimitiveType: INT32, OriginalType: INT_8)
Valid types for this column are: null
at parquet.filter2.predicate.ValidTypeMap.assertTypeValid(ValidTypeMap.java:114)
Reporter: Low Chin Wei
Assignee: Alex Levenson / @isnotinvain
Related issues:
- Release Parquet 1.8.0 (blocks)
- Add DATE mapping in ValidTypeMap of filter2 (is duplicated by)
- Parquet shouldn't fail when pushing down predicates over a column whose underlying Parquet type is an ENUM (is related to)
PRs and other links:
Note: This issue was originally created as PARQUET-201. Please see the migration documentation for further details.