Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] can't load parquet file with column name case sensitive with Doris column #9351

Closed
2 of 3 tasks
dataalive opened this issue May 3, 2022 · 0 comments · Fixed by #9358
Closed
2 of 3 tasks

[Bug] can't load parquet file with column name case sensitive with Doris column #9351

dataalive opened this issue May 3, 2022 · 0 comments · Fixed by #9358
Labels
usercase Important user case type label

Comments

@dataalive
Copy link
Contributor

dataalive commented May 3, 2022

Search before asking

  • I had searched in the issues and found no similar issues.

Version

1.0.0-rc03

What's Wrong?

doris table

CREATE TABLE `record` (
 `id` varchar(50) NOT NULL ,
 `energySerial` varchar(3) NULL 
) ENGINE=OLAP
UNIQUE KEY(`id`)
DISTRIBUTED BY HASH(`id`) BUCKETS 10;
LOAD LABEL test.record_20220502
( 
 DATA INFILE ("hdfs://172.0.0.9/tmp/part0.parq")
 INTO TABLE record format as parquet ( id,energyserial) 
 SET
 ( 
 id = id, 
energySerial = energyserial
 )
) WITH BROKER 'Broker_Doris' ( "username" = "hadoop" );

to show the key difference more clearly in sample above,

energySerial.toLowerCase() = energyserial

we get an load error msg like

unknown reference column, column=energySerial, reference=energyserial 

we can't load that parquet column to doris

What You Expected?

it could works

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

deardeng added a commit to deardeng/incubator-doris that referenced this issue May 3, 2022
deardeng pushed a commit to deardeng/incubator-doris that referenced this issue May 7, 2022
deardeng pushed a commit to deardeng/incubator-doris that referenced this issue May 7, 2022
deardeng added a commit to deardeng/incubator-doris that referenced this issue May 9, 2022
@lide-reed lide-reed added the usercase Important user case type label label May 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
usercase Important user case type label
Projects
None yet
2 participants