Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exception "Unknown identifier" occur when addRemoveNullableStep for Filter #383

Closed
exmy opened this issue Mar 27, 2023 · 1 comment
Closed

Comments

@exmy
Copy link

exmy commented Mar 27, 2023

Describe what's wrong

java.lang.RuntimeException: Unknown identifier: 'arrayElement(tupleElement(event,1_0),abflags_v2_1)'
0. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, int) @ 0x19c8b25a in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0xebf5655 in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
2. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>(int, FormatStringHelperImpl<std::__1::type_identity<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>::type>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) @ 0xc2dcce4 in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
3. DB::ActionsDAG::findInOutputs(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) const @ 0x14b5da53 in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
4. local_engine::SerializedPlanParser::removeNullable(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>, std::__1::shared_ptr<DB::ActionsDAG>) @ 0xc30dafc in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
5. local_engine::SerializedPlanParser::addRemoveNullableStep(DB::QueryPlan&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>) @ 0xc30d82c in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
6. local_engine::SerializedPlanParser::parseOp(substrait::Rel const&, std::__1::list<substrait::Rel const*, std::__1::allocator<substrait::Rel const*>>&) @ 0xc315d50 in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
7. local_engine::SerializedPlanParser::parseOp(substrait::Rel const&, std::__1::list<substrait::Rel const*, std::__1::allocator<substrait::Rel const*>>&) @ 0xc314fe8 in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
8. local_engine::SerializedPlanParser::parseOp(substrait::Rel const&, std::__1::list<substrait::Rel const*, std::__1::allocator<substrait::Rel const*>>&) @ 0xc314787 in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
9. local_engine::SerializedPlanParser::parse(std::__1::unique_ptr<substrait::Plan, std::__1::default_delete<substrait::Plan>>) @ 0xc3138de in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
10. local_engine::SerializedPlanParser::parse(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) @ 0xc322ebc in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so
11. Java_io_glutenproject_vectorized_ExpressionEvaluatorJniWrapper_nativeCreateKernelWithIterator @ 0xc6e98b6 in /data15/hadoop/yarn/local/usercache/xumingyong/filecache/279/libch.so

	at io.glutenproject.vectorized.ExpressionEvaluatorJniWrapper.nativeCreateKernelWithIterator(Native Method)
	at io.glutenproject.vectorized.NativeExpressionEvaluator.createKernelWithBatchIterator(NativeExpressionEvaluator.java:79)
	at io.glutenproject.backendsapi.clickhouse.CHIteratorApi.genFirstStageIterator(CHIteratorApi.scala:183)
	at io.glutenproject.execution.GlutenWholeStageColumnarRDD.compute(GlutenWholeStageColumnarRDD.scala:116)

How to reproduce
this can be easily reproduced when sql where clause contains these: event.log_extra['abflags_v2'] is not null

@exmy
Copy link
Author

exmy commented Mar 27, 2023

I will solve it soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant