-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HBASE-24831 Avoid invoke Counter using reflection in SnapshotInputFormat #2209
Conversation
🎊 +1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
with the pr we get about 7.6%/9.1% performance improve in my test case with ScanPerformanceEvaluation tools like that
with pr 1# total time to scan: 143943 ms 2# total time to scan: 145948 ms total time to scan: 149962 ms without pr 1th: 2th |
The test error seems not related |
@anoopsjohn @pankaj72981 @tedyu @Apache9 @infraio mind have a looks,thanks |
Mind explaing a bit why we do not need the reflection any more? Because we have dropped the support for some hadoop versions? |
Thanks for reply I checkout the hadoop code with branch-2.7/branch-2.8/branch-2.9/branch-3/branch-3.0/branch-3.1/branch-3.2/branch-3.3 getCounter method just has two:
the code always pass two String params to invoke so I think we can just use besides that: hadoop 2 version has been removed from hbase 3.0 in jdk11 case: We need a minimum HDFS version of 3.2.0 for HADOOP-12760 So, I think we can use getCounter(String,String) safely. If i was wrong ,please correct me ,thanks |
format the log to trigger cicd |
🎊 +1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
fix NullPointerException when using TestTableSnapshotInputFormat,something the counter is null before that, origin code using try-catch and debug log , here we using |
mind have a look @anoopsjohn thanks |
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
done |
…mat (#2209) Signed-off-by: Duo Zhang <zhangduo@apache.org>
…mat (#2209) Signed-off-by: Duo Zhang <zhangduo@apache.org>
…mat (apache#2209) Signed-off-by: Duo Zhang <zhangduo@apache.org>
Avoid invoke Counter using reflection in SnapshotInputFormat