Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HBASE-13798 TestFromClientSide* don't close the Table (branch-2) #289

Merged
merged 2 commits into from
Jul 2, 2019

Conversation

anmolnar
Copy link
Contributor

@anmolnar anmolnar commented Jun 5, 2019

This is the branch-2 backport of master patch: 7878389

@anmolnar anmolnar changed the title HBASE-13798 TestFromClientSide* don't close the Table HBASE-13798 TestFromClientSide* don't close the Table (branch-2) Jun 5, 2019
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 150 Docker mode activated.
_ Prechecks _
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1 mvninstall 250 branch-2 passed
+1 compile 54 branch-2 passed
+1 checkstyle 73 branch-2 passed
+1 shadedjars 245 branch has no errors when building our shaded downstream artifacts.
+1 findbugs 159 branch-2 passed
+1 javadoc 31 branch-2 passed
_ Patch Compile Tests _
+1 mvninstall 225 the patch passed
+1 compile 51 the patch passed
+1 javac 51 the patch passed
-1 checkstyle 67 hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 236 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 739 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 findbugs 171 the patch passed
+1 javadoc 31 the patch passed
_ Other Tests _
-1 unit 13956 hbase-server in the patch failed.
+1 asflicense 23 The patch does not generate ASF License warnings.
16790
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/artifact/out/Dockerfile
GITHUB PR #289
Optional Tests dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux d1da0ef7d941 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /testptch/patchprocess/precommit/personality/provided.sh
git revision branch-2 / 3139db5
maven version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java 1.8.0_181
findbugs v3.1.11
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/testReport/
Max. process+thread count 4599 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/console
Powered by Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@saintstack
Copy link
Contributor

Nice cleanup @anmolnar Mind force pushing to retrigger build checks? Seems like that is how folks are doing PR re-check (asking...). The patch failed unrelated tests in hbase-server.... which must be unrelated given this just a test refactor. Thanks.

@petersomogyi
Copy link
Contributor

I started a new build now.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 31 Docker mode activated.
_ Prechecks _
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1 mvninstall 241 branch-2 passed
+1 compile 57 branch-2 passed
+1 checkstyle 72 branch-2 passed
+1 shadedjars 240 branch has no errors when building our shaded downstream artifacts.
+1 findbugs 174 branch-2 passed
+1 javadoc 34 branch-2 passed
_ Patch Compile Tests _
+1 mvninstall 228 the patch passed
+1 compile 52 the patch passed
+1 javac 52 the patch passed
-1 checkstyle 67 hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 245 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 711 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 findbugs 177 the patch passed
+1 javadoc 33 the patch passed
_ Other Tests _
+1 unit 7578 hbase-server in the patch passed.
+1 asflicense 30 The patch does not generate ASF License warnings.
10283
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/artifact/out/Dockerfile
GITHUB PR #289
Optional Tests dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 92bfd9960964 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /testptch/patchprocess/precommit/personality/provided.sh
git revision branch-2 / 8328d24
maven version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java 1.8.0_181
findbugs v3.1.11
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/artifact/out/diff-checkstyle-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/testReport/
Max. process+thread count 4108 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/console
Powered by Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@saintstack
Copy link
Contributor

Thanks @petersomogyi That worked. Let me try redoing the checks..... So I can document it and know what I'm talking about.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 30 Docker mode activated.
_ Prechecks _
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1 mvninstall 228 branch-2 passed
+1 compile 52 branch-2 passed
+1 checkstyle 69 branch-2 passed
+1 shadedjars 238 branch has no errors when building our shaded downstream artifacts.
+1 findbugs 160 branch-2 passed
+1 javadoc 33 branch-2 passed
_ Patch Compile Tests _
+1 mvninstall 233 the patch passed
+1 compile 51 the patch passed
+1 javac 51 the patch passed
-1 checkstyle 65 hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 241 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 698 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 findbugs 178 the patch passed
+1 javadoc 32 the patch passed
_ Other Tests _
-1 unit 7828 hbase-server in the patch failed.
+1 asflicense 32 The patch does not generate ASF License warnings.
10474
Reason Tests
Failed junit tests hadoop.hbase.procedure.TestProcedureManager
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/artifact/out/Dockerfile
GITHUB PR #289
Optional Tests dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux ffb55344d8f8 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /testptch/patchprocess/precommit/personality/provided.sh
git revision branch-2 / 8328d24
maven version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java 1.8.0_181
findbugs v3.1.11
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/testReport/
Max. process+thread count 4146 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/console
Powered by Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

Copy link
Contributor

@petersomogyi petersomogyi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change looks very good!
I have 2 comments, similar ones can be found in a few other test cases, but I don't think we need to modify those in this change.

long [] ts = {1000, 2000, 3000, 4000, 5000};

Table ht = TEST_UTIL.createTable(tableName, FAMILY, 5);
try (Admin admin = TEST_UTIL.getAdmin()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Apache9 mentioned on master PR that Admin shouldn't be closed. In this case I'd prefer to keep try-with-resource since that's what we have on master and original version explicitly closed admin.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the TEST_UTIL is not created per test, but is setup once only for all tests, then indeed, closing the Admin made by TEST_UTIL will mess up subsequent attempts at using admin.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@petersomogyi Sorry I missed that TEST_UTIL actually stores and maintains the Admin. It should not be closed from tests, but from your comment I cannot decide whether I change it here or just leave, because it's a backport.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can have this change like this to be consistent between master and branch-2 and fix the Admin closes in a different ticket since that is required on master as well.

if (ts[j].getTableName().equals(tables[i])) {
found = true;
break;
try (Admin admin = TEST_UTIL.getAdmin()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here, however, it wasn't closed previously.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There're also a few places in TestFromClientSide3 which missed the refactoring and not closing the Admin.

@saintstack
Copy link
Contributor

If new patch, mind addressing the checkstyle issue @anmolnar ? Thanks.

@saintstack
Copy link
Contributor

Checks run #3 shows TestProcedure failing which is not realted to changes in here. Just saying.

@anmolnar
Copy link
Contributor Author

anmolnar commented Jun 7, 2019

@saintstack Thanks, I will fix checkstyle issues.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 177 Docker mode activated.
_ Prechecks _
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1 mvninstall 313 branch-2 passed
+1 compile 66 branch-2 passed
+1 checkstyle 86 branch-2 passed
+1 shadedjars 305 branch has no errors when building our shaded downstream artifacts.
+1 findbugs 227 branch-2 passed
+1 javadoc 40 branch-2 passed
_ Patch Compile Tests _
+1 mvninstall 298 the patch passed
+1 compile 65 the patch passed
+1 javac 65 the patch passed
-1 checkstyle 83 hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 311 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 912 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 findbugs 232 the patch passed
+1 javadoc 40 the patch passed
_ Other Tests _
-1 unit 16852 hbase-server in the patch failed.
+1 asflicense 30 The patch does not generate ASF License warnings.
20429
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/artifact/out/Dockerfile
GITHUB PR #289
Optional Tests dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 848f46cdc993 4.4.0-145-generic #171-Ubuntu SMP Tue Mar 26 12:43:40 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /testptch/patchprocess/precommit/personality/provided.sh
git revision branch-2 / 6978d4a
maven version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java 1.8.0_181
findbugs v3.1.11
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/testReport/
Max. process+thread count 4450 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/console
Powered by Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@busbey
Copy link
Contributor

busbey commented Jun 21, 2019

this still active?

@anmolnar
Copy link
Contributor Author

@busbey Yes. I'm still on holiday, but will come back to this next week.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 101 Docker mode activated.
_ Prechecks _
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1 mvninstall 270 branch-2 passed
+1 compile 58 branch-2 passed
+1 checkstyle 72 branch-2 passed
+1 shadedjars 247 branch has no errors when building our shaded downstream artifacts.
+1 findbugs 172 branch-2 passed
+1 javadoc 30 branch-2 passed
_ Patch Compile Tests _
+1 mvninstall 233 the patch passed
+1 compile 56 the patch passed
+1 javac 56 the patch passed
-1 checkstyle 70 hbase-server: The patch generated 5 new + 53 unchanged - 68 fixed = 58 total (was 121)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 243 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 737 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 findbugs 179 the patch passed
+1 javadoc 34 the patch passed
_ Other Tests _
+1 unit 8135 hbase-server in the patch passed.
+1 asflicense 29 The patch does not generate ASF License warnings.
10978
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/artifact/out/Dockerfile
GITHUB PR #289
Optional Tests dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux dfdc19020138 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /testptch/patchprocess/precommit/personality/provided.sh
git revision branch-2 / e153f58
maven version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java 1.8.0_181
findbugs v3.1.11
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/artifact/out/diff-checkstyle-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/testReport/
Max. process+thread count 4443 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/console
Powered by Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@anmolnar
Copy link
Contributor Author

anmolnar commented Jul 2, 2019

@petersomogyi @busbey Most of checkstyle issues have been addressed, unit tests are green.

@petersomogyi petersomogyi merged commit 2f8ad5a into apache:branch-2 Jul 2, 2019
@anmolnar anmolnar deleted the HBASE-13798_b2 branch July 2, 2019 12:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants