HBASE-28679 Upgrade yetus to a newer version #6012

Apache9 · 2024-06-21T07:22:51Z

No description provided.

Apache9 · 2024-06-21T07:30:24Z

For pre commit, see

For Nightly build, see

https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-28679/3/

Apache-HBase · 2024-06-21T07:36:17Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console in case of problems.

Apache-HBase · 2024-06-21T07:36:29Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console in case of problems.

Apache-HBase · 2024-06-21T07:36:40Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console in case of problems.

Apache-HBase · 2024-06-21T07:36:40Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console in case of problems.

Apache-HBase · 2024-06-21T07:37:13Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 40s		Docker mode activated.
-0 ⚠️	yetus	0m 3s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-list --blanks-tabs-ignore-list --quick-hadoopcheck
			_ Prechecks _
			_ master Compile Tests _
+0 🆗	mvndep	0m 11s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 5s		Maven dependency ordering for patch
			_ Other Tests _
		1m 42s

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#6012
Optional Tests
uname	Linux 0da7b3a38c49 5.4.0-177-generic #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `99f296a`
Max. process+thread count	33 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console
versions	git=2.34.1 maven=3.8.6
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-06-21T07:37:52Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 40s		Docker mode activated.
-0 ⚠️	yetus	0m 2s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-list --blanks-tabs-ignore-list --quick-hadoopcheck
			_ Prechecks _
			_ master Compile Tests _
+0 🆗	mvndep	0m 28s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 4s		Maven dependency ordering for patch
			_ Other Tests _
		2m 10s

Subsystem	Report/Notes
Docker	ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR	#6012
Optional Tests
uname	Linux 3cc43f19be2a 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `99f296a`
Max. process+thread count	43 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console
versions	git=2.34.1 maven=3.8.6
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-06-21T07:39:29Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 41s		Docker mode activated.
-0 ⚠️	yetus	0m 2s		Unprocessed flag(s): --blanks-eol-ignore-list --blanks-tabs-ignore-list
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ master Compile Tests _
+0 🆗	mvndep	0m 27s		Maven dependency ordering for branch
+1 💚	spotless	0m 45s		branch has no errors when running spotless:check.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 4s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	hadolint	0m 0s		No new issues.
+1 💚	shellcheck	0m 1s		No new issues.
+1 💚	spotless	0m 42s		patch has no errors when running spotless:check.
			_ Other Tests _
+0 🆗	asflicense	0m 0s		ASF License check generated no output?
		3m 49s

Subsystem	Report/Notes
Docker	ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#6012
Optional Tests	dupname asflicense codespell detsecrets hadolint shellcheck shelldocs spotless
uname	Linux 92e7b853bf9a 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `99f296a`
Max. process+thread count	44 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console
versions	git=2.34.1 maven=3.8.6 hadolint=2.10.0 shellcheck=0.8.0
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-06-21T07:40:30Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	3m 51s		Docker mode activated.
-0 ⚠️	yetus	0m 3s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-list --blanks-tabs-ignore-list --quick-hadoopcheck
			_ Prechecks _
			_ master Compile Tests _
+0 🆗	mvndep	0m 9s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 4s		Maven dependency ordering for patch
			_ Other Tests _
		4m 52s

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#6012
Optional Tests
uname	Linux 61f65f92b495 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 14:29:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `99f296a`
Max. process+thread count	36 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6012/1/console
versions	git=2.34.1 maven=3.8.6
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

ndimiduk · 2024-06-21T13:55:37Z

dev-support/Jenkinsfile

    // output from surefire; sadly the archive function in yetus only works on file names.
    ARCHIVE_PATTERN_LIST = 'TEST-*.xml,org.apache.h*.txt,*.dumpstream,*.dump'
    // These tests currently have known failures. Once they burn down to 0, remove from here so that new problems will cause a failure.
-    TESTS_FILTER = 'cc,checkstyle,javac,javadoc,pylint,shellcheck,whitespace,perlcritic,ruby-lint,rubocop,mvnsite'
+    TESTS_FILTER = 'checkstyle,javac,javadoc,pylint,shellcheck,shelldocs,blanks,perlcritic,ruby-lint,rubocop'


we have C code in the repository?

We do have some c code in hbase-example...

ndimiduk · 2024-06-21T13:56:40Z

dev-support/Jenkinsfile_GitHub

@@ -102,11 +104,11 @@ pipeline {
                            checkout scm
                        }
                        dir("${YETUSDIR}") {
-                            checkout([
-                              $class           : 'GitSCM',
-                              branches         : [[name: "${YETUS_VERSION}"]],


IIRC, this previous behavior was so that we could test with upstream yetus feature branch if need be. Maybe unrealistic...

We have a special option for nightly job, for using the newest yetus code.

I think later we could introduce the same logic for pre commit.

ndimiduk · 2024-06-21T13:57:50Z

dev-support/Jenkinsfile_GitHub

-			allOf {
-                            // this will return true if the pipeline is building a change request, such as a GitHub pull request.
-                            changeRequest()
-                            expression { env.CHANGE_TARGET in ['master', 'branch-3'] }


Should be when in [master, branch-3, branch-2] ?

Will change this part later in HBASE-28678. We still have some problem for jdk17 builds, for example, we do not unstash the result later so on the final jira report we missed the jdk 17 line...

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org> (cherry picked from commit 17ce7c3)

HBASE-28679 Upgrade yetus to a newer version

99f296a

Apache9 requested a review from ndimiduk June 21, 2024 07:22

Apache9 self-assigned this Jun 21, 2024

ndimiduk approved these changes Jun 21, 2024

View reviewed changes

Apache9 merged commit 17ce7c3 into master Jun 22, 2024
1 check passed

Apache9 added a commit that referenced this pull request Jun 22, 2024

HBASE-28679 Upgrade yetus to a newer version (#6012)

014fc51

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org> (cherry picked from commit 17ce7c3)

Apache9 added a commit that referenced this pull request Jun 22, 2024

HBASE-28679 Upgrade yetus to a newer version (#6012)

5b72290

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org> (cherry picked from commit 17ce7c3)

Apache9 deleted the HBASE-28679 branch June 22, 2024 02:38

Apache9 added a commit that referenced this pull request Jun 22, 2024

HBASE-28679 Upgrade yetus to a newer version (#6012)

6f93e93

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org> (cherry picked from commit 17ce7c3)

Apache9 added a commit that referenced this pull request Jun 22, 2024

HBASE-28679 Upgrade yetus to a newer version (#6012)

265dcb4

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org> (cherry picked from commit 17ce7c3)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HBASE-28679 Upgrade yetus to a newer version #6012

HBASE-28679 Upgrade yetus to a newer version #6012

Apache9 commented Jun 21, 2024

Apache9 commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

ndimiduk Jun 21, 2024

Apache9 Jun 21, 2024

ndimiduk Jun 21, 2024

Apache9 Jun 21, 2024

ndimiduk Jun 21, 2024

Apache9 Jun 21, 2024

HBASE-28679 Upgrade yetus to a newer version #6012

HBASE-28679 Upgrade yetus to a newer version #6012

Conversation

Apache9 commented Jun 21, 2024

Apache9 commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

Apache-HBase commented Jun 21, 2024

ndimiduk Jun 21, 2024

Choose a reason for hiding this comment

Apache9 Jun 21, 2024

Choose a reason for hiding this comment

ndimiduk Jun 21, 2024

Choose a reason for hiding this comment

Apache9 Jun 21, 2024

Choose a reason for hiding this comment

ndimiduk Jun 21, 2024

Choose a reason for hiding this comment

Apache9 Jun 21, 2024

Choose a reason for hiding this comment