Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backport "HBASE-28807 Remove some useless code and add some logs for CanaryTool" to branch-3 #6213

Closed
wants to merge 514 commits into from

Conversation

NihalJain
Copy link
Contributor

Backport #6187

CC: @1458451310

Apache9 and others added 30 commits February 28, 2024 23:12
…apache#5641)

Co-authored-by: sunhao5 <sunhao5@kingsoft.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
apache#5689)

HBASE-27949 [JDK17] Add JDK17 compilation and unit test support to nightly job
HBASE-26372 [JDK17] Jenkins build support
…(addendum) (apache#5717)

Signed-off-by: Nihal Jain <nihaljain@apache.org>
…#5709)

We see unit test failures in Jenkins that look like this:

```
java.lang.IllegalArgumentException: run queue not empty
	at org.apache.hbase.thirdparty.com.google.common.base.Preconditions.checkArgument(Preconditions.java:143)
	at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.load(ProcedureExecutor.java:332)
	at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.init(ProcedureExecutor.java:665)
	at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:132)
	at org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.restart(ProcedureTestingUtility.java:100)
	at org.apache.hadoop.hbase.master.procedure.MasterProcedureTestingUtility.restartMasterProcedureExecutor(MasterProcedureTestingUtility.java:85)
	at org.apache.hadoop.hbase.master.assignment.TestRollbackSCP.testFailAndRollback(TestRollbackSCP.java:180)
```

This isn't enough information to debug the situation. The test code in question looks reasonable
enough – it clears the object for re-use between tests. However, somewhere between
stop/clear/start we miss something. Add some toString implementations and dump the objects in the
preconditions.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
…ition (apache#5699)

When a region is in transition, it may briefly have a null ServerName in meta. The
RegionSizeCalculator calls RegionLocator.getAllRegionLocations() and does not handle the
possibility that a RegionLocation.getServerName() could be null. The ServerName is eventually
passed into an Admin call, which results in an NPE.

This has come up in other contexts. For example, taking a look at getAllRegionLocations() impl, we
have checks to ensure that we don't call null server names. We need to similarly handle the
possibility of nulls in RegionSizeCalculator.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Hui Ruan <huiruan@apache.org>
Assume a user has a series of backups: Full1, Inc2, Inc3, where a table has not changed between Full1 and Inc3, but has changed after Inc3. When restoring that table to Inc3, a log warning was outputted mentioning there was no need for a restore. This message in fact means there is no need for the incremental restore portion of the restore process.

Signed-off-by: Nihal Jain <nihaljain@apache.org>
(cherry picked from commit 102c1b6)
…he#5732)

- Fixes the way logLevel page renders in UI

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Pankaj Kumar < pankajkumar@apache.org>
…h broken pipe instead of bad auth (apache#5740)

Also change the IPC related tests to test different combinations of rpc server&client, for example, NettyRpcClient and SimpleRpcServer

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
…egistry (apache#5744)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Our objective is to remove ZooKeeper from our public interface, remaking it as an internal
concern. Connecting to a cluster via ZooKeeper quorum will be considered deprecated starting in
2.6. Our default connection mechanism will switch to via RPC in 3.0 And finally we intend to
remove the ZooKeeper connection mechanism from client-facing APIs in 4.0.

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
…3.0.0-beta-2 (apache#5697)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
…ut/Delete mutations (apache#5760)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
…segment (apache#5705)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
…nfigurable. (apache#5743)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
…ed (apache#5713)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
…s to global archived dir (apache#5756)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar < pankajkumar@apache.org>
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
…pache#5765)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
…erval (apache#5773)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2005hithlj and others added 24 commits August 2, 2024 22:38
…ntiateDeleteTracker (apache#6133)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
* Sync code as per irb 1.4.2
* Also provide option to try irb's new functionalities for colorize and autocomplete 

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Istvan Toth <stoty@apache.org>
… from output tarball (apache#6157)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
…eTransition if procedure is initialised by next Active master (apache#6129)

Added masterActiveTime as fencing token for remote procedures

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
…nalSslHandler (apache#6149)

Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
… disabled at table level (apache#6169)

- Fail fast by adding a check before even submitting a procedure
- Update test cases to assert for expected exception post this change
- Remove deprecated method mergeRegionsAsync's usage in test
- Make use of RegionInfo.getShortNameToLog instead of logging complete region info
- Update comments in procedure implementation

Signed-off-by: Duo Zhang <zhangduo@apache.org>
HBASE-28793 Update hbase-thirdparty to 4.1.8

Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Vineet Kumar Maheshwari <vineet.4008@gmail.com>
…apache#6176)

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
Reviewed-by: Vineet Kumar Maheshwari <vineet.4008@gmail.com>
…rable state for the given backup (apache#6088)

Co-authored-by: Ray Mattingly <rmattingly@hubspot.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
…lete (apache#6089)

Co-authored-by: Ray Mattingly <rmattingly@hubspot.com>
… cache. (apache#6183)

HBASE-28805: Chunked persistence of backing map for persistent bucket cache.

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
…fined order (apache#6168)

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
…ks a connection to ZooKeeper (apache#6147)

Co-authored-by: rodenli <rodenli@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
…pache#6196)

Bumps [cryptography](https://github.com/pyca/cryptography) from 42.0.4 to 43.0.1.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](pyca/cryptography@42.0.4...43.0.1)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
…procedure.jsp while Master is initializing (apache#6152)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
…#6076)

Co-authored-by: Evie Boland <eboland@hubspot.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
…ame of the datanode (apache#6148)

Co-authored-by: wangxin <wangxin9702@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Reviewed-by: Vineet Kumar Maheshwari <vineet.4008@gmail.com>
Reviewed-by: guluo <lupeng_nwpu@qq.com>
…apache#6187)

Co-authored-by: wangxin <wangxin9702@gmail.com>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
(cherry picked from commit b161ad5)
@NihalJain NihalJain added the backport This PR is a back port of some issue or issues already committed to master label Sep 6, 2024
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ patch 0m 5s #6213 does not apply to master. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR #6213
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6213/1/console
versions git=2.17.1
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ patch 0m 7s #6213 does not apply to master. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR #6213
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6213/1/console
versions git=2.25.1
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@NihalJain NihalJain changed the base branch from master to branch-3 September 6, 2024 14:02
@NihalJain
Copy link
Contributor Author

Will reopen as another PR. closing without commit.!

@NihalJain NihalJain closed this Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport This PR is a back port of some issue or issues already committed to master
Projects
None yet
Development

Successfully merging this pull request may close these issues.