[fix][broker] Update TransferShedder underloaded broker check to consider max loaded broker's msgThroughputEMA and update IsExtensibleLoadBalancerImpl check

[heesung-sn]

Motivation

Checking zero traffic is not practical to identify if a broker is too underloaded or not(when first joining the cluster). There might be some health-checking traffic, which might make the broker's traffic slightly bigger than 1 byte/s. We better consider some relative measurements to check if a broker is significantly underloaded.

Modifications

• Update TransferShedder underloaded broker check to consider max loaded broker's msgThroughputEMA
• Delete isLoadManagerExtensionEnabled(ServiceConfiguration conf) to use only isLoadManagerExtensionEnabled(PulsarService pulsar) func

Verifying this change

• Make sure that the change passes the CI checks.

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

• Dependencies (add or upgrade a dependency)
• The public API
• The schema
• The default values of configurations
• The threading model
• The binary protocol
• The REST endpoints
• The admin CLI options
• The metrics
• Anything that affects deployment

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

Matching PR in forked repository

PR in forked repository:

[Demogorgon314]

LGTM.

[dragosvictor]

LGTM!

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 85.29412% with 5 lines in your changes missing coverage. Please review.

Project coverage is 73.80%. Comparing base (bbc6224) to head (1105476).
Report is 582 commits behind head on master.

Files with missing lines	Patch %	Lines
...dbalance/extensions/scheduler/TransferShedder.java	80.00%	1 Missing and 1 partial ⚠️
...ache/pulsar/broker/namespace/NamespaceService.java	86.66%	1 Missing and 1 partial ⚠️
...n/java/org/apache/pulsar/broker/PulsarService.java	75.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #22321      +/-   ##
============================================
+ Coverage     73.57%   73.80%   +0.22%     
+ Complexity    32624    32418     -206     
============================================
  Files          1877     1885       +8     
  Lines        139502   139881     +379     
  Branches      15299    15321      +22     
============================================
+ Hits         102638   103235     +597     
+ Misses        28908    28664     -244     
- Partials       7956     7982      +26     

Flag	Coverage Δ
inttests	26.96% <50.00%> (+2.37%)	⬆️
systests	24.58% <0.00%> (+0.25%)	⬆️
unittests	73.07% <85.29%> (+0.23%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
...pache/pulsar/broker/admin/impl/NamespacesBase.java	74.63% <100.00%> (+1.55%)	⬆️
...dbalance/extensions/ExtensibleLoadManagerImpl.java	81.72% <100.00%> (+1.64%)	⬆️
...rg/apache/pulsar/broker/web/PulsarWebResource.java	64.44% <100.00%> (+0.41%)	⬆️
...n/java/org/apache/pulsar/broker/PulsarService.java	83.60% <75.00%> (+1.23%)	⬆️
...dbalance/extensions/scheduler/TransferShedder.java	81.86% <80.00%> (-1.06%)	⬇️
...ache/pulsar/broker/namespace/NamespaceService.java	73.00% <86.66%> (+0.76%)	⬆️

... and 181 files with indirect coverage changes

[heesung-sn]

Hi, @mattisonchao I saw you merged this PR , #22379. Can we also merge this too? It appears that CI is broken now?