[improve][ci] Split Pulsar IO unit test job to multiple jobs

[lhotari]

Motivation

• the tests in Pulsar IO are extremely slow and could cause the current 75 minute limit to exceed.
• elastic-search tests are the slowest Pulsar IO tests
  • Elasticsearch tests took over 12 minutes here: https://ge.apache.org/s/ge3kvi7torsxq/performance/execution#goal-mlju2z5u77bvw
  • Also seen here: https://ge.apache.org/s/ge3kvi7torsxq/tests/overview
• Kafka Connect Adaptor & Debezium tests are another set of slow tests

Modifications

• add new maven profile pulsar-io-elastic-tests that can be used to target Elasticsearch tests
• run Elasticsearch tests in a separate build job
• add new maven profile pulsar-io-kafka-connect-tests that can be used to target Kafka Connect related tests
• run Kafka Connect adaptor tests in a separate build job

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

I am intentionally splitting Pulsar IO ES and Kafka to separate jobs. Reasons are in comments.

[lhotari]

Kafka Connect tests took 17 minutes 28 seconds here: https://github.com/apache/pulsar/actions/runs/5077621849/jobs/9121399847
Elastic Search tests took 16 minutes 24 seconds:
https://github.com/apache/pulsar/actions/runs/5077621849/jobs/9121399712

That is a lot of time spent in those tests.

[lhotari]

breakdown

https://github.com/apache/pulsar/actions/runs/5077621849/jobs/9121399847#step:10:2131

  [INFO] Pulsar ............................................. SUCCESS [  6.586 s]
  [INFO] Pulsar IO :: Parent ................................ SUCCESS [  2.573 s]
  [INFO] Pulsar IO :: IO .................................... SUCCESS [ 18.234 s]
  [INFO] Pulsar IO :: IO Common ............................. SUCCESS [  4.159 s]
  [INFO] Pulsar IO :: Kafka ................................. SUCCESS [03:42 min]
  [INFO] Pulsar IO :: Kafka Connect Adaptor ................. SUCCESS [06:34 min]
  [INFO] Pulsar IO :: Kafka Connect Adaptor NAR ............. SUCCESS [ 42.596 s]
  [INFO] Pulsar IO :: Debezium .............................. SUCCESS [  0.216 s]
  [INFO] Pulsar IO :: Debezium :: Core ...................... SUCCESS [ 55.757 s]
  [INFO] Pulsar IO :: Debezium :: mysql ..................... SUCCESS [01:29 min]
  [INFO] Pulsar IO :: Debezium :: postgres .................. SUCCESS [  6.676 s]
  [INFO] Pulsar IO :: Debezium :: mongodb ................... SUCCESS [01:01 min]
  [INFO] Pulsar IO :: Debezium :: oracle .................... SUCCESS [01:15 min]
  [INFO] Pulsar IO :: Debezium :: Microsoft SQL ............. SUCCESS [ 59.784 s]
  [INFO] ------------------------------------------------------------------------
  [INFO] BUILD SUCCESS
  [INFO] ------------------------------------------------------------------------
  [INFO] Total time:  17:23 min

https://github.com/apache/pulsar/actions/runs/5077621849/jobs/9121399712#step:10:778

  [INFO] Pulsar ............................................. SUCCESS [  5.833 s]
  [INFO] Pulsar IO :: Parent ................................ SUCCESS [  2.154 s]
  [INFO] Pulsar IO :: IO .................................... SUCCESS [ 18.579 s]
  [INFO] Pulsar IO :: IO Common ............................. SUCCESS [  4.151 s]
  [INFO] Pulsar IO :: ElasticSearch ......................... SUCCESS [15:42 min]
  [INFO] ------------------------------------------------------------------------
  [INFO] BUILD SUCCESS
  [INFO] ------------------------------------------------------------------------
  [INFO] Total time:  16:17 min