Run v2 e2e integration tests for Kafka

[joeyyy09]

Which problem is this PR solving?

• Resolves [Jaeger v2] Add Kafka exporter and receiver #4868

Description of the changes

• Add v2 e2e integration tests scripts for kafka
• Add v2 gh workflows for kafka

Checklist

• I have read https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
• I have signed all commits
• I have added unit tests for the new functionality
• I have run lint and test steps successfully
  • for jaeger: make lint test
  • for jaeger-ui: yarn lint and yarn test

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.65%. Comparing base (65f6cb9) to head (c4b54ee).
Report is 3 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #5782   +/-   ##
=======================================
  Coverage   96.65%   96.65%           
=======================================
  Files         342      342           
  Lines       16519    16519           
=======================================
  Hits        15966    15966           
  Misses        363      363           
  Partials      190      190           

Flag	Coverage Δ
badger_v1	8.05% <ø> (ø)
badger_v2	?
cassandra-3.x-v1	16.61% <ø> (ø)
cassandra-3.x-v2	1.74% <ø> (ø)
cassandra-4.x-v1	16.61% <ø> (ø)
cassandra-4.x-v2	1.74% <ø> (ø)
elasticsearch-6.x-v1	18.78% <ø> (ø)
elasticsearch-7.x-v1	18.84% <ø> (ø)
elasticsearch-8.x-v1	19.03% <ø> (+0.01%)	⬆️
elasticsearch-8.x-v2	1.80% <ø> (ø)
grpc_v1	9.52% <ø> (ø)
grpc_v2	7.14% <ø> (+0.01%)	⬆️
kafka	?
kafka-v1	9.74% <ø> (?)
kafka-v2	1.81% <ø> (?)
memory_v2	?
opensearch-1.x-v1	18.86% <ø> (-0.02%)	⬇️
opensearch-2.x-v1	18.89% <ø> (ø)
opensearch-2.x-v2	1.81% <ø> (ø)
unittests	95.07% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[joeyyy09]

the v2 check failed, looking into it.

[yurishkuro]

I pushed the following fix (30ceb02):

• added flags parsing to the script, to support -K and -j
• the collector with kafka did not have a query service running on 16686, which caused the test to fail.
  • made a change to cmd/jaeger/internal/integration/e2e_integration.go to allow using a different endpoint for health checking
  • changed collector startup to use "http://localhost:8888/metrics" endpoint instead

With these changes the test is now succeeding

[joeyyy09]

I pushed the following fix (30ceb02):

* added flags parsing to the script, to support `-K` and `-j`

* the collector with kafka did not have a query service running on 16686, which caused the test to fail.
  
  * made a change to cmd/jaeger/internal/integration/e2e_integration.go to allow using a different endpoint for health checking
  * changed collector startup to use `"http://localhost:8888/metrics"` endpoint instead

With these changes the test is now succeeding

Makes sense, thanks!