Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pulsar client should be able to connect to brokers without DNS #3218

Closed
7 tasks done
sijie opened this issue Dec 19, 2018 · 10 comments
Closed
7 tasks done

Pulsar client should be able to connect to brokers without DNS #3218

sijie opened this issue Dec 19, 2018 · 10 comments
Labels
area/client lifecycle/stale type/feature The PR added a new feature or issue requested a new feature

Comments

@sijie
Copy link
Member

sijie commented Dec 19, 2018

Sometimes people doesn't have DNS for brokers. It might be good for people to specify a list of brokers as bootstrap brokers.

Since ServiceUrlProvider was introduced in #2543 , it should be trivial to add a service url provider implementation that randomly returns a chosen broker.

@sijie sijie added area/client type/feature The PR added a new feature or issue requested a new feature labels Dec 19, 2018
@sijie sijie added this to the 2.3.0 milestone Dec 19, 2018
@ivankelly
Copy link
Contributor

A subtask for this would be to make it possible to use a list of brokers in the proxy client configuration to allow proxy use without dns

sijie added a commit to sijie/pulsar that referenced this issue Dec 24, 2018
…ice url and web url

*Motivation*

Sometimes people doesn't have DNS for brokers. It might be good for people to specify a list of brokers as bootstrap brokers.

*Changes*

This PR introduce `ServiceURI` and `ServiceNameResolver` for supporting specifying multiple hosts in pulsar service url and
web url.

Master Issue: apache#3218
@sijie
Copy link
Member Author

sijie commented Jan 10, 2019

@ivankelly added the subtasks. however I removed "metadata format" and "proxy". because there is nothing to do at these two parts. If the pulsar client supports a URI with multiple hosts, both metadata format and proxy will be working. However the current most tricky part is pulsar-admin. still figuring out how to do it in jersey client.

sijie added a commit that referenced this issue Jan 13, 2019
…ice url and web url (#3249)

*Motivation*

Sometimes people doesn't have DNS for brokers. It might be good for people to specify a list of brokers as bootstrap brokers.

*Changes*

This PR introduce `ServiceURI` and `ServiceNameResolver` for supporting specifying multiple hosts in pulsar service url and
web url.

Master Issue: #3218
@ivankelly
Copy link
Contributor

however I removed "metadata format" and "proxy"

We should still test these, to ensure they do work. I would even stay we should only test these with multiple addresses, and not with single addresses, as single address is a special case of multiple.

@jiazhai
Copy link
Member

jiazhai commented Dec 2, 2019

add a sub task issue for cpp client

wolfstudy pushed a commit to apache/pulsar-client-go that referenced this issue Mar 9, 2021
Fixes #177 

Master Issue apache/pulsar#3218

### Motivation

add multiple hosts support to go client

### Modifications

- add service uri & service name resolver
- add service name resolver to lookup service & rpc client
- add unit tests
- add integration tests

### Verifying this change

- [ ] Make sure that the change passes the CI checks.
@freeznet
Copy link
Contributor

freeznet commented Mar 9, 2021

go client now support multiple hosts (ref: apache/pulsar-client-go#484)

@tisonkun
Copy link
Member

@BewareMyPower @baodi @RobertIndie could you check whether client C++ and Python implement this functionality?

@BewareMyPower
Copy link
Contributor

@tisonkun Yes, the multiple hosts feature is supported in the C++ client since #17162 and #17410.

@BewareMyPower
Copy link
Contributor

The Python client support should be ready since the first 3.0.0 release or the 2.11.0 release.

@tisonkun
Copy link
Member

OK. Then I'm closing the related issues as completed...

@tisonkun
Copy link
Member

Closed as all subtasks done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/client lifecycle/stale type/feature The PR added a new feature or issue requested a new feature
Projects
None yet
Development

No branches or pull requests

8 participants