Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NSQLookupd support for nsq_consumer is broken in 1.9.0/1.9.1 #5208

Closed
ljagiello opened this issue Jan 2, 2019 · 4 comments
Closed

NSQLookupd support for nsq_consumer is broken in 1.9.0/1.9.1 #5208

ljagiello opened this issue Jan 2, 2019 · 4 comments
Assignees
Labels
bug unexpected problem or unintended behavior regression something that used to work, but is now broken

Comments

@ljagiello
Copy link
Contributor

Relevant telegraf.conf:

[agent]
  interval = "10s"
  round_interval = true
  metric_batch_size = 1000
  metric_buffer_limit = 10000
  collection_jitter = "0s"
  flush_interval = "10s"
  flush_jitter = "10s"
  precision = ""
  debug = false
  quiet = false
  logfile = ""
  hostname = ""
  omit_hostname = false

# Read NSQ topic for metrics.
[[inputs.nsq_consumer]]
  ## An string representing the NSQD TCP/NSQLookupd HTTP Endpoints
  nsqlookupd = ["nsqlookupd1.ops:4161","nsqlookupd2.ops:4161"]
  topic = "telegraf-dev"
  channel = "consumer"
  max_in_flight = 100

  ## Data format to consume.
  ## Each data format has its own unique set of configuration options, read
  ## more about them here:
  ## https://github.com/influxdata/telegraf/blob/master/docs/DATA_FORMATS_INPUT.md
  data_format = "influx"

System info:

Official docker image 1.9.0 / 1.9.1

Steps to reproduce:

  1. Run nsq_consumer with nsqlookupd (and multiple nsqd behind)
  2. Telegraf will connect only to a single nsqd

Expected behavior:

Telegraf should fetch messages from all nsqd behind nsqlookupd.

Actual behavior:

Telegraf connects only to a single nsqd.

Additional info:

The only change between working version and broken is: #4938

@ljagiello ljagiello changed the title NSQLookupd support for nsq_consumer broken in 1.9.0/1.9.1 NSQLookupd support for nsq_consumer is broken in 1.9.0/1.9.1 Jan 2, 2019
@danielnelson danielnelson self-assigned this Jan 2, 2019
@danielnelson danielnelson added this to the 1.11.0 milestone Apr 23, 2019
@danielnelson danielnelson added bug unexpected problem or unintended behavior regression something that used to work, but is now broken labels Apr 23, 2019
@danielnelson danielnelson modified the milestones: 1.11.0, 1.12.0 May 24, 2019
@russorat russorat modified the milestones: 1.12.0, 1.13.0 Aug 12, 2019
@sjwang90 sjwang90 added the ready label Oct 24, 2019
@sjwang90 sjwang90 modified the milestones: 1.13.0, 1.14.0 Nov 15, 2019
@ssoroka
Copy link
Contributor

ssoroka commented Mar 10, 2020

You don't happen to have a docker-compose environment using the setup you describe that I could use to test against, do you? I'm having problems replicating the same conditions you're seeing.

@danielnelson danielnelson modified the milestones: 1.14.0, 1.15.0 Mar 13, 2020
@danielnelson danielnelson modified the milestones: 1.15.0, planned Mar 27, 2020
@sjwang90
Copy link
Contributor

sjwang90 commented Nov 2, 2020

@ljagiello can you respond to the above comment or provide any updates to this issue? thanks!

@ljagiello
Copy link
Contributor Author

Hi @sjwang90, I don't use telegraf anymore and I'm not sure how complicated would be to replicate this bug with docker-compose, but I can provide an update in few days.

@ljagiello
Copy link
Contributor Author

@ssoroka @sjwang90 I've tried to replicate environment based on what I remember with docker composer but I was unable to generate the same issue. Because I don't use telegraf, I don't have access to that environment and I'm unable to replicate this issue I will close this ticket.

Thank you so much for checking here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug unexpected problem or unintended behavior regression something that used to work, but is now broken
Projects
None yet
Development

No branches or pull requests

5 participants