Skip to content
This repository was archived by the owner on Apr 1, 2024. It is now read-only.

ISSUE-5944: PulsarIO Sink "topics-pattern" regex is not filtering inputs topics correctly #21

Closed
sijie opened this issue Dec 26, 2019 · 0 comments
Labels

Comments

@sijie
Copy link
Member

sijie commented Dec 26, 2019

Original Issue: apache#5944


Describe the bug
PulsarIO Sink "topics-pattern" regex is not working as expected

To Reproduce
We have two topics:

  1. ://public/default/topic1
  2. ://public/default/topic2

We are using the builtin influxdb connector, so check to have it installed before try to reproduce the behaviour.

Steps to reproduce the behavior:

  1. We would like to create a new sink using a regex topic-pattern that has as inputs both topic1 and topic2 and all the topics that start with the character "t" using the pattern "t.*". So, create the Sink using the following command
    pulsar-admin sinks create --tenant public --namespace default --name test-sink --sink-type influxdb --sink-config-file influxdb.yaml --topics-pattern "t.*

This is the influxdb.yaml configuration
configs: influxdbUrl: "http://localhost:8086" database: "test_db" username: "admin" password: "Oncode01" consistencyLevel: "ONE" logLevel: "NONE" retentionPolicy: "autogen" gzipEnable: true batchTimeMs: 1000 batchSize: 200

  1. I expcted to have as inputs both topic1 and topic2 but there are no topics as input
  2. If I use as topic pattern only ".*" using this command
    pulsar-admin sinks create --tenant public --namespace default --name test-sink --sink-type influxdb --sink-config-file influxdb.yaml --topics-pattern "t.* and the same influxdb.yaml configuration I have correctly topic1 and topic2 as inputs

Expected behavior
The expected behaviour is to have both topic1 and topic2 as the sink inputs.

I suspect this is a bug since I tried with many others regex pattern and no one is working. Only ".*" is working.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant