Was topics.regex available before?

[abhishekgahlot2]

I saw topics.regex used by someone before in existing issues. wondering if it was available before or removed? I want to try to use it.

I think here

// TODO: check Kafka Connect's topics name or topics regex config and
            // only add tables to in-memory mapping that matches the topics we consume.
            for (Table table : tableList) {
                mapping.put(table.getName(), table);
            }

[Paultagoras]

It should still be an option - have you run into an issue with it?

[Paultagoras]

And what sort of behavior are you seeing - no data is showing up to ANY of the tables? Even when the tables match the topic name?

[abhishekgahlot2]

Yes thats correct, i created a exact table and topic name and i got no data.

[abhishekgahlot2]

i didn't add topics here in config, should it be topics.regex or topics only? or just one or both

[abhishekgahlot2]

Never mind i think connector logs created topics that didnt match table name in clickhouse. so wildcard regex was bad idea.

However if table was created during runtime in clickhouse i often see this error

02:02:29 | ERROR | Table [`ballu`] does not exist - see docs for more details about table names and topic names.
-- | -- | --
02:02:29 | WARN | Deciding how to handle exception: Topic: [ballu], Partition: [2], MinOffset: [0], MaxOffset: [57], (QueryId: [2041ab44-64a1-4e9c-bca5-09031c0fbf20])
02:02:29 | ERROR | Errors tolerance is disabled, wrapping exception: Topic: [ballu], Partition: [2], MinOffset: [0], MaxOffset: [57], (QueryId: [2041ab44-64a1-4e9c-bca5-09031c0fbf20])
02:02:29 | ERROR | WorkerSinkTask{id=clcc-y6w3d6-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted. Error: Number of records: 58Number of records: 58

possibly due to cache.

Marking as resolved.