Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Map topic fields to Elasticsearch index fields #385

Open
pavelpe opened this issue Feb 10, 2020 · 0 comments
Open

Map topic fields to Elasticsearch index fields #385

pavelpe opened this issue Feb 10, 2020 · 0 comments

Comments

@pavelpe
Copy link

pavelpe commented Feb 10, 2020

Add support to map topic fields names to ES field names.
It could be even be a mapping file which is later could be placed in etc/kafka-connect-elasticsearch/config (for example) and then used by ES sink connector.

Currently the only option, as I know, it to force topic value field names to match those in ES index.
But it less convenient because this way if, for instance, I have topic that doesn't match index mapping, then I have to stream all my data through another topic which is adjusted to ES index mapping.

If ES index mapping is changed, then instead of adjusting ES sink connector to new changes and continue consuming, I have to create new stream which puts new data to new topic which is adjusted to latest ES Index changes and update ES Sink connector.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant