Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ERROR LOG: Camunda Exporter fails to retrieve mappings for indices/templates #24354

Closed
ChrisKujawa opened this issue Nov 5, 2024 · 0 comments · Fixed by #24391
Closed

ERROR LOG: Camunda Exporter fails to retrieve mappings for indices/templates #24354

ChrisKujawa opened this issue Nov 5, 2024 · 0 comments · Fixed by #24391
Assignees
@EuroLew
Labels
area/project Marks an issue as related to project management (e.g. PR templates, editor config, etc.) impact/low Marks issues relieving an uncommon pain or fulfilling a nonessential request kind/bug Categorizes an issue or PR as a bug severity/low Marks a bug as having little to no noticeable impact for the user version:8.7.0-alpha2 Labal that represents features released with 8.7.0-alpha2

Comments

@ChrisKujawa
Copy link
Member

ChrisKujawa commented Nov 5, 2024 •
edited
Loading

Description

Several Errors have been reported on SaaS for the Alpha1 (MVP) that indices haven't been found, this was logged as error.

Severity:

  • Low: As check will be retried, other partitions are creating the indices in the meantime and succeed.

Impact

  • Low: As retry is possible and done. It is just noise.

Stacktrace

io.camunda.exporter.exceptions.ElasticsearchExporterException: Failed retrieving mappings from index/index templates with pattern [identity-users-8.7.0_*,identity-authorizations-8.7.0_*,tasklist-form-8.4.0_*,tasklist-metric-8.3.0_*,operate-process-8.3.0_*,operate-metric-8.3.0_*,operate-decision-requirements-8.3.0_*,operate-decision-8.3.0_*]
	at io.camunda.exporter.schema.elasticsearch.ElasticsearchEngineClient.getMappings(ElasticsearchEngineClient.java:131) ~[camunda-exporter-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.exporter.schema.SchemaManager.initialiseIndices(SchemaManager.java:72) ~[camunda-exporter-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.exporter.schema.SchemaManager.initialiseResources(SchemaManager.java:62) ~[camunda-exporter-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.exporter.schema.SchemaManager.startup(SchemaManager.java:49) ~[camunda-exporter-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.exporter.CamundaExporter.open(CamundaExporter.java:104) ~[camunda-exporter-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.broker.exporter.stream.ExporterContainer.lambda$openExporter$0(ExporterContainer.java:118) ~[zeebe-broker-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.util.jar.ThreadContextUtil.runCheckedWithClassLoader(ThreadContextUtil.java:59) ~[zeebe-util-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.util.jar.ThreadContextUtil.runWithClassLoader(ThreadContextUtil.java:35) ~[zeebe-util-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.broker.exporter.stream.ExporterContainer.openExporter(ExporterContainer.java:117) ~[zeebe-broker-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.broker.exporter.stream.ExporterDirector.lambda$startActiveExportingMode$16(ExporterDirector.java:532) ~[zeebe-broker-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.scheduler.retry.BackOffRetryStrategy.run(BackOffRetryStrategy.java:51) ~[zeebe-scheduler-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.scheduler.ActorJob.invoke(ActorJob.java:83) [zeebe-scheduler-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.scheduler.ActorJob.execute(ActorJob.java:42) [zeebe-scheduler-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.scheduler.ActorTask.execute(ActorTask.java:122) [zeebe-scheduler-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.scheduler.ActorThread.executeCurrentTask(ActorThread.java:130) [zeebe-scheduler-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.scheduler.ActorThread.doWork(ActorThread.java:108) [zeebe-scheduler-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.zeebe.scheduler.ActorThread.run(ActorThread.java:227) [zeebe-scheduler-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
Caused by: co.elastic.clients.elasticsearch._types.ElasticsearchException: [es/indices.get_mapping] failed: [index_not_found_exception] no such index [identity-users-8.7.0_]
	at co.elastic.clients.transport.ElasticsearchTransportBase.getApiResponse(ElasticsearchTransportBase.java:345) ~[elasticsearch-java-8.13.4.jar:?]
	at co.elastic.clients.transport.ElasticsearchTransportBase.performRequest(ElasticsearchTransportBase.java:147) ~[elasticsearch-java-8.13.4.jar:?]
	at co.elastic.clients.elasticsearch.indices.ElasticsearchIndicesClient.getMapping(ElasticsearchIndicesClient.java:1210) ~[elasticsearch-java-8.13.4.jar:?]
	at co.elastic.clients.elasticsearch.indices.ElasticsearchIndicesClient.getMapping(ElasticsearchIndicesClient.java:1226) ~[elasticsearch-java-8.13.4.jar:?]
	at io.camunda.exporter.schema.elasticsearch.ElasticsearchEngineClient.getCurrentMappings(ElasticsearchEngineClient.java:199) ~[camunda-exporter-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	at io.camunda.exporter.schema.elasticsearch.ElasticsearchEngineClient.getMappings(ElasticsearchEngineClient.java:114) ~[camunda-exporter-8.7.0-SNAPSHOT.jar:8.7.0-SNAPSHOT]
	... 16 more

Occurrences:
@ChrisKujawa ChrisKujawa added kind/bug Categorizes an issue or PR as a bug severity/low Marks a bug as having little to no noticeable impact for the user area/project Marks an issue as related to project management (e.g. PR templates, editor config, etc.) impact/low Marks issues relieving an uncommon pain or fulfilling a nonessential request labels Nov 5, 2024
@EuroLew EuroLew mentioned this issue Nov 5, 2024
Merged
github-merge-queue bot pushed a commit that referenced this issue Nov 6, 2024
@EuroLew
Failed to retrieve mappings fix (#24391)
fccd20b 
## Description

Fails to retrieve mappings when a subset of indices in the query exists
e.g. if index `foo` exists a `getMapping("foo*,bar*")` will fail this is
fixed by the `ignore_unavailable` field being set referenced
[here](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-mapping.html)

The other logs resulting in this error mentioned in the issue was a
connection issue to the Elastic instance

## Related issues

closes #24354
@npepinpe npepinpe added the version:8.7.0-alpha2 Labal that represents features released with 8.7.0-alpha2 label Dec 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@EuroLew EuroLew

Labels
area/project Marks an issue as related to project management (e.g. PR templates, editor config, etc.) impact/low Marks issues relieving an uncommon pain or fulfilling a nonessential request kind/bug Categorizes an issue or PR as a bug severity/low Marks a bug as having little to no noticeable impact for the user version:8.7.0-alpha2 Labal that represents features released with 8.7.0-alpha2
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Failed to retrieve mappings fix camunda/camunda
3 participants
@npepinpe @ChrisKujawa @EuroLew