Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Elasticsearch exceptions for 1.3.0 migrations #14857

Closed
OnkarVO7 opened this issue Jan 25, 2024 · 0 comments · Fixed by #14876
Closed

Elasticsearch exceptions for 1.3.0 migrations #14857

OnkarVO7 opened this issue Jan 25, 2024 · 0 comments · Fixed by #14876
Assignees
@07Himank
Labels
backend bug Something isn't working

Comments

@OnkarVO7
Copy link
Contributor

Affected module
Backend

Below elasticsearch errors are visible in the migration logs in 1.3.0
The logs are from the execute_migrate_all container

2024-01-25 11:08:03 Failed to create Elastic Search indexes due to
2024-01-25 11:08:03 es.org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=mapper_parsing_exception, reason=Failed to parse mapping: analyzer [om_ngram] has not been configured in mappings]
2024-01-25 11:08:03     at es.org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:178)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2484)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:2461)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2184)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:2154)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:2118)
2024-01-25 11:08:03     at es.org.elasticsearch.client.IndicesClient.create(IndicesClient.java:152)
2024-01-25 11:08:03     at org.openmetadata.service.search.elasticsearch.ElasticSearchClient.createIndex(ElasticSearchClient.java:224)
2024-01-25 11:08:03     at org.openmetadata.service.search.SearchRepository.updateIndex(SearchRepository.java:201)
2024-01-25 11:08:03     at org.openmetadata.service.search.SearchRepository.updateIndexes(SearchRepository.java:155)
2024-01-25 11:08:03     at org.openmetadata.service.util.TablesInitializer.execute(TablesInitializer.java:370)
2024-01-25 11:08:03     at org.openmetadata.service.util.TablesInitializer.main(TablesInitializer.java:233)
2024-01-25 11:08:03     Suppressed: es.org.elasticsearch.client.ResponseException: method [PUT], host [http://elasticsearch:9200], URI [/search_service_search_index?master_timeout=30s&timeout=30s], status line [HTTP/1.1 400 Bad Request]
2024-01-25 11:08:03 {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"Failed to parse mapping: analyzer [om_ngram] has not been configured in mappings"}],"type":"mapper_parsing_exception","reason":"Failed to parse mapping: analyzer [om_ngram] has not been configured in mappings","caused_by":{"type":"illegal_argument_exception","reason":"analyzer [om_ngram] has not been configured in mappings"}},"status":400}
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestClient.convertResponse(RestClient.java:347)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:313)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2699)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2171)
2024-01-25 11:08:03             ... 8 common frames omitted
2024-01-25 11:08:03 Caused by: es.org.elasticsearch.ElasticsearchException: Elasticsearch exception [type=illegal_argument_exception, reason=analyzer [om_ngram] has not been configured in mappings]
2024-01-25 11:08:03     at es.org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:519)
2024-01-25 11:08:03     at es.org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:430)
2024-01-25 11:08:03     at es.org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:460)
2024-01-25 11:08:03     at es.org.elasticsearch.ElasticsearchException.failureFromXContent(ElasticsearchException.java:626)
2024-01-25 11:08:03     at es.org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:170)
2024-01-25 11:08:03     ... 11 common frames omitted
2024-01-25 11:08:03 Failed to create alias for searchService due to
2024-01-25 11:08:03 es.org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=index_not_found_exception, reason=no such index [search_service_search_index]]
2024-01-25 11:08:03     at es.org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:178)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2484)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:2461)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2184)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:2137)
2024-01-25 11:08:03     at es.org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:2105)
2024-01-25 11:08:03     at es.org.elasticsearch.client.IndicesClient.updateAliases(IndicesClient.java:737)
2024-01-25 11:08:03     at org.openmetadata.service.search.elasticsearch.ElasticSearchClient.createAliases(ElasticSearchClient.java:251)
2024-01-25 11:08:03     at org.openmetadata.service.search.SearchRepository.updateIndex(SearchRepository.java:203)
2024-01-25 11:08:03     at org.openmetadata.service.search.SearchRepository.updateIndexes(SearchRepository.java:155)
2024-01-25 11:08:03     at org.openmetadata.service.util.TablesInitializer.execute(TablesInitializer.java:370)
2024-01-25 11:08:03     at org.openmetadata.service.util.TablesInitializer.main(TablesInitializer.java:233)
2024-01-25 11:08:03     Suppressed: es.org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch:9200], URI [/_aliases?master_timeout=30s&timeout=30s], status line [HTTP/1.1 404 Not Found]
2024-01-25 11:08:03 {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [search_service_search_index]","resource.type":"index_or_alias","resource.id":"search_service_search_index","index_uuid":"_na_","index":"search_service_search_index"}],"type":"index_not_found_exception","reason":"no such index [search_service_search_index]","resource.type":"index_or_alias","resource.id":"search_service_search_index","index_uuid":"_na_","index":"search_service_search_index"},"status":404}
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestClient.convertResponse(RestClient.java:347)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:313)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2699)
2024-01-25 11:08:03             at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2171)
2024-01-25 11:08:03             ... 8 common frames omitted
2024-01-25 11:08:04 Failed to create Elastic Search indexes due to
2024-01-25 11:08:04 es.org.elasticsearch.ElasticsearchParseException: Failed to parse content to map
2024-01-25 11:08:04     at es.org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:212)
2024-01-25 11:08:04     at es.org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:138)
2024-01-25 11:08:04     at es.org.elasticsearch.client.indices.CreateIndexRequest.source(CreateIndexRequest.java:280)
2024-01-25 11:08:04     at es.org.elasticsearch.client.indices.CreateIndexRequest.source(CreateIndexRequest.java:261)
2024-01-25 11:08:04     at org.openmetadata.service.search.elasticsearch.ElasticSearchClient.createIndex(ElasticSearchClient.java:222)
2024-01-25 11:08:04     at org.openmetadata.service.search.SearchRepository.updateIndex(SearchRepository.java:201)
2024-01-25 11:08:04     at org.openmetadata.service.search.SearchRepository.updateIndexes(SearchRepository.java:155)
2024-01-25 11:08:04     at org.openmetadata.service.util.TablesInitializer.execute(TablesInitializer.java:370)
2024-01-25 11:08:04     at org.openmetadata.service.util.TablesInitializer.main(TablesInitializer.java:233)
2024-01-25 11:08:04 Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('}' (code 125)): was expecting double-quote to start field name
2024-01-25 11:08:04  at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 120, column: 12]
2024-01-25 11:08:04     at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:2481)
2024-01-25 11:08:04     at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:752)
2024-01-25 11:08:04     at com.fasterxml.jackson.core.base.ParserMinimalBase._reportUnexpectedChar(ParserMinimalBase.java:676)
2024-01-25 11:08:04     at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._handleOddName(UTF8StreamJsonParser.java:2147)
2024-01-25 11:08:04     at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._parseName(UTF8StreamJsonParser.java:1797)
2024-01-25 11:08:04     at com.fasterxml.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:801)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.json.JsonXContentParser.nextToken(JsonXContentParser.java:73)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapEntries(AbstractXContentParser.java:320)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readValueUnsafe(AbstractXContentParser.java:394)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapEntries(AbstractXContentParser.java:318)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readValueUnsafe(AbstractXContentParser.java:394)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapEntries(AbstractXContentParser.java:318)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readValueUnsafe(AbstractXContentParser.java:394)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapEntries(AbstractXContentParser.java:318)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readValueUnsafe(AbstractXContentParser.java:394)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapEntries(AbstractXContentParser.java:318)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readValueUnsafe(AbstractXContentParser.java:394)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapEntries(AbstractXContentParser.java:318)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapSafe(AbstractXContentParser.java:304)
2024-01-25 11:08:04     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.map(AbstractXContentParser.java:254)
2024-01-25 11:08:04     at es.org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:210)
2024-01-25 11:08:04     ... 8 common frames omitted
2024-01-25 11:08:04 Failed to create alias for storedProcedure due to
2024-01-25 11:08:04 es.org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=index_not_found_exception, reason=no such index [stored_procedure_search_index]]
2024-01-25 11:08:04     at es.org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:178)
2024-01-25 11:08:04     at es.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2484)
2024-01-25 11:08:04     at es.org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:2461)
2024-01-25 11:08:04     at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2184)
2024-01-25 11:08:04     at es.org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:2137)
2024-01-25 11:08:04     at es.org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:2105)
2024-01-25 11:08:04     at es.org.elasticsearch.client.IndicesClient.updateAliases(IndicesClient.java:737)
2024-01-25 11:08:04     at org.openmetadata.service.search.elasticsearch.ElasticSearchClient.createAliases(ElasticSearchClient.java:251)
2024-01-25 11:08:04     at org.openmetadata.service.search.SearchRepository.updateIndex(SearchRepository.java:203)
2024-01-25 11:08:04     at org.openmetadata.service.search.SearchRepository.updateIndexes(SearchRepository.java:155)
2024-01-25 11:08:04     at org.openmetadata.service.util.TablesInitializer.execute(TablesInitializer.java:370)
2024-01-25 11:08:04     at org.openmetadata.service.util.TablesInitializer.main(TablesInitializer.java:233)
2024-01-25 11:08:04     Suppressed: es.org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch:9200], URI [/_aliases?master_timeout=30s&timeout=30s], status line [HTTP/1.1 404 Not Found]
2024-01-25 11:08:04 {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [stored_procedure_search_index]","resource.type":"index_or_alias","resource.id":"stored_procedure_search_index","index_uuid":"_na_","index":"stored_procedure_search_index"}],"type":"index_not_found_exception","reason":"no such index [stored_procedure_search_index]","resource.type":"index_or_alias","resource.id":"stored_procedure_search_index","index_uuid":"_na_","index":"stored_procedure_search_index"},"status":404}
2024-01-25 11:08:04             at es.org.elasticsearch.client.RestClient.convertResponse(RestClient.java:347)
2024-01-25 11:08:04             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:313)
2024-01-25 11:08:04             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
2024-01-25 11:08:04             at es.org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2699)
2024-01-25 11:08:04             at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2171)
2024-01-25 11:08:04             ... 8 common frames omitted
2024-01-25 11:08:08 Failed to create Elastic Search indexes due to
2024-01-25 11:08:08 es.org.elasticsearch.ElasticsearchParseException: Failed to parse content to map
2024-01-25 11:08:08     at es.org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:212)
2024-01-25 11:08:08     at es.org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:138)
2024-01-25 11:08:08     at es.org.elasticsearch.client.indices.CreateIndexRequest.source(CreateIndexRequest.java:280)
2024-01-25 11:08:08     at es.org.elasticsearch.client.indices.CreateIndexRequest.source(CreateIndexRequest.java:261)
2024-01-25 11:08:08     at org.openmetadata.service.search.elasticsearch.ElasticSearchClient.createIndex(ElasticSearchClient.java:222)
2024-01-25 11:08:08     at org.openmetadata.service.search.SearchRepository.updateIndex(SearchRepository.java:201)
2024-01-25 11:08:08     at org.openmetadata.service.search.SearchRepository.updateIndexes(SearchRepository.java:155)
2024-01-25 11:08:08     at org.openmetadata.service.util.TablesInitializer.execute(TablesInitializer.java:370)
2024-01-25 11:08:08     at org.openmetadata.service.util.TablesInitializer.main(TablesInitializer.java:233)
2024-01-25 11:08:08 Caused by: com.fasterxml.jackson.core.io.JsonEOFException: Unexpected end-of-input: expected close marker for Object (start marker at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1, column: 1])
2024-01-25 11:08:08  at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 336, column: 2]
2024-01-25 11:08:08     at com.fasterxml.jackson.core.base.ParserMinimalBase._reportInvalidEOF(ParserMinimalBase.java:699)
2024-01-25 11:08:08     at com.fasterxml.jackson.core.base.ParserBase._handleEOF(ParserBase.java:514)
2024-01-25 11:08:08     at com.fasterxml.jackson.core.base.ParserBase._eofAsNextChar(ParserBase.java:531)
2024-01-25 11:08:08     at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._skipWSOrEnd(UTF8StreamJsonParser.java:3107)
2024-01-25 11:08:08     at com.fasterxml.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:760)
2024-01-25 11:08:08     at es.org.elasticsearch.xcontent.json.JsonXContentParser.nextToken(JsonXContentParser.java:73)
2024-01-25 11:08:08     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapEntries(AbstractXContentParser.java:320)
2024-01-25 11:08:08     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.readMapSafe(AbstractXContentParser.java:304)
2024-01-25 11:08:08     at es.org.elasticsearch.xcontent.support.AbstractXContentParser.map(AbstractXContentParser.java:254)
2024-01-25 11:08:08     at es.org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:210)
2024-01-25 11:08:08     ... 8 common frames omitted
2024-01-25 11:08:08 Failed to create alias for chart due to
2024-01-25 11:08:08 es.org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=index_not_found_exception, reason=no such index [chart_search_index]]
2024-01-25 11:08:08     at es.org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:178)
2024-01-25 11:08:08     at es.org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2484)
2024-01-25 11:08:08     at es.org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:2461)
2024-01-25 11:08:08     at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2184)
2024-01-25 11:08:08     at es.org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:2137)
2024-01-25 11:08:08     at es.org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:2105)
2024-01-25 11:08:08     at es.org.elasticsearch.client.IndicesClient.updateAliases(IndicesClient.java:737)
2024-01-25 11:08:08     at org.openmetadata.service.search.elasticsearch.ElasticSearchClient.createAliases(ElasticSearchClient.java:251)
2024-01-25 11:08:08     at org.openmetadata.service.search.SearchRepository.updateIndex(SearchRepository.java:203)
2024-01-25 11:08:08     at org.openmetadata.service.search.SearchRepository.updateIndexes(SearchRepository.java:155)
2024-01-25 11:08:08     at org.openmetadata.service.util.TablesInitializer.execute(TablesInitializer.java:370)
2024-01-25 11:08:08     at org.openmetadata.service.util.TablesInitializer.main(TablesInitializer.java:233)
2024-01-25 11:08:08     Suppressed: es.org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch:9200], URI [/_aliases?master_timeout=30s&timeout=30s], status line [HTTP/1.1 404 Not Found]
2024-01-25 11:08:08 {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [chart_search_index]","resource.type":"index_or_alias","resource.id":"chart_search_index","index_uuid":"_na_","index":"chart_search_index"}],"type":"index_not_found_exception","reason":"no such index [chart_search_index]","resource.type":"index_or_alias","resource.id":"chart_search_index","index_uuid":"_na_","index":"chart_search_index"},"status":404}
2024-01-25 11:08:08             at es.org.elasticsearch.client.RestClient.convertResponse(RestClient.java:347)
2024-01-25 11:08:08             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:313)
2024-01-25 11:08:08             at es.org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
2024-01-25 11:08:08             at es.org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2699)
2024-01-25 11:08:08             at es.org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2171)
2024-01-25 11:08:08             ... 8 common frames omitted
2024-01-25 11:08:09 es-migrateoption successful
@OnkarVO7 OnkarVO7 added bug Something isn't working backend labels Jan 25, 2024
@pmbrull pmbrull moved this to Search in Release 1.3.0 Jan 25, 2024
@07Himank 07Himank mentioned this issue Jan 25, 2024
Merged
2 tasks
@harshach harshach moved this from Search to Done in Release 1.3.0 Jan 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@07Himank 07Himank

Labels
backend bug Something isn't working
Projects
No open projects
Release 1.3.0
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix a part of es exception while migrate open-metadata/OpenMetadata
2 participants
@OnkarVO7 @07Himank