[Backport] [2.x] Update to Apache Lucene 9.4.0 (#4661)

[reta]

Signed-off-by: Andriy Redko andriy.redko@aiven.io

Description

Backport of #4661 to 2.x

Issues Resolved

[List any issues this PR will resolve]

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/3721/
• CommitID: 7f14bc9

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/3732/
• CommitID: 7f14bc9

[andrross]

Looks like a legit failure? I think this constant needs to change on the 2.x branch.

»  java.lang.AssertionError: PerFieldMappingPostingFormatCodec must subclass the latest lucene codec: Lucene92
»  	at org.opensearch.index.codec.PerFieldMappingPostingFormatCodec.<clinit>(PerFieldMappingPostingFormatCodec.java:62)
»  	at org.opensearch.index.codec.CodecService.<init>(CodecService.java:68)
»  	at org.opensearch.index.shard.IndexShard.<init>(IndexShard.java:338)
»  	at org.opensearch.index.IndexService.createShard(IndexService.java:550)
»  	at org.opensearch.indices.IndicesService.createShard(IndicesService.java:866)
»  	at org.opensearch.indices.IndicesService.createShard(IndicesService.java:200)
»  	at org.opensearch.indices.cluster.IndicesClusterStateService.createShard(IndicesClusterStateService.java:651)
»  	at org.opensearch.indices.cluster.IndicesClusterStateService.createOrUpdateShards(IndicesClusterStateService.java:628)
»  	at org.opensearch.indices.cluster.IndicesClusterStateService.applyClusterState(IndicesClusterStateService.java:285)
»  	at org.opensearch.cluster.service.ClusterApplierService.callClusterStateAppliers(ClusterApplierService.java:606)
»  	at org.opensearch.cluster.service.ClusterApplierService.callClusterStateAppliers(ClusterApplierService.java:593)
»  	at org.opensearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:561)
»  	at org.opensearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:484)
»  	at org.opensearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:186)
»  	at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:747)
»  	at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:282)
»  	at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:245)
»  	at java.****/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
»  	at java.****/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
»  	at java.****/java.lang.Thread.run(Thread.java:833)

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/3751/
• CommitID: b34a124