[Meta] Switch to the new Elasticsearch client

[mshustov]

From the v7.10, Kibana core provides a new Elasticsearch client as a substation of the legacy one.
All the plugins are expected to migrate to the new Elasticsearch client before v8.0, where the legacy client support will be removed from the Kibana Core.
Migration path and breaking changes are available in the Migration guide

List of all plugins grouped by owners:
Important: set ✅ if a plugin is migrated to the new Elasticsearch client or it doesn't use Elasticsearch client API at all.

App team

@elastic/kibana-app

plugin	migration status
discover_enhanced	✅
lens	✅ (#84340)
graph	✅ (#84398)
advanced_settings	✅
charts	✅
discover	✅
management	✅
kibana_legacy	✅
timelion	✅
vis_default_editor	✅
vis_type_metric	✅
vis_type_table	✅
vis_type_tagcloud	✅
vis_type_timelion	✅
vis_type_timeseries	✅ #85275
vis_type_vega	✅ #85280
vis_type_vislib	✅
vis_type_xy	✅
visualize	✅
visualizations	✅ #85245

App Services team

Blockers:

@elastic/kibana-app-services

plugin	migration status
bfetch	✅
data	✅
embeddable	✅
expressions	✅
inspector	✅
kibana_react	✅
kibana_utils	✅
navigation	✅
share	✅
ui_actions	✅
data_enhanced	✅
embeddable_enhanced	✅
reporting	✅ #95375
index_pattern_management	✅
ui_actions_enhanced	✅

Functional tests

#98608

• test/api_integration/apis/index_patterns/es_errors/errors.js:23:
• test/functional/apps/management/_create_index_pattern_wizard.js:14:
• test/functional/apps/management/_handle_alias.js:13:
• test/functional/apps/management/_handle_version_conflict.js:24:
• test/functional/apps/management/_index_patterns_empty.ts:18:
• x-pack/test/functional/apps/management/create_index_pattern_wizard.js:10:

APM team

@elastic/apm-ui

plugin	migration status
apm	✅ (#83913)
apm_oss	✅ (#83913)

Functional tests

• x-pack/test/apm_api_integration/tests/feature_controls.ts:17:

Core team

@elastic/kibana-core

plugin	migration status
src/core	✅
features	✅
global_search	✅ (exists for compatibility with GlobalSearchProviderContext
global_search_bar	✅
cloud	✅
licensing	✅ (#92185)
saved_objects_management	✅
kibana_usage_collection	✅
newsfeed	✅
telemetry	✅
telemetry_collection_manager	✅
telemetry_management_section	✅
usage_collection	✅
telemetry_collection_xpack	✅
home	✅
kibana_overview	✅
xpack_legacy	✅

Logs metrics UI team

@elastic/logs-metrics-ui

plugin	migration status
infra	✅ (#73978)

Functional tests

• x-pack/test/api_integration/apis/metrics_ui/metrics_alerting.ts:15:

Fleet team

@elastic/fleet

plugin	migration status
fleet	✅ (#74111)

Functional tests

• x-pack/test/fleet_api_integration/apis/settings/update.ts:18:

Observability UI team

@elastic/observability-ui

plugin	migration status
observability	✅

Stack monitoring UI team

@elastic/stack-monitoring-ui

plugin	migration status
monitoring	✅ (#101850)

Functional tests

• x-pack/test/api_integration/apis/monitoring/common/mappings_exist.js:17:

Uptime team

@elastic/uptime

plugin	migration status
uptime	✅ #82003

Functional tests

• x-pack/test/api_integration/apis/uptime/rest/certs.ts:18:
• x-pack/test/api_integration/apis/uptime/rest/certs.ts:36:
• x-pack/test/api_integration/apis/uptime/rest/monitor_states_generated.ts:38:
• x-pack/test/api_integration/apis/uptime/rest/monitor_states_generated.ts:66:
• x-pack/test/api_integration/apis/uptime/rest/monitor_states_generated.ts:143:
• x-pack/test/api_integration/apis/uptime/rest/snapshot.ts:55:
• x-pack/test/api_integration/apis/uptime/rest/telemetry_collectors.ts:15:
• x-pack/test/functional/apps/uptime/locations.ts:14:
• x-pack/test/functional/apps/uptime/ping_redirects.ts:38:

ML team

@elastic/ml-ui

plugin	migration status
ml	✅ #74965
transform	✅ #84932

Functional tests

• x-pack/test/functional/services/ml/api.ts:38: ES client : use the new type definitions #83808
• x-pack/test/functional/services/transform/api.ts:23: [ML] Replace legacy es client in Transform API service for functional tests  #95512

Maps team

@elastic/kibana-gis

plugin	migration status
maps	✅
maps_legacy	✅
file_upload	✅
maps_legacy_licensing	✅
tile_map	✅
region_map	✅

Operations team

@elastic/kibana-operations

plugin	migration status
src/dev	✅
es-archiver	✅
kbn-test	✅ (#95443)

Presentation team

@elastic/kibana-presentation

plugin	migration status
canvas	✅
dashboard_enhanced	✅
dashboard	✅
input_control_vis	✅
vis_type_markdown	✅

Security team

@elastic/kibana-security

plugin	migration status
security_oss	✅
spaces	✅
encrypted_saved_objects	✅
security	✅ (#84641)

Functional tests

• x-pack/test/encrypted_saved_objects_api_integration/tests/encrypted_saved_objects_api.ts:13:
• x-pack/test/api_integration/apis/security/index_fields.ts:30:
• x-pack/test/saved_object_api_integration/security_and_spaces/apis/bulk_create.ts:87:
• x-pack/test/saved_object_api_integration/security_and_spaces/apis/create.ts:74:
• x-pack/test/saved_object_api_integration/security_and_spaces/apis/import.ts:112:
• x-pack/test/saved_object_api_integration/security_and_spaces/apis/resolve_import_errors.ts:100:
• x-pack/test/saved_object_api_integration/security_only/apis/bulk_create.ts:53:
• x-pack/test/saved_object_api_integration/security_only/apis/create.ts:52:
• x-pack/test/saved_object_api_integration/security_only/apis/import.ts:83:
• x-pack/test/saved_object_api_integration/security_only/apis/resolve_import_errors.ts:65:
• x-pack/test/saved_object_api_integration/spaces_only/apis/bulk_create.ts:81:
• x-pack/test/saved_object_api_integration/spaces_only/apis/create.ts:68:
• x-pack/test/saved_object_api_integration/spaces_only/apis/import.ts:103:
• x-pack/test/saved_object_api_integration/spaces_only/apis/resolve_import_errors.ts:94:
• x-pack/test/spaces_api_integration/common/config.ts:38:
• x-pack/test/spaces_api_integration/security_and_spaces/apis/copy_to_space.ts:17:
• x-pack/test/spaces_api_integration/security_and_spaces/apis/delete.ts:17:
• x-pack/test/spaces_api_integration/spaces_only/apis/copy_to_space.ts:15:
• x-pack/test/spaces_api_integration/spaces_only/apis/delete.ts:16:

Kibana Alerting team

@elastic/kibana-alerting-services
#50247

plugin	migration status
alerting	✅
actions	✅
event_log	✅
task_manager	✅
triggers_actions_ui	✅
stack_alerts	✅

Functional tests

• x-pack/test/alerting_api_integration/security_and_spaces/tests/actions/builtin_action_types/es_index.ts:16:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/actions/builtin_action_types/es_index_preconfigured.ts:18:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/actions/execute.ts:26:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/alerts.ts:29:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/create.ts:23:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/delete.ts:22:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/disable.ts:23:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/enable.ts:23:
• x-pack/test/alerting_api_integration/security_and_spaces/tests/alerting/rbac_legacy.ts:17:
• x-pack/test/alerting_api_integration/spaces_only/tests/actions/builtin_action_types/es_index.ts:16:
• x-pack/test/alerting_api_integration/spaces_only/tests/actions/execute.ts:25:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/alerts_base.ts:26:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/builtin_alert_types/es_query/alert.ts:35:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/builtin_alert_types/index_threshold/alert.ts:34:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/builtin_alert_types/index_threshold/fields_endpoint.ts:20:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/builtin_alert_types/index_threshold/indices_endpoint.ts:21:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/builtin_alert_types/index_threshold/time_series_query_endpoint.ts:54:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/create.ts:22:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/delete.ts:16:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/disable.ts:21:
• x-pack/test/alerting_api_integration/spaces_only/tests/alerting/enable.ts:21:
• x-pack/test/plugin_api_integration/test_suites/event_log/service_api_integration.ts:14:

Enterprise Alerting team

@elastic/enterprise-search-frontend

plugin	migration status
enterprise_search	✅ (not using)

Elasticsearch UI team

@elastic/kibana-stack-management
Tracked via #73973

plugin	migration status
dev_tools	✅
console	✅ (only using legacy config)
es_ui_shared	✅
cross_cluster_replication	✅ #100131
index_lifecycle_management	✅ (#78416)
console_extensions	✅
es_ui_shared	✅
grokdebugger	✅ (#83036)
index_management	✅ (#105863)
license_management	✅ (#97795)
painless_lab	✅ (#88704)
remote_clusters	✅ (#98747)
rollup	✅ (#95926)
searchprofiler	✅ (#88725)
snapshot_restore	✅ (#95499)
upgrade_assistant	✅ (#89207)
watcher	✅ (#97260)
ingest_pipelines	✅ (#96406)

Functional tests

• x-pack/test/api_integration/apis/management/cross_cluster_replication/lib/elasticsearch.js:16:
• x-pack/test/api_integration/apis/management/index_management/data_streams.ts:17:
• x-pack/test/api_integration/apis/management/index_management/lib/elasticsearch.js:16:
• x-pack/test/api_integration/apis/management/ingest_pipelines/lib/elasticsearch.ts:33:
• x-pack/test/api_integration/apis/management/rollup/lib/es_index.js:16:
• x-pack/test/api_integration/apis/management/snapshot_restore/lib/elasticsearch.ts:39:
• x-pack/test/functional/apps/ingest_pipelines/ingest_pipelines.ts:20:
• x-pack/test/functional/apps/rollup_job/hybrid_index_pattern.js:13:
• x-pack/test/functional/apps/rollup_job/rollup_jobs.js:13:
• x-pack/test/functional/apps/rollup_job/tsvb.js:12:
• x-pack/test/functional/apps/snapshot_restore/home_page.ts:14:

Security Solution team

@elastic/endpoint-app-team
@elastic/security-detections-response
@elastic/security-threat-hunting

plugin	migration status
security_solution	✅ (#106130)
cases	✅
lists	✅ (#106130)

Logstash team

@elastic/logstash

plugin	migration status
logstash	✅

Functional tests

• x-pack/test/api_integration/apis/logstash/cluster/load.ts:13:

Plugins that will not be migrated due to removal

plugin	migration status
beats_management	✅ (removed in 7.14)

[shahzad31]

Uptime is already migrated #82003

[peteharverson]

The ml plugin was migrated for 7.10 - #74965

[cee-chen]

Sorry, still kind of a new at Kibana - our plugin (enterprise_search) isn't directly using the Elasticsearch client as far as we know, should we just change our migration status to a green or do you want some other icon to indicate "Not Applicable"?

[pgayvallet]

@constancecchen if the plugin is not directly using the legacy client, you can set the migration status to green.

[jbudz]

src/dev has one case for code coverage, it's using the new client directly. Updated it to a check.