Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix for max & min aggregations when no metric property exist #870

Merged
merged 1 commit into from
Jul 28, 2023

Conversation

sbcd90
Copy link
Contributor

@sbcd90 sbcd90 commented Jul 22, 2023

Issue #, if available:

Description of changes:
fix for max & min aggregations when no metric property exist

CheckList:

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@codecov
Copy link

codecov bot commented Jul 22, 2023

Codecov Report

Merging #870 (426b817) into main (d4cafd6) will increase coverage by 0.05%.
The diff coverage is 100.00%.

❗ Current head 426b817 differs from pull request most recent head 2b36a79. Consider uploading reports for the commit 2b36a79 to get more accurate results

@@             Coverage Diff              @@
##               main     #870      +/-   ##
============================================
+ Coverage     75.63%   75.69%   +0.05%     
- Complexity     2848     2850       +2     
============================================
  Files           364      364              
  Lines         16184    16184              
  Branches       2329     2329              
============================================
+ Hits          12241    12250       +9     
+ Misses         2600     2590      -10     
- Partials       1343     1344       +1     
Files Changed Coverage Δ
...opensearch/indexmanagement/rollup/RollupIndexer.kt 57.57% <100.00%> (ø)

... and 13 files with indirect coverage changes

@@ -152,6 +152,11 @@ abstract class IndexManagementRestTestCase : ODFERestTestCase() {
insertSampleBulkData(index, javaClass.classLoader.getResource("data/nyc_5000.ndjson").readText())
}

protected fun generateMessageLogsData(index: String = "message-logs") {
createIndex(index, Settings.EMPTY, """"properties": {"USM_Storage":{"properties":{"occured_to_received":{"type":"long"},"received_to_storage":{"type":"long"},"storage_to_os":{"type":"long"}}},"message":{"properties":{"access_control_outcome":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"access_key_id":{"ignore_above":10000,"type":"keyword"},"account_id":{"ignore_above":10000,"type":"keyword"},"account_name":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"account_vendor":{"ignore_above":10000,"type":"keyword"},"adhoc_query_id":{"ignore_above":10000,"type":"keyword"},"affected_family":{"ignore_above":10000,"type":"keyword"},"affected_platform":{"ignore_above":10000,"type":"keyword"},"affected_platforms":{"ignore_above":10000,"type":"keyword"},"affected_products":{"ignore_above":10000,"type":"keyword"},"alarm_events_count":{"type":"long"},"app_id":{"ignore_above":10000,"type":"keyword"},"app_name":{"ignore_above":10000,"type":"keyword"},"app_type":{"ignore_above":10000,"type":"keyword"},"application":{"ignore_above":10000,"type":"keyword"},"application_protocol":{"ignore_above":10000,"type":"keyword"},"application_type":{"ignore_above":10000,"type":"keyword"},"asset_status":{"ignore_above":10000,"type":"keyword"},"assumed_role":{"ignore_above":10000,"type":"keyword"},"audit_reason":{"ignore_above":10000,"type":"keyword"},"authentication_mode":{"ignore_above":10000,"type":"keyword"},"authentication_package_name":{"ignore_above":10000,"type":"keyword"},"authentication_type":{"ignore_above":10000,"type":"keyword"},"base_event_count":{"type":"long"},"blacklist_reference_url":{"ignore_above":10000,"type":"keyword"},"bytes_in":{"type":"long"},"bytes_out":{"type":"long"},"certificate_issuer_name":{"ignore_above":10000,"type":"keyword"},"certificate_serial_number":{"ignore_above":10000,"type":"keyword"},"certificate_subject_name":{"ignore_above":10000,"type":"keyword"},"confidence":{"type":"long"},"connection_count":{"type":"long"},"connector_id":{"ignore_above":10000,"type":"keyword"},"connector_source":{"ignore_above":10000,"type":"keyword"},"connector_source_file":{"ignore_above":10000,"type":"keyword"},"container_cmd":{"ignore_above":10000,"type":"keyword"},"container_cpu":{"ignore_above":10000,"type":"keyword"},"container_id":{"ignore_above":10000,"type":"keyword"},"container_image":{"ignore_above":10000,"type":"keyword"},"container_image_id":{"ignore_above":10000,"type":"keyword"},"container_memory":{"ignore_above":10000,"type":"keyword"},"container_name":{"ignore_above":10000,"type":"keyword"},"container_state":{"ignore_above":10000,"type":"keyword"},"container_volume":{"ignore_above":10000,"type":"keyword"},"contains_credit_card_number":{"type":"boolean"},"content_category":{"ignore_above":10000,"type":"keyword"},"control_id":{"ignore_above":10000,"type":"keyword"},"current_pps":{"type":"long"},"current_working_directory":{"ignore_above":10000,"type":"keyword"},"customfield_0":{"ignore_above":10000,"type":"keyword"},"customfield_1":{"ignore_above":10000,"type":"keyword"},"customfield_10":{"ignore_above":10000,"type":"keyword"},"customfield_11":{"ignore_above":10000,"type":"keyword"},"customfield_12":{"ignore_above":10000,"type":"keyword"},"customfield_13":{"ignore_above":10000,"type":"keyword"},"customfield_14":{"ignore_above":10000,"type":"keyword"},"customfield_15":{"ignore_above":10000,"type":"keyword"},"customfield_16":{"ignore_above":10000,"type":"keyword"},"customfield_17":{"ignore_above":10000,"type":"keyword"},"customfield_18":{"ignore_above":10000,"type":"keyword"},"customfield_19":{"ignore_above":10000,"type":"keyword"},"customfield_2":{"ignore_above":10000,"type":"keyword"},"customfield_20":{"ignore_above":10000,"type":"keyword"},"customfield_21":{"ignore_above":10000,"type":"keyword"},"customfield_22":{"ignore_above":10000,"type":"keyword"},"customfield_23":{"ignore_above":10000,"type":"keyword"},"customfield_24":{"ignore_above":10000,"type":"keyword"},"customfield_25":{"ignore_above":10000,"type":"keyword"},"customfield_26":{"ignore_above":10000,"type":"keyword"},"customfield_27":{"ignore_above":10000,"type":"keyword"},"customfield_28":{"ignore_above":10000,"type":"keyword"},"customfield_29":{"ignore_above":10000,"type":"keyword"},"customfield_3":{"ignore_above":10000,"type":"keyword"},"customfield_30":{"ignore_above":10000,"type":"keyword"},"customfield_4":{"ignore_above":10000,"type":"keyword"},"customfield_5":{"ignore_above":10000,"type":"keyword"},"customfield_6":{"ignore_above":10000,"type":"keyword"},"customfield_7":{"ignore_above":10000,"type":"keyword"},"customfield_8":{"ignore_above":10000,"type":"keyword"},"customfield_9":{"ignore_above":10000,"type":"keyword"},"customheader_0":{"ignore_above":10000,"type":"keyword"},"customheader_1":{"ignore_above":10000,"type":"keyword"},"customheader_10":{"ignore_above":10000,"type":"keyword"},"customheader_11":{"ignore_above":10000,"type":"keyword"},"customheader_12":{"ignore_above":10000,"type":"keyword"},"customheader_13":{"ignore_above":10000,"type":"keyword"},"customheader_14":{"ignore_above":10000,"type":"keyword"},"customheader_15":{"ignore_above":10000,"type":"keyword"},"customheader_16":{"ignore_above":10000,"type":"keyword"},"customheader_17":{"ignore_above":10000,"type":"keyword"},"customheader_18":{"ignore_above":10000,"type":"keyword"},"customheader_19":{"ignore_above":10000,"type":"keyword"},"customheader_2":{"ignore_above":10000,"type":"keyword"},"customheader_20":{"ignore_above":10000,"type":"keyword"},"customheader_21":{"ignore_above":10000,"type":"keyword"},"customheader_22":{"ignore_above":10000,"type":"keyword"},"customheader_23":{"ignore_above":10000,"type":"keyword"},"customheader_24":{"ignore_above":10000,"type":"keyword"},"customheader_25":{"ignore_above":10000,"type":"keyword"},"customheader_26":{"ignore_above":10000,"type":"keyword"},"customheader_27":{"ignore_above":10000,"type":"keyword"},"customheader_28":{"ignore_above":10000,"type":"keyword"},"customheader_29":{"ignore_above":10000,"type":"keyword"},"customheader_3":{"ignore_above":10000,"type":"keyword"},"customheader_30":{"ignore_above":10000,"type":"keyword"},"customheader_4":{"ignore_above":10000,"type":"keyword"},"customheader_5":{"ignore_above":10000,"type":"keyword"},"customheader_6":{"ignore_above":10000,"type":"keyword"},"customheader_7":{"ignore_above":10000,"type":"keyword"},"customheader_8":{"ignore_above":10000,"type":"keyword"},"customheader_9":{"ignore_above":10000,"type":"keyword"},"datascience_alarm_threshold":{"type":"float"},"datascience_alarm_threshold_99":{"type":"float"},"datascience_alarm_threshold_low_confidence":{"type":"float"},"datascience_alarm_threshold_medium_confidence":{"type":"float"},"datascience_anomaly_score":{"type":"float"},"datascience_inference_explanation":{"ignore_above":10000,"type":"keyword"},"datascience_inference_type":{"ignore_above":10000,"type":"keyword"},"datascience_tenant_event_threshold":{"type":"float"},"destination_account_id":{"ignore_above":10000,"type":"keyword"},"destination_additional_hostnames":{"ignore_above":10000,"type":"keyword"},"destination_address":{"ignore_above":10000,"type":"keyword"},"destination_address_6":{"ignore_above":10000,"type":"keyword"},"destination_asn":{"ignore_above":10000,"type":"keyword"},"destination_asset_id":{"ignore_above":10000,"type":"keyword"},"destination_blacklist_activity":{"ignore_above":10000,"type":"keyword"},"destination_blacklist_priority":{"ignore_above":10000,"type":"keyword"},"destination_blacklist_reliability":{"ignore_above":10000,"type":"keyword"},"destination_canonical":{"ignore_above":10000,"type":"keyword"},"destination_city":{"ignore_above":10000,"type":"keyword"},"destination_country":{"ignore_above":10000,"type":"keyword"},"destination_datastore":{"ignore_above":10000,"type":"keyword"},"destination_dns_domain":{"ignore_above":10000,"type":"keyword"},"destination_fqdn":{"ignore_above":10000,"type":"keyword"},"destination_hostname":{"ignore_above":10000,"type":"keyword"},"destination_infrastructure_name":{"ignore_above":10000,"type":"keyword"},"destination_infrastructure_type":{"ignore_above":10000,"type":"keyword"},"destination_instance_id":{"ignore_above":10000,"type":"keyword"},"destination_latitude":{"ignore_above":10000,"type":"keyword"},"destination_longitude":{"ignore_above":10000,"type":"keyword"},"destination_mac":{"ignore_above":10000,"type":"keyword"},"destination_mac_vendor":{"ignore_above":10000,"type":"keyword"},"destination_name":{"ignore_above":10000,"type":"keyword"},"destination_nat_address":{"ignore_above":10000,"type":"keyword"},"destination_nat_port":{"type":"long"},"destination_netmask":{"ignore_above":10000,"type":"keyword"},"destination_network":{"ignore_above":10000,"type":"keyword"},"destination_ntdomain":{"ignore_above":10000,"type":"keyword"},"destination_organisation":{"ignore_above":10000,"type":"keyword"},"destination_port":{"type":"long"},"destination_port_label":{"ignore_above":10000,"type":"keyword"},"destination_post_nat_port":{"type":"long"},"destination_pre_nat_port":{"type":"long"},"destination_process":{"ignore_above":10000,"type":"keyword"},"destination_process_id":{"ignore_above":10000,"type":"keyword"},"destination_region":{"ignore_above":10000,"type":"keyword"},"destination_registered_country":{"ignore_above":10000,"type":"keyword"},"destination_service_name":{"ignore_above":10000,"type":"keyword"},"destination_translated_address":{"ignore_above":10000,"type":"keyword"},"destination_translated_port":{"type":"long"},"destination_user_email":{"ignore_above":10000,"type":"keyword"},"destination_user_group":{"ignore_above":10000,"type":"keyword"},"destination_user_id":{"ignore_above":10000,"type":"keyword"},"destination_user_privileges":{"ignore_above":10000,"type":"keyword"},"destination_userid":{"ignore_above":10000,"type":"keyword"},"destination_username":{"ignore_above":10000,"type":"keyword"},"destination_vguest":{"ignore_above":10000,"type":"keyword"},"destination_vhost":{"ignore_above":10000,"type":"keyword"},"destination_vpc":{"ignore_above":10000,"type":"keyword"},"destination_vpn":{"ignore_above":10000,"type":"keyword"},"destination_zone":{"ignore_above":10000,"type":"keyword"},"device_class":{"ignore_above":10000,"type":"keyword"},"device_configuration":{"ignore_above":10000,"type":"keyword"},"device_custom_date_1":{"ignore_above":10000,"type":"keyword"},"device_custom_date_1_label":{"ignore_above":10000,"type":"keyword"},"device_custom_date_2":{"ignore_above":10000,"type":"keyword"},"device_custom_date_2_label":{"ignore_above":10000,"type":"keyword"},"device_custom_number_1":{"type":"long"},"device_custom_number_1_label":{"ignore_above":10000,"type":"keyword"},"device_custom_number_2":{"type":"long"},"device_custom_number_2_label":{"ignore_above":10000,"type":"keyword"},"device_custom_number_3":{"type":"long"},"device_custom_number_3_label":{"ignore_above":10000,"type":"keyword"},"device_direction":{"ignore_above":10000,"type":"keyword"},"device_dns_domain":{"ignore_above":10000,"type":"keyword"},"device_event_category":{"ignore_above":10000,"type":"keyword"},"device_external_id":{"ignore_above":10000,"type":"keyword"},"device_facility":{"ignore_above":10000,"type":"keyword"},"device_inbound_interface":{"ignore_above":10000,"type":"keyword"},"device_name":{"ignore_above":10000,"type":"keyword"},"device_nt_domain":{"ignore_above":10000,"type":"keyword"},"device_outbound_interface":{"ignore_above":10000,"type":"keyword"},"device_process_name":{"ignore_above":10000,"type":"keyword"},"device_sender_address":{"ignore_above":10000,"type":"keyword"},"device_sender_asset_id":{"ignore_above":10000,"type":"keyword"},"device_vendor":{"ignore_above":10000,"type":"keyword"},"dns_message":{"ignore_above":10000,"type":"keyword"},"dns_rcode":{"type":"long"},"dns_rrname":{"ignore_above":10000,"type":"keyword"},"dns_rrtype":{"ignore_above":10000,"type":"keyword"},"dns_server_address":{"ignore_above":10000,"type":"keyword"},"dns_ttl":{"ignore_above":10000,"type":"keyword"},"dns_type":{"ignore_above":10000,"type":"keyword"},"duration":{"ignore_above":10000,"type":"keyword"},"email_recipient":{"ignore_above":10000,"type":"keyword"},"email_relay":{"ignore_above":10000,"type":"keyword"},"email_sender":{"ignore_above":10000,"type":"keyword"},"email_subject":{"ignore_above":10000,"type":"keyword"},"environment_variable_key":{"ignore_above":10000,"type":"keyword"},"environment_variable_value":{"ignore_above":10000,"type":"keyword"},"error_code":{"ignore_above":10000,"type":"keyword"},"error_message":{"ignore_above":10000,"type":"keyword"},"event_action":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"event_activity":{"ignore_above":10000,"type":"keyword"},"event_attack_id":{"ignore_above":10000,"type":"keyword"},"event_attack_tactic":{"ignore_above":10000,"type":"keyword"},"event_attack_technique":{"ignore_above":10000,"type":"keyword"},"event_auth_action":{"ignore_above":10000,"type":"keyword"},"event_auth_role":{"ignore_above":10000,"type":"keyword"},"event_category":{"ignore_above":10000,"type":"keyword"},"event_cve":{"ignore_above":10000,"type":"keyword"},"event_description":{"ignore_above":10000,"type":"keyword"},"event_description_url":{"ignore_above":10000,"type":"keyword"},"event_group":{"ignore_above":10000,"type":"keyword"},"event_name":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"event_outcome":{"ignore_above":10000,"type":"keyword"},"event_priority":{"type":"long"},"event_receipt_time":{"type":"date"},"event_ref_date":{"ignore_above":10000,"type":"keyword"},"event_ref_score":{"ignore_above":10000,"type":"keyword"},"event_ref_source":{"ignore_above":10000,"type":"keyword"},"event_severity":{"ignore_above":10000,"type":"keyword"},"event_subcategory":{"ignore_above":10000,"type":"keyword"},"event_type":{"ignore_above":10000,"type":"keyword"},"event_violation":{"ignore_above":10000,"type":"keyword"},"expires":{"type":"boolean"},"external_id":{"ignore_above":10000,"type":"keyword"},"file_hash":{"ignore_above":10000,"type":"keyword"},"file_hash_algorithm":{"ignore_above":10000,"type":"keyword"},"file_hash_md5":{"ignore_above":10000,"type":"keyword"},"file_hash_sha1":{"ignore_above":10000,"type":"keyword"},"file_hash_sha256":{"ignore_above":10000,"type":"keyword"},"file_id":{"ignore_above":10000,"type":"keyword"},"file_kb_size":{"ignore_above":10000,"type":"keyword"},"file_modification_time":{"ignore_above":10000,"type":"keyword"},"file_name":{"ignore_above":10000,"type":"keyword"},"file_old_hash":{"ignore_above":10000,"type":"keyword"},"file_old_id":{"ignore_above":10000,"type":"keyword"},"file_old_modification_time":{"ignore_above":10000,"type":"keyword"},"file_old_name":{"ignore_above":10000,"type":"keyword"},"file_old_path":{"ignore_above":10000,"type":"keyword"},"file_old_permission":{"ignore_above":10000,"type":"keyword"},"file_old_size":{"ignore_above":10000,"type":"keyword"},"file_owner":{"ignore_above":10000,"type":"keyword"},"file_path":{"ignore_above":10000,"type":"keyword"},"file_permission":{"ignore_above":10000,"type":"keyword"},"file_type":{"ignore_above":10000,"type":"keyword"},"full_message":{"ignore_above":10000,"type":"keyword"},"gateway":{"ignore_above":10000,"type":"keyword"},"global_list_name":{"ignore_above":10000,"type":"keyword"},"global_list_value":{"ignore_above":10000,"type":"keyword"},"group_policy":{"ignore_above":10000,"type":"keyword"},"has_alarm":{"type":"boolean"},"highlight_fields":{"ignore_above":10000,"type":"keyword"},"http_hostname":{"ignore_above":10000,"type":"keyword"},"http_referer":{"ignore_above":10000,"type":"keyword"},"identity_group_name":{"ignore_above":10000,"type":"keyword"},"identity_host_name":{"ignore_above":10000,"type":"keyword"},"incident_id":{"ignore_above":10000,"type":"keyword"},"instance_ids":{"ignore_above":10000,"type":"keyword"},"instance_types":{"ignore_above":10000,"type":"keyword"},"iocs":{"ignore_above":10000,"type":"keyword"},"ip_addresses":{"ignore_above":10000,"type":"keyword"},"k8s_dns_policy":{"ignore_above":10000,"type":"keyword"},"k8s_node_name":{"ignore_above":10000,"type":"keyword"},"k8s_priority":{"ignore_above":10000,"type":"keyword"},"level":{"type":"long"},"log":{"index_options":"docs","norms":false,"type":"text"},"malware_family":{"ignore_above":10000,"type":"keyword"},"malware_variant":{"ignore_above":10000,"type":"keyword"},"matched_value":{"ignore_above":10000,"type":"keyword"},"needs_enrichment":{"type":"boolean"},"needs_internal_enrichment":{"type":"boolean"},"num_containers":{"ignore_above":10000,"type":"keyword"},"old_ip":{"ignore_above":10000,"type":"keyword"},"operating_system":{"ignore_above":10000,"type":"keyword"},"package_architecture":{"ignore_above":10000,"type":"keyword"},"package_name":{"ignore_above":10000,"type":"keyword"},"package_revision":{"ignore_above":10000,"type":"keyword"},"package_source":{"ignore_above":10000,"type":"keyword"},"package_version":{"ignore_above":10000,"type":"keyword"},"packet_data":{"ignore_above":10000,"type":"keyword"},"packet_payload":{"ignore_above":10000,"type":"keyword"},"packet_type":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"packets_received":{"type":"long"},"packets_sent":{"type":"long"},"peak_pps":{"type":"long"},"pefile_company":{"ignore_above":10000,"type":"keyword"},"pefile_description":{"ignore_above":10000,"type":"keyword"},"pefile_fileversion":{"ignore_above":10000,"type":"keyword"},"pefile_product":{"ignore_above":10000,"type":"keyword"},"plugin":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"plugin_device":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"plugin_device_type":{"ignore_above":10000,"type":"keyword"},"plugin_device_version":{"ignore_above":10000,"type":"keyword"},"plugin_enrichment_script":{"ignore_above":10000,"type":"keyword"},"plugin_family":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"plugin_parent":{"ignore_above":10000,"type":"keyword"},"plugin_rule":{"ignore_above":10000,"type":"keyword"},"plugin_version":{"ignore_above":10000,"type":"keyword"},"policy":{"ignore_above":10000,"type":"keyword"},"policy_address":{"ignore_above":10000,"type":"keyword"},"pre_authentication_type":{"ignore_above":10000,"type":"keyword"},"project_id":{"ignore_above":10000,"type":"keyword"},"protocol_version":{"ignore_above":10000,"type":"keyword"},"received_from":{"ignore_above":10000,"type":"keyword"},"registry_path":{"ignore_above":10000,"type":"keyword"},"registry_value":{"ignore_above":10000,"type":"keyword"},"relative_distinguished_name":{"ignore_above":10000,"type":"keyword"},"rep_dev_canonical":{"ignore_above":10000,"type":"keyword"},"rep_device_address":{"ignore_above":10000,"type":"keyword"},"rep_device_address_6":{"ignore_above":10000,"type":"keyword"},"rep_device_asset_id":{"ignore_above":10000,"type":"keyword"},"rep_device_fqdn":{"ignore_above":10000,"type":"keyword"},"rep_device_hostname":{"ignore_above":10000,"type":"keyword"},"rep_device_inbound_interface":{"ignore_above":10000,"type":"keyword"},"rep_device_instance_id":{"ignore_above":10000,"type":"keyword"},"rep_device_mac":{"ignore_above":10000,"type":"keyword"},"rep_device_model":{"ignore_above":10000,"type":"keyword"},"rep_device_outbound_interface":{"ignore_above":10000,"type":"keyword"},"rep_device_rule_id":{"ignore_above":10000,"type":"keyword"},"rep_device_type":{"ignore_above":10000,"type":"keyword"},"rep_device_vendor":{"ignore_above":10000,"type":"keyword"},"rep_device_version":{"ignore_above":10000,"type":"keyword"},"report_executed_date":{"type":"date"},"reputation_score":{"ignore_above":10000,"type":"keyword"},"request_content_type":{"ignore_above":10000,"type":"keyword"},"request_cookies":{"ignore_above":10000,"type":"keyword"},"request_http_version":{"ignore_above":10000,"type":"keyword"},"request_method":{"ignore_above":10000,"type":"keyword"},"request_referrer":{"ignore_above":10000,"type":"keyword"},"request_url":{"ignore_above":10000,"type":"keyword"},"request_user_agent":{"ignore_above":10000,"type":"keyword"},"resource_provider":{"ignore_above":10000,"type":"keyword"},"resource_uri":{"ignore_above":10000,"type":"keyword"},"response_code":{"type":"long"},"response_content_type":{"ignore_above":10000,"type":"keyword"},"return_value":{"ignore_above":10000,"type":"keyword"},"rule_id":{"ignore_above":10000,"type":"keyword"},"rule_uuid":{"ignore_above":10000,"type":"keyword"},"security_group_id":{"ignore_above":10000,"type":"keyword"},"security_group_name":{"ignore_above":10000,"type":"keyword"},"sensor_event_rate":{"type":"double"},"sensor_name":{"ignore_above":10000,"type":"keyword"},"sensor_uuid":{"ignore_above":10000,"type":"keyword"},"session":{"ignore_above":10000,"type":"keyword"},"shared_resource_name":{"ignore_above":10000,"type":"keyword"},"short_message":{"ignore_above":10000,"type":"keyword"},"silent":{"type":"boolean"},"source_account":{"ignore_above":10000,"type":"keyword"},"source_account_id":{"ignore_above":10000,"type":"keyword"},"source_account_name":{"ignore_above":10000,"type":"keyword"},"source_additional_hostnames":{"ignore_above":10000,"type":"keyword"},"source_address":{"ignore_above":10000,"type":"keyword"},"source_address_6":{"ignore_above":10000,"type":"keyword"},"source_asn":{"ignore_above":10000,"type":"keyword"},"source_asset_id":{"ignore_above":10000,"type":"keyword"},"source_blacklist_activity":{"ignore_above":10000,"type":"keyword"},"source_blacklist_priority":{"ignore_above":10000,"type":"keyword"},"source_blacklist_reliability":{"ignore_above":10000,"type":"keyword"},"source_canonical":{"ignore_above":10000,"type":"keyword"},"source_city":{"ignore_above":10000,"type":"keyword"},"source_country":{"ignore_above":10000,"type":"keyword"},"source_cpe":{"ignore_above":10000,"type":"keyword"},"source_datacenter":{"ignore_above":10000,"type":"keyword"},"source_datastore":{"ignore_above":10000,"type":"keyword"},"source_dns_domain":{"ignore_above":10000,"type":"keyword"},"source_fqdn":{"ignore_above":10000,"type":"keyword"},"source_hostname":{"ignore_above":10000,"type":"keyword"},"source_infrastructure_name":{"ignore_above":10000,"type":"keyword"},"source_infrastructure_type":{"ignore_above":10000,"type":"keyword"},"source_instance_id":{"ignore_above":10000,"type":"keyword"},"source_latitude":{"ignore_above":10000,"type":"keyword"},"source_location_id":{"ignore_above":10000,"type":"keyword"},"source_location_name":{"ignore_above":10000,"type":"keyword"},"source_longitude":{"ignore_above":10000,"type":"keyword"},"source_mac":{"ignore_above":10000,"type":"keyword"},"source_mac_vendor":{"ignore_above":10000,"type":"keyword"},"source_name":{"ignore_above":10000,"type":"keyword"},"source_nat_address":{"ignore_above":10000,"type":"keyword"},"source_nat_port":{"type":"long"},"source_netmask":{"ignore_above":10000,"type":"keyword"},"source_network":{"ignore_above":10000,"type":"keyword"},"source_ntdomain":{"ignore_above":10000,"type":"keyword"},"source_organisation":{"ignore_above":10000,"type":"keyword"},"source_port":{"type":"long"},"source_port_label":{"ignore_above":10000,"type":"keyword"},"source_post_nat_port":{"type":"long"},"source_pre_nat_port":{"type":"long"},"source_process":{"ignore_above":10000,"type":"keyword"},"source_process_commandline":{"ignore_above":10000,"type":"keyword"},"source_process_id":{"ignore_above":10000,"type":"keyword"},"source_process_parent":{"ignore_above":10000,"type":"keyword"},"source_process_parent_commandline":{"ignore_above":10000,"type":"keyword"},"source_process_parent_process_id":{"ignore_above":10000,"type":"keyword"},"source_region":{"ignore_above":10000,"type":"keyword"},"source_registered_country":{"ignore_above":10000,"type":"keyword"},"source_service_name":{"ignore_above":10000,"type":"keyword"},"source_translated_address":{"ignore_above":10000,"type":"keyword"},"source_translated_port":{"type":"long"},"source_user_email":{"ignore_above":10000,"type":"keyword"},"source_user_email_domain":{"ignore_above":10000,"type":"keyword"},"source_user_group":{"ignore_above":10000,"type":"keyword"},"source_user_id":{"ignore_above":10000,"type":"keyword"},"source_user_privileges":{"ignore_above":10000,"type":"keyword"},"source_userid":{"ignore_above":10000,"type":"keyword"},"source_username":{"ignore_above":10000,"type":"keyword"},"source_vhost":{"ignore_above":10000,"type":"keyword"},"source_vpc":{"ignore_above":10000,"type":"keyword"},"source_vpn":{"ignore_above":10000,"type":"keyword"},"source_workstation":{"ignore_above":10000,"type":"keyword"},"source_zone":{"ignore_above":10000,"type":"keyword"},"ssh_authorized_key":{"ignore_above":10000,"type":"keyword"},"ssh_client_proto":{"ignore_above":10000,"type":"keyword"},"ssh_client_software":{"ignore_above":10000,"type":"keyword"},"ssh_server_proto":{"ignore_above":10000,"type":"keyword"},"ssh_server_software":{"ignore_above":10000,"type":"keyword"},"stat_value":{"type":"long"},"status":{"ignore_above":10000,"type":"keyword"},"suppress_rule_id":{"ignore_above":10000,"type":"keyword"},"suppress_rule_name":{"ignore_above":10000,"type":"keyword"},"suppressed":{"eager_global_ordinals":true,"ignore_above":10000,"type":"keyword"},"syslog_source":{"ignore_above":10000,"type":"keyword"},"tag":{"ignore_above":10000,"type":"keyword"},"threat_intelligence_feed_name":{"ignore_above":10000,"type":"keyword"},"threat_intelligence_matched_metadata":{"ignore_above":10000,"type":"keyword"},"ticket_encryption_type":{"ignore_above":10000,"type":"keyword"},"timeStamp":{"ignore_above":10000,"type":"keyword"},"time_end":{"type":"date"},"time_offset":{"ignore_above":10000,"type":"keyword"},"time_start":{"type":"date"},"time_zone":{"ignore_above":10000,"type":"keyword"},"timestamp_arrived":{"type":"date"},"timestamp_end":{"type":"date"},"timestamp_occured":{"type":"date"},"timestamp_occured_iso8601":{"type":"date"},"timestamp_os":{"type":"date"},"timestamp_received":{"type":"date"},"timestamp_received_iso8601":{"type":"date"},"timestamp_start":{"type":"date"},"timestamp_to_storage":{"type":"date"},"tls_cipher":{"ignore_above":10000,"type":"keyword"},"tls_fingerprint":{"ignore_above":10000,"type":"keyword"},"tls_issuerdn":{"ignore_above":10000,"type":"keyword"},"tls_sni":{"ignore_above":10000,"type":"keyword"},"tls_subject":{"ignore_above":10000,"type":"keyword"},"tls_version":{"ignore_above":10000,"type":"keyword"},"total_disconnection_time":{"ignore_above":10000,"type":"keyword"},"total_packets":{"type":"long"},"transaction_status":{"ignore_above":10000,"type":"keyword"},"transient":{"type":"boolean"},"transport_protocol":{"ignore_above":10000,"type":"keyword"},"tty_terminal":{"ignore_above":10000,"type":"keyword"},"used_hint":{"type":"boolean"},"user_group_id":{"ignore_above":10000,"type":"keyword"},"user_policy":{"ignore_above":10000,"type":"keyword"},"user_realm":{"ignore_above":10000,"type":"keyword"},"user_resource":{"ignore_above":10000,"type":"keyword"},"user_resource_type":{"ignore_above":10000,"type":"keyword"},"user_role":{"ignore_above":10000,"type":"keyword"},"user_type":{"ignore_above":10000,"type":"keyword"},"uuid":{"ignore_above":10000,"type":"keyword"},"virtual_source_address":{"ignore_above":10000,"type":"keyword"},"virtual_source_name":{"ignore_above":10000,"type":"keyword"},"was_fuzzied":{"type":"boolean"},"was_guessed":{"type":"boolean"},"watchlist":{"ignore_above":10000,"type":"keyword"},"wireless_ap":{"ignore_above":10000,"type":"keyword"},"wireless_bssid":{"ignore_above":10000,"type":"keyword"},"wireless_channel":{"ignore_above":10000,"type":"keyword"},"wireless_encryption":{"ignore_above":10000,"type":"keyword"},"wireless_ssid":{"ignore_above":10000,"type":"keyword"},"x_att_tenantid":{"ignore_above":10000,"type":"keyword"}}},"timeStamp":{"ignore_above":10000,"type":"keyword"}}""")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wondering why putting so many fields here? same for the sample data

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hi @bowenlan-amzn , updated the mappings to only have necessary fields & updated sample data too.

@@ -116,8 +116,8 @@ class RollupIndexer(
it.aggregations.forEach {
when (it) {
is InternalSum -> aggResults[it.name] = it.value
is InternalMax -> aggResults[it.name] = it.value
is InternalMin -> aggResults[it.name] = it.value
is InternalMax -> if (it.value.isInfinite()) aggResults[it.name] = null else aggResults[it.name] = it.value
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The reason this was missed before is because the value of max/min in InternalMax/InternalMin is initialized in method reduce, and processed in doXContentBody before responding. However, the it.value we got here has not been processed by doXContentBody. This is easy to miss, can we add a comment here in case in the future we are adding more metrics and may miss again. like Need to redo the logic in corresponding doXContentBody https://github.com/opensearch-project/OpenSearch/blob/main/server/src/main/java/org/opensearch/search/aggregations/metrics/InternalMax.java#L101

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hi @bowenlan-amzn , i added a comment.

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
@bowenlan-amzn bowenlan-amzn merged commit 6cbe2f4 into opensearch-project:main Jul 28, 2023
opensearch-trigger-bot bot pushed a commit that referenced this pull request Jul 28, 2023
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
(cherry picked from commit 6cbe2f4)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
bowenlan-amzn pushed a commit that referenced this pull request Jul 28, 2023
…878)

(cherry picked from commit 6cbe2f4)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
tanqiuliu pushed a commit to tanqiuliu/index-management that referenced this pull request Sep 25, 2023
…rch-project#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
bowenlan-amzn added a commit that referenced this pull request Oct 11, 2023
* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
bowenlan-amzn added a commit to bowenlan-amzn/index-management that referenced this pull request Oct 11, 2023
* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (opensearch-project#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (opensearch-project#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (opensearch-project#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (opensearch-project#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (opensearch-project#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (opensearch-project#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (opensearch-project#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (opensearch-project#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (opensearch-project#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (opensearch-project#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (opensearch-project#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (opensearch-project#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (opensearch-project#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (opensearch-project#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (opensearch-project#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (opensearch-project#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (opensearch-project#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
bowenlan-amzn added a commit that referenced this pull request Oct 12, 2023
* [Feature] Support Transform as an ISM action (#760)

* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>

* [Test] increase the wait time after transform job triggered (#999)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: Tanqiu Liu <liutanqiu@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Joshua152 pushed a commit to Joshua152/index-management that referenced this pull request Dec 12, 2023
* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (opensearch-project#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (opensearch-project#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (opensearch-project#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (opensearch-project#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (opensearch-project#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (opensearch-project#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (opensearch-project#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (opensearch-project#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (opensearch-project#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (opensearch-project#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (opensearch-project#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (opensearch-project#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (opensearch-project#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (opensearch-project#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (opensearch-project#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (opensearch-project#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (opensearch-project#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>
bowenlan-amzn added a commit that referenced this pull request Dec 12, 2023
* Added minimum timeout for transforms search of 10 minutes

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Extracted cancel minimum code to function

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Fixed transform code to use cluster setting

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Removed log statements

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Changed timeout logic

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Switched to basing off seconds

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* [Feature] Support Transform as an ISM action (#760)

* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* [Test] increase the wait time after transform job triggered (#999)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Drafted 2.11 release notes. (#1004)

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Refactor change policy API and the policy in managed index to be non-null (#967)

* Refactor the policy to be non null in managed index config

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Update

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* fix bug

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Add more error notification at fail points (#1000)

* Add more error notification at fail points

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Handle exception gracefully

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* small fix

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* fix the race condition in test reset action start time (#1007)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Bump bwc version after 2.11 release (#1015)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* added type check for pipeline aggregator types in Transform initialization (#1014)

Signed-off-by: n-dohrmann <noah@dohrmann.org>
Co-authored-by: Joanne Wang <109310487+jowg-amazon@users.noreply.github.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Improve security plugin enabling check (#1017)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Onboard jenkins prod docker images to github actions (#1025)

* Onboard jenkins prod docker images to github actions

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

* Add more

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

* Add more

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

---------

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Support switch aliases in shrink action. (#987)

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: ikibo <oleg.kravchuk@logz.io>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Transform pipeline aggr test (#1027)

* tester code: pipeline aggr. transform job

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* made test case for pipeline aggregator in transform job

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* removed unnec. test lines

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* re-added method call on Transform obj

Signed-off-by: n-dohrmann <noah@dohrmann.org>

---------

Signed-off-by: n-dohrmann <noah@dohrmann.org>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added unit test for switchAliases method. (#1035)

* Added unit test for switchAliases method.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* Added unit test for switchAliases method checking the flow when switchAliases is disabled.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

---------

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036)

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added minimum for search.cancel_after_time_interval setting for rollups (#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added constant for cancel_after_time_interval for rollup search

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Handled case of default value for cancel interval

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added comment explanation for default rollup cancel after time interval

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Fixed github workflow checks

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

---------

Signed-off-by: Joshua Au <joshuahyau@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Update 2.11.1 release note (#1042)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Interval schedule should take start time from the request, should not… (#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed styling

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

---------

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Removed unused imports

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

---------

Signed-off-by: Joshua Au <joshuahyau@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: n-dohrmann <noah@dohrmann.org>
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: Tanqiu Liu <liutanqiu@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Co-authored-by: n-dohrmann <87952011+n-dohrmann@users.noreply.github.com>
Co-authored-by: Joanne Wang <109310487+jowg-amazon@users.noreply.github.com>
Co-authored-by: Peter Zhu <zhujiaxi@amazon.com>
Co-authored-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: ikibo <oleg.kravchuk@logz.io>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Dec 12, 2023
* Added minimum timeout for transforms search of 10 minutes

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Extracted cancel minimum code to function

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Fixed transform code to use cluster setting

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Removed log statements

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Changed timeout logic

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Switched to basing off seconds

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* [Feature] Support Transform as an ISM action (#760)

* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* [Test] increase the wait time after transform job triggered (#999)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Drafted 2.11 release notes. (#1004)

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Refactor change policy API and the policy in managed index to be non-null (#967)

* Refactor the policy to be non null in managed index config

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Update

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* fix bug

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Add more error notification at fail points (#1000)

* Add more error notification at fail points

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Handle exception gracefully

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* small fix

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* fix the race condition in test reset action start time (#1007)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Bump bwc version after 2.11 release (#1015)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* added type check for pipeline aggregator types in Transform initialization (#1014)

Signed-off-by: n-dohrmann <noah@dohrmann.org>
Co-authored-by: Joanne Wang <109310487+jowg-amazon@users.noreply.github.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Improve security plugin enabling check (#1017)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Onboard jenkins prod docker images to github actions (#1025)

* Onboard jenkins prod docker images to github actions

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

* Add more

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

* Add more

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

---------

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Support switch aliases in shrink action. (#987)

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: ikibo <oleg.kravchuk@logz.io>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Transform pipeline aggr test (#1027)

* tester code: pipeline aggr. transform job

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* made test case for pipeline aggregator in transform job

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* removed unnec. test lines

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* re-added method call on Transform obj

Signed-off-by: n-dohrmann <noah@dohrmann.org>

---------

Signed-off-by: n-dohrmann <noah@dohrmann.org>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added unit test for switchAliases method. (#1035)

* Added unit test for switchAliases method.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* Added unit test for switchAliases method checking the flow when switchAliases is disabled.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

---------

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036)

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added minimum for search.cancel_after_time_interval setting for rollups (#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added constant for cancel_after_time_interval for rollup search

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Handled case of default value for cancel interval

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added comment explanation for default rollup cancel after time interval

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Fixed github workflow checks

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

---------

Signed-off-by: Joshua Au <joshuahyau@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Update 2.11.1 release note (#1042)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Interval schedule should take start time from the request, should not… (#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed styling

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

---------

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Removed unused imports

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

---------

Signed-off-by: Joshua Au <joshuahyau@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: n-dohrmann <noah@dohrmann.org>
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: Tanqiu Liu <liutanqiu@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Co-authored-by: n-dohrmann <87952011+n-dohrmann@users.noreply.github.com>
Co-authored-by: Joanne Wang <109310487+jowg-amazon@users.noreply.github.com>
Co-authored-by: Peter Zhu <zhujiaxi@amazon.com>
Co-authored-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: ikibo <oleg.kravchuk@logz.io>
(cherry picked from commit 60a8513)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
jowg-amazon added a commit that referenced this pull request Dec 12, 2023
)

* Added minimum timeout for transforms search of 10 minutes



* Extracted cancel minimum code to function



* Fixed transform code to use cluster setting



* Removed log statements



* Changed timeout logic



* Switched to basing off seconds



* [Feature] Support Transform as an ISM action (#760)

* Initial impl



* fix style



* end to end functional



* ISM transform unit tests & integ tests



* Fix after core #8157 (#857)



* Upgrade the backport workflow (#862)




* Added 2.9 release notes. (#851)

* Added 2.9 release notes.



* Added 2.9 release notes.



* Added 2.9 release notes.



---------




* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.



* unit test



---------





* Fix core XcontentType refactor (#873)




* fix for max & min aggregations when no metric property exist (#870)




* core refactor change (#884)




* update backport branch name (#885)




* core refactor change (#887)




* Fix breaking change by core refactor (#888)




* fix core breaking (#906)




* Support copy alias in rollover (#907)

* Support copy alias in rollover



* 2.10



---------




* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index



* Use _primary_first instead



---------




* Add primary first preference to all search requests (#912)



* fix intelliJ IDEA gradle sync error (#916)




* make control center index as system index (#919)




* Updates demo certs used in integ tests (#921)




* Added 2.10 release notes (#925)




* Bump bwc version (#930)




* fix integ tests; upgrade mappings versions



* Fix DCO



* Addressed pr comments; Add integ test case for re-execute the same transform action



* Addressed detekt error



* Added ISMTransform writeable test



* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase



---------




















* [Test] increase the wait time after transform job triggered (#999)




* Drafted 2.11 release notes. (#1004)

* Drafted 2.11 release notes.



* Drafted 2.11 release notes.



---------




* Refactor change policy API and the policy in managed index to be non-null (#967)

* Refactor the policy to be non null in managed index config



* Update



* fix bug



---------




* Add more error notification at fail points (#1000)

* Add more error notification at fail points



* Handle exception gracefully



* small fix



---------




* fix the race condition in test reset action start time (#1007)




* Bump bwc version after 2.11 release (#1015)




* added type check for pipeline aggregator types in Transform initialization (#1014)





* Improve security plugin enabling check (#1017)




* Onboard jenkins prod docker images to github actions (#1025)

* Onboard jenkins prod docker images to github actions



* Add more



* Add more



---------




* Support switch aliases in shrink action. (#987)





* Transform pipeline aggr test (#1027)

* tester code: pipeline aggr. transform job



* made test case for pipeline aggregator in transform job



* removed unnec. test lines



* re-added method call on Transform obj



---------




* Added unit test for switchAliases method. (#1035)

* Added unit test for switchAliases method.



* Added unit test for switchAliases method checking the flow when switchAliases is disabled.



---------




* Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036)




* Added minimum for search.cancel_after_time_interval setting for rollups (#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups



* Added constant for cancel_after_time_interval for rollup search



* Handled case of default value for cancel interval



* Added comment explanation for default rollup cancel after time interval



* Fixed github workflow checks



---------





* Update 2.11.1 release note (#1042)




* Interval schedule should take start time from the request, should not… (#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.



* Changed the "delayed continuous execution test" to be more expressive about what it should test.



* fixed the NPE if schedule.startTime is NULL



* fixed the NPE if schedule.startTime is NULL



* fixed styling



* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test



---------




* Removed unused imports



---------




























(cherry picked from commit 60a8513)

Signed-off-by: Joshua Au <joshuahyau@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: n-dohrmann <noah@dohrmann.org>
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Tanqiu Liu <liutanqiu@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Co-authored-by: n-dohrmann <87952011+n-dohrmann@users.noreply.github.com>
Co-authored-by: Joanne Wang <109310487+jowg-amazon@users.noreply.github.com>
Co-authored-by: Peter Zhu <zhujiaxi@amazon.com>
Co-authored-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: ikibo <oleg.kravchuk@logz.io>
Joshua152 pushed a commit to Joshua152/index-management that referenced this pull request Dec 22, 2023
* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (opensearch-project#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (opensearch-project#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (opensearch-project#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (opensearch-project#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (opensearch-project#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (opensearch-project#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (opensearch-project#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (opensearch-project#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (opensearch-project#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (opensearch-project#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (opensearch-project#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (opensearch-project#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (opensearch-project#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (opensearch-project#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (opensearch-project#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (opensearch-project#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (opensearch-project#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Joshua152 added a commit to Joshua152/index-management that referenced this pull request Dec 22, 2023
…-project#1033)

* Added minimum timeout for transforms search of 10 minutes

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Extracted cancel minimum code to function

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Fixed transform code to use cluster setting

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Removed log statements

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Changed timeout logic

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Switched to basing off seconds

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* [Feature] Support Transform as an ISM action (opensearch-project#760)

* Initial impl

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix style

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* end to end functional

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix after core #8157 (opensearch-project#857)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Upgrade the backport workflow (opensearch-project#862)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.9 release notes. (opensearch-project#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Handle NPE in isRollupIndex (opensearch-project#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

* unit test

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>

---------

Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix core XcontentType refactor (opensearch-project#873)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix for max & min aggregations when no metric property exist (opensearch-project#870)

Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#884)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* update backport branch name (opensearch-project#885)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* core refactor change (opensearch-project#887)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix breaking change by core refactor (opensearch-project#888)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix core breaking (opensearch-project#906)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Support copy alias in rollover (opensearch-project#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* 2.10

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Set preference to _primary when searching control-center index (opensearch-project#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <gbinlong@amazon.com>

* Use _primary_first instead

Signed-off-by: gaobinlong <gbinlong@amazon.com>

---------

Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Add primary first preference to all search requests (opensearch-project#912)

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix intelliJ IDEA gradle sync error (opensearch-project#916)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* make control center index as system index (opensearch-project#919)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Updates demo certs used in integ tests (opensearch-project#921)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added 2.10 release notes (opensearch-project#925)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Bump bwc version (opensearch-project#930)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Fix DCO

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>

---------

Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* [Test] increase the wait time after transform job triggered (opensearch-project#999)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Drafted 2.11 release notes. (opensearch-project#1004)

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Refactor change policy API and the policy in managed index to be non-null (opensearch-project#967)

* Refactor the policy to be non null in managed index config

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Update

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* fix bug

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Add more error notification at fail points (opensearch-project#1000)

* Add more error notification at fail points

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Handle exception gracefully

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* small fix

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* fix the race condition in test reset action start time (opensearch-project#1007)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Bump bwc version after 2.11 release (opensearch-project#1015)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* added type check for pipeline aggregator types in Transform initialization (opensearch-project#1014)

Signed-off-by: n-dohrmann <noah@dohrmann.org>
Co-authored-by: Joanne Wang <109310487+jowg-amazon@users.noreply.github.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Improve security plugin enabling check (opensearch-project#1017)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Onboard jenkins prod docker images to github actions (opensearch-project#1025)

* Onboard jenkins prod docker images to github actions

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

* Add more

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

* Add more

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>

---------

Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Support switch aliases in shrink action. (opensearch-project#987)

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: ikibo <oleg.kravchuk@logz.io>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Transform pipeline aggr test (opensearch-project#1027)

* tester code: pipeline aggr. transform job

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* made test case for pipeline aggregator in transform job

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* removed unnec. test lines

Signed-off-by: n-dohrmann <noah@dohrmann.org>

* re-added method call on Transform obj

Signed-off-by: n-dohrmann <noah@dohrmann.org>

---------

Signed-off-by: n-dohrmann <noah@dohrmann.org>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added unit test for switchAliases method. (opensearch-project#1035)

* Added unit test for switchAliases method.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* Added unit test for switchAliases method checking the flow when switchAliases is disabled.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

---------

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Interval schedule should take start time from the request, should not set it to the current time of request execution. (opensearch-project#1036)

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added minimum for search.cancel_after_time_interval setting for rollups (opensearch-project#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added constant for cancel_after_time_interval for rollup search

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Handled case of default value for cancel interval

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Added comment explanation for default rollup cancel after time interval

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Fixed github workflow checks

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

---------

Signed-off-by: Joshua Au <joshuahyau@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Update 2.11.1 release note (opensearch-project#1042)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Interval schedule should take start time from the request, should not… (opensearch-project#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* fixed styling

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>

---------

Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Signed-off-by: Joshua Au <joshuahyau@gmail.com>

* Removed unused imports

Signed-off-by: Joshua Au <joshuahyau@gmail.com>

---------

Signed-off-by: Joshua Au <joshuahyau@gmail.com>
Signed-off-by: Tanqiu Liu <liutanqiu@gmail.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: Bryce Lampe <brycelampe@gmail.com>
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: gaobinlong <gbinlong@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: n-dohrmann <noah@dohrmann.org>
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
Signed-off-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: Tanqiu Liu <liutanqiu@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
Co-authored-by: AWSHurneyt <hurneyt@amazon.com>
Co-authored-by: Bryce Lampe <brycelampe@gmail.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Co-authored-by: gaobinlong <gbl_long@163.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Co-authored-by: n-dohrmann <87952011+n-dohrmann@users.noreply.github.com>
Co-authored-by: Joanne Wang <109310487+jowg-amazon@users.noreply.github.com>
Co-authored-by: Peter Zhu <zhujiaxi@amazon.com>
Co-authored-by: Oleg Kravchuk <oleg.ikibo@gmail.com>
Co-authored-by: ikibo <oleg.kravchuk@logz.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants