Version 0.6.0

What's Changed

• Translate PPL dedup Command Part 1: allowedDuplication=1 by @LantaoJin in #521
• Bump Flint version to 0.6.0 by @penghuo in #542
• Some fixes for the README by @salyh in #546
• Add statement timeout by @noCharger in #539
• Remove query rewrite for LogsTable skipping index by @seankao-az in #552
• Fix refresh policy back to WAIT_FOR other than writing query result by @ykmr1224 in #554
• Lateral eval expressions are supported after Spark upgrading by @LantaoJin in #544
• Add rate limiter for bulk request by @ykmr1224 in #567
• Abstract service for accessing Flint index metadata by @seankao-az in #495
• Update PPL describe command by @YANG-DB in #573
• Implement stddev_samp and stddev_pop ppl stats function by @salyh in #549
• Top & Rare PPL commands support by @YANG-DB in #568
• Nested fields query fix by @YANG-DB in #564
• Add percentile PPL function by @salyh in #547
• Add conf for specifying flint checkpoint location by @noCharger in #577
• Fix distinct_count ppl stats function by @salyh in #548
• Retry bulk request to OpenSearch by @ykmr1224 in #572
• PPL Parse command by @YANG-DB in #595
• [Refactor] Extend REPL to support external metadata storage and data storage by @noCharger in #381
• Add support of GroK command including default patterns by @YANG-DB in #598
• Add UT and IT for 2+ level aggregations PPL command by @LantaoJin in #603
• Translate PPL dedup Command Part 2: allowedDuplication>1 by @LantaoJin in #543
• Remove checkpoint folder when vacuuming index by @dai-chen in #621
• Update checkpoint location on alter path by @noCharger in #616
• Refactor FlintJob with FlintStatement and StatementExecutionManager by @noCharger in #635
• Ppl patterns command by @YANG-DB in #627
• Disable timeout params for deleteIndex API only for serverless by @ykmr1224 in #646
• ispresent implemented as function by @lukasz-soszynski-eliatra in #651
• Add coalesce PPL command by @salyh in #609
• Fix ppl describe bug #612 by @YANG-DB in #656
• Add langType to FlintStatement model by @noCharger in #664
• Translate PPL join Command by @LantaoJin in #630
• Add support for serializing TimestampNTZType by @engechas in #673
• Isempty by @lukasz-soszynski-eliatra in #676
• Optional support for getAllIndexMetadata by index pattern by @seankao-az in #682
• Introduce async query scheduler by @noCharger in #668
• Add resultIndex to session manager extension by @noCharger in #689
• Support Fields Minus Command by @LantaoJin in #698
• Translate PPL LOOKUP Command by @LantaoJin in #686
• Import Lombok and override the equals and hashCode methods for expression and plan nodes by @LantaoJin in #703
• Implementation of case function. by @lukasz-soszynski-eliatra in #695
• Add explain command by @kt-eliatra in #687
• [REFACTOR] Move DF reformat from StatementExecutionManagerImpl to QueryResultWriterImpl by @noCharger in #701
• Re-select an excluded field should throw SyntaxCheckException by @LantaoJin in #707
• Support InSubquery in PPL by @LantaoJin in #714
• Antler syntax extensions related ot signum function. by @lukasz-soszynski-eliatra in #652
• Add rename PPL function by @kt-eliatra in #618
• update documentation with examples comment specifications markdown pages by @YANG-DB in #743
• update docs & links & add planned commands docs with process suggestion by @YANG-DB in #745
• Implement isBlank by @salyh in #749
• Fillnull command introduced by @lukasz-soszynski-eliatra in #723
• update MAINTAINERS.md by @YANG-DB in #756
• update code-owners by @YANG-DB in #761
• Support ScalarSubquery PPL by @LantaoJin in #752
• AND should have higher precedence than OR in predicate expression by @LantaoJin in #771
• Support table identifier contains dot with backticks by @LantaoJin in #768
• Support ExistsSubquery in PPL by @LantaoJin in #769
• Support recovery for index with external scheduler by @noCharger in #717
• Add auth-crt lib as runtime dependency by @noCharger in #778
• Lazy clean up dangling index metadata log entry by @dai-chen in #558
• [Infrastructure] Move style check ahead of Integ test by @LantaoJin in #783
• Support RelationSubquery PPL by @LantaoJin in #775
• Refactor datetime functions docs and IT by @LantaoJin in #787
• Add check list in pull request template by @LantaoJin in #794
• Support line comment and block comment in PPL by @LantaoJin in #792
• Implement Cryptographic hash functions by @Gokul-Radhakrishnan in #788
• Add query execution metrics by @ykmr1224 in #799
• Add Tomo as maintainer by @noCharger in #807
• Resolution for previous concurrency issue by @noCharger in #802
• Support alter refresh interval on external scheduler by @noCharger in #801
• Support PPL JSON functions: construction and extraction by @LantaoJin in #780
• PPL fieldsummary command by @YANG-DB in #766
• Add read/write bytes metrics by @ykmr1224 in #803
• Support Eventstats in PPL by @LantaoJin in #800
• Add checkpoint.delete.processingTime metric by @ykmr1224 in #817
• Add opensearch related metrics by @ykmr1224 in #818
• Fix copyright header missing by @LantaoJin in #813
• All-fields as an argument of aggregator such as count() can be resolved after other field by @LantaoJin in #814
• Support IN expression in PPL by @LantaoJin in #823
• Fix the issue that missing identifiers from ANTLR keywords by @LantaoJin in #821
• Add PPL Between functionality by @dr-lilienthal in #758
• Fillnull command documentation by @lukasz-soszynski-eliatra in #815
• Write metadata cache data to mappings _meta with refresh time update by @seankao-az in #805
• Add index state metrics by @ykmr1224 in #825
• PPL cidr function by @salyh in #706
• Optimize prepareStatementExecution request freq by @noCharger in #828
• Add external scheduler metrics by @ykmr1224 in #827
• Add functions DATE_ADD, DATE_SUB, TIMESTAMPADD, TIMESTAMPDIFF, CURRENT_TIMEZONE and UTC_TIMESTAMP by @LantaoJin in #839
• Refactor CatalystQueryPlanVisitor into distinct Plan & Expression visitors by @YANG-DB in #852
• PPl flatten command by @lukasz-soszynski-eliatra in #784
• Extract source table names from mv query by @seankao-az in #854
• Fallback to internal scheduler when index creation failed by @noCharger in #850
• New trendline ppl command (SMA only) by @salyh in #833
• cidrmatch ppl command add logical tests and docs by @YANG-DB in #865
• Support Lambda and add related array functions by @qianheng-aws in #864
• [followup] Refactor JSON function and add TO_JSON_STRING, ARRAY_LENGHT functions by @LantaoJin in #870
• Join side aliases should be optional by @LantaoJin in #862
• [Backport 0.6] Fix bug for not able to get sourceTables from metadata by @opensearch-trigger-bot in #894
• [Backport 0.6] Apply shaded rules by @opensearch-trigger-bot in #892
• [Backport 0.6] Expand ppl command by @opensearch-trigger-bot in #895
• [Backport 0.6] Add jvmGCTime metrics by @opensearch-trigger-bot in #899
• [Backport 0.6] Add query count per session metric by @opensearch-trigger-bot in #900
• [Backport 0.6] Add metrics for query types by @opensearch-trigger-bot in #901
• [Backport 0.6] Fix build issue due to import by @opensearch-trigger-bot in #904
• [Backport 0.6] New trendline ppl command (WMA) by @opensearch-trigger-bot in #907
• [Backport 0.6] Support parenthesized expression in filter (#888) by @LantaoJin in #905
• [Backport 0.6] replace loading of grok patterns to hard coded by @opensearch-trigger-bot in #909
• [Backport 0.6] Add metrics for successful/failed Spark index creation by @opensearch-trigger-bot in #917
• [Backport 0.6] Support UnrecoverableException by @opensearch-trigger-bot in #916
• [Backport 0.6] Temporarily support 4+ parts table identifier by @opensearch-trigger-bot in #919
• [Backport 0.6] Temp fix for table name more than 3 parts by @opensearch-trigger-bot in #924
• [Backport 0.6] Support alter from manual to auto without specifying scheduler mode by @opensearch-trigger-bot in #933
• [Backport 0.6] Support flatten with alias by @opensearch-trigger-bot in #935
• [Backport 0.6] Add support for serializing MapType by @opensearch-trigger-bot in #939
• [Backport 0.6] [Bugfix]Record statement execution error by @opensearch-trigger-bot in #941
• [Backport 0.6] Rethrow exception in writeData() by @opensearch-trigger-bot in #945

New Contributors

• @salyh made their first contribution in #546
• @lukasz-soszynski-eliatra made their first contribution in #651
• @kt-eliatra made their first contribution in #687
• @Gokul-Radhakrishnan made their first contribution in #788
• @dr-lilienthal made their first contribution in #758

Full Changelog: v0.5.0...v0.6.0