You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description:
We propose adding a fillnull command to OpenSearch's Piped Processing Language (PPL) to provide a convenient way to handle null or missing values in query results. This feature would be similar to the fillnull command in Splunk's SPL, enhancing PPL's data cleaning and preparation capabilities.
Proposed Functionality:
The 'fillnull' command should allow users to replace null values with a specified value.
It should support filling nulls for specific fields or all fields.
The command should allow different fill values for different fields.
It should support conditional filling based on other field values or expressions.
Example Usage:
... | fillnull value=0
This would replace all null values in all fields with 0.
... | fillnull value=N/A field1, field2
This would replace null values in field1 and field2 with "N/A".
Description:
We propose adding a
fillnull
command to OpenSearch's Piped Processing Language (PPL) to provide a convenient way to handle null or missing values in query results. This feature would be similar to thefillnull
command in Splunk's SPL, enhancing PPL's data cleaning and preparation capabilities.Proposed Functionality:
Example Usage:
This would replace all null values in all fields with 0.
This would replace null values in field1 and field2 with "N/A".
This would fill null values in different fields with different values.
This example uses
eval
to create a new field (or overwrite an existing one) based on a condition, and then usefillnull
to handle the null valuesThis example uses multiple eval expressions to handle different conditions for multiple fields, followed by fillnull
implementation Considerations:
Support for PPL
fillnull
functionality is required for both:OpenSearch based PPL engine
fillnull
command to PPL #3032Spark based PPL engine
fillnull
command to PPL opensearch-spark#670The text was updated successfully, but these errors were encountered: