Optimize tsdb data stream timestamp parsing if ingest pipeline is used #84046
Labels
:Data Management/Data streams
Data streams and their lifecycles
>enhancement
Team:Data Management
Meta label for data/management team
For tsdb data streams, the
@timestamp
field is used to determine to which backing index a data stream resolves to.Currently in
IndexAbstraction.DataStream#getWriteIndex(...)
the source of the document is parsed in order to extract the@timestamp
field. If an ingest pipeline is active then this parsing is redundant, because ingest parse the source of a document to into a map of maps in order for a pipeline to process it.After the final pipeline has executed, ingest can extract the
@timestamp
field and attach it as String/Long to theIndexRequest
class as a field. ThenIndexAbstraction.DataStream#getWriteIndex(...)
can check for whether that field has been set and if so use that parse it into aInstant
instance.The text was updated successfully, but these errors were encountered: