How to configure Time_Format to parse UNIX timestamp in miliseconds?

[gajus]

I am using Roarr JSON logger, which produces logs in the following format:

{
  "context": {
    "application": "contra-web-app",
    "namespace": "server",
    "logLevel": 10
  },
  "message": "render page time 23 ms",
  "sequence": "1285",
  "time": 1670267708402,
  "version": "2.0.0",
  "severity": "DEBUG"
}

It is not clear when reading parser configuration how to configure Time_Format given that it asks to specify format compatible with strptime, and the latter does not have format for milliseconds.

I see that the documentation includes section about fractional seconds, but it only mentions nanoseconds and not milliseconds:

In addition, we extended our time resolution to support fractional seconds like 2017-05-17T15:44:31**.187512963**Z. Since Fluent Bit v0.12 we have full support for nanoseconds resolution, the %L format option for Time_Format is provided as a way to indicate that content must be interpreted as fractional seconds.

I tried %s%L, but didn't have the desired effect.

https://docs.fluentbit.io/manual/pipeline/parsers/configuring-parser

[fovgrubby128]

bump up! Not sure how you solve it in the end...

[jmtt89]

it's not posible, the easiest fix is modifying you server to generate date with toISOString() and use %Y-%m-%dT%H:%M:%S.%LZ

another option i found is use a lua script for preformat the time field.

[selmison]

A way is: %s.%L

Notice this comment:

Since strptime(3) does not support fractional seconds, this
requires a workaround/hack in our parser. This is a known
issue and addressed in different ways in other languages.

The following links are a good reference:

• http://stackoverflow.com/questions/7114690/how-to-parse-syslog-timestamp
• http://code.activestate.com/lists/python-list/521885

[lake2]

A way is: %s.%L

Notice this comment:

Since strptime(3) does not support fractional seconds, this
requires a workaround/hack in our parser. This is a known
issue and addressed in different ways in other languages.
The following links are a good reference:

• http://stackoverflow.com/questions/7114690/how-to-parse-syslog-timestamp
• http://code.activestate.com/lists/python-list/521885

It's not working

[lake2]

same issue +1