generate timestamp when path is null

[khoan]

Shouldn't timestamp be generated when value of path is null ?

Mapping definition:

curl -X PUT  http://localhost:9200/twitter/ -d '{
    "mappings": {
        "_default_": {
            "_timestamp" : {
                "enabled" : "yes",
                "store": "yes",
                "path" : "post_date"
            },
            "properties": {
                "message": {
                    "type": "string"
                }
            }
        }
    }
}'

Get error when:

curl -X PUT http://127.0.0.1:9200/twitter/tweet/123 -d '{
  message: "bam bam"
}'

=>  {"error":"ElasticSearchParseException[failed to parse doc to extract routing/timestamp]; nested: TimestampParsingException[failed to parse timestamp [null]]; ","status":400}

curl -X PUT http://127.0.0.1:9200/twitter/tweet/123 -d '{
  message: "bam bam",
  post_date: "2009-11-15T14:12:12Z"
}'

=> {"ok":true,"_index":"twitter","_type":"tweet","_id":"123","_version":1}

[clintongormley]

This should probably be an option that can be turned on, so that bad data isn't silently ignored.

[dadoonet]

@clintongormley Where should we put that new option? Index settings? Mapping? Other?
Which name should we use: ignore_missing_timestamp or so?

[dadoonet]

The more I think about it, the more I think we should define for _timestamp field a new option named default. default could be: now (by default) or a date which respect the format format or null.

I remember a use case on the mailing list where the user does not have a value for every document so I'd like to set it to 01/01/1970.

The new _timestamp field would look like this:

{
    "tweet" : {
        "_timestamp" : {
            "enabled" : true,
            "path" : "post_date",
            "format" : "YYYY-MM-dd",
            "default" : "1970-01-01"
        }
    }
}

Or

{
    "tweet" : {
        "_timestamp" : {
            "enabled" : true,
            "path" : "post_date",
            "format" : "YYYY-MM-dd",
            "default" : "now"
        }
    }
}

Or

{
    "tweet" : {
        "_timestamp" : {
            "enabled" : true,
            "path" : "post_date",
            "format" : "YYYY-MM-dd",
            "default" : null
        }
    }
}

WDYT?

[clintongormley]

Sounds reasonable to me

[dadoonet]

PR Opened #7036.