Field formatting disappears sporadically

[yoavderazon]

Kibana version: 6.2.3

Elasticsearch version:6.2.3

Server OS version: on cloud

Browser version: Firefox on mac - latest ver

Browser OS version: MacOS, latest ver.

Original install method (e.g. download page, yum, from source, etc.): # NA

Description of the problem including expected versus actual behavior:
Occasionally, my date, number and other formats get deleted from the index pattern.
sometimes all of them, and sometimes just few of them.
env. where this happens is https://ef50dfd8dac67b1fab5ee7ec666007a8.us-east-1.aws.found.io:9243, and i can provide access if needed.

Steps to reproduce:

1. unable to reliably reproduce this, but it happens frequently (every day or two, with daily engagement in kibana of creating visualizations and dashboards)

Errors in browser console (if relevant): # NA

Provide logs and/or server output (if relevant): # NA

[yoavderazon]

@AlonaNadler , @nestermn , @chrisronline

[chrisronline]

@yoavderazon This feels related to #7191. Thoughts?

cc @jen-huang

[AlonaNadler]

@chrisronline I'm not sure it's the same problem, Yoav and I worked on his cluster and formatted a few fields, using number.js formatting 0,0a, we saw the changes were updated and all the visualizations refreshed with the new formatting, 15 min later without know reason Kibana reset all the formatting. There wasn't any conflict at the time. #7191 is a different known issue where scripted fields doesn't handler conflicts so if multiple users try to update the same scripted fields they will override each other.

[chrisronline]

@AlonaNadler Is it possible someone else is using the same kibana instance at the same time? Or can we safely assume there is only one user using it at a time and this bug occurs while only one user is active?

[yoavderazon]

i have a confirmation from @nestermn that he was not loading any data or making any changes at the time.
is your question about "using kibana" also involve juts looking at dashboards and discover ?

[chrisronline]

Just actions that would write to the kibana index, editing or adding a saved object. It's sounding like this might be a separate issue but I honestly haven't heard this before but I'll see if I can look deeper and figure something out

[yoavderazon]

if there is a "debug level logging" setting for kibana that may help you - we can enable it - just let us know.

[alexfrancoeur]

Would we run into this problem if multiple tabs are opened and a modification is made in one that writes to the .kibana index? I wonder if having multiple sessions, one of which made the change to the scripted field and another that does not is potentially causing these issues. If I recall correctly, you had multiple tabs open @yoavderazon

[yoavderazon]

i didnt find a (productive) way to work with kibana without multiple tabs open, but i am careful not to perform index-patter related operation in more than one tab. if ANY kibana operation (e.g. creating new vis. or dash.) constitutes a tab-concurrency issue - than i think we have a practical problem here.

[yoavderazon]

@chrisronline ,
I keep losing my formats, which messes up the entire set of dashboards that we put together.
I have spent countless hours (this is not an exaggeration) updating the date formats over and over again.

thanks
Yoav

[yoavderazon]

@chrisronline ,
@nestermn and i were able to reliably reproduce the issue and recorded a zoom session showing the experience. for this we wrote a script that applies the desired formats on all fields, ran it, and then refreshed the index on the other browser session - which made it disappear.

cc: @AlonaNadler , @alexfrancoeur