Imported beats dashboards are missing visualizations.

[bhavyarm]

• Version: master

Some of the imported beats dashboards are missing visualizations. There is no warning or error shown to the user that this is happening.

Its happening with metricbeats and filebeats dashboards from unified snapshot build from: #5​34 Jun 27, 2018 7:38 AM

I also logged an associated Kibana bug because we couldn't open the dashboards to view:
elastic/kibana#20308

My log for loading dashboards:

Thu, Jun 28, 2018  1:52:33 PM Load metricbeat index patterns, saves searches, visualizations, and dashboards
++ [[ 7.0.0-alpha1 > 6 ]]
++ /c/windowsInstalls/7.0.0-alpha1/metricbeat/metricbeat setup -e -c /c/windowsInstalls/7.0.0-alpha1/metricbeat/metricbeat.yml
2018-06-28T13:52:34.138Z	INFO	instance/beat.go:533	Home path: [C:\windowsInstalls\7.0.0-alpha1\metricbeat] Config path: [C:\windowsInstalls\7.0.0-alpha1\metricbeat] Data path: [C:\windowsInstalls\7.0.0-alpha1\metricbeat\data] Logs path: [C:\windowsInstalls\7.0.0-alpha1\metricbeat\logs]
2018-06-28T13:52:34.226Z	INFO	instance/beat.go:540	Beat UUID: 9ca96abe-15c1-4c29-9bd9-8395b927f68e
2018-06-28T13:52:34.227Z	INFO	[beat]	instance/beat.go:757	Beat info	{"system_info": {"beat": {"path": {"config": "C:\\windowsInstalls\\7.0.0-alpha1\\metricbeat", "data": "C:\\windowsInstalls\\7.0.0-alpha1\\metricbeat\\data", "home": "C:\\windowsInstalls\\7.0.0-alpha1\\metricbeat", "logs": "C:\\windowsInstalls\\7.0.0-alpha1\\metricbeat\\logs"}, "type": "metricbeat", "uuid": "9ca96abe-15c1-4c29-9bd9-8395b927f68e"}}}
2018-06-28T13:52:34.227Z	INFO	[beat]	instance/beat.go:766	Build info	{"system_info": {"build": {"commit": "85143fbd31dd6d141da5ff17d482306de3659e5f", "libbeat": "7.0.0-alpha1", "time": "2018-06-27T08:17:16.000Z", "version": "7.0.0-alpha1"}}}
2018-06-28T13:52:34.227Z	INFO	[beat]	instance/beat.go:769	Go runtime info	{"system_info": {"go": {"os":"windows","arch":"amd64","max_procs":4,"version":"go1.10.3"}}}
2018-06-28T13:52:34.246Z	INFO	[beat]	instance/beat.go:773	Host info	{"system_info": {"host": {"architecture":"x86_64","boot_time":"2018-06-28T13:43:43.49Z","hostname":"vagrant-2016","ips":["fe80::3937:792:2082:617e/64","10.0.2.15/24","::1/128","127.0.0.1/8","fe80::5efe:a00:20f/128","2001:0:5ef5:79fb:14e9:13ea:3079:7545/64","fe80::14e9:13ea:3079:7545/64"],"kernel_version":"10.0.14393.2273 (rs1_release_1.180427-1811)","mac_addresses":["08:00:27:b8:5d:c6","00:00:00:00:00:00:00:e0","00:00:00:00:00:00:00:e0"],"os":{"family":"windows","platform":"windows","name":"Windows Server 2016 Standard Evaluation","version":"10.0","major":10,"minor":0,"patch":0,"build":"14393.2273"},"timezone":"GMT","timezone_offset_sec":0,"id":"fa4a0de6-5c59-4870-84a0-cde535805dfc"}}}
2018-06-28T13:52:34.247Z	INFO	instance/beat.go:262	Setup Beat: metricbeat; Version: 7.0.0-alpha1
2018-06-28T13:52:34.247Z	INFO	elasticsearch/client.go:162	Elasticsearch url: http://localhost:9200
2018-06-28T13:52:34.249Z	INFO	pipeline/module.go:98	Beat name: vagrant-2016
2018-06-28T13:52:34.249Z	INFO	elasticsearch/client.go:162	Elasticsearch url: http://localhost:9200
2018-06-28T13:52:34.255Z	INFO	elasticsearch/client.go:707	Connected to Elasticsearch version 7.0.0-alpha1
2018-06-28T13:52:34.258Z	INFO	template/load.go:82	Loading template for Elasticsearch
 version: 7.0.0-alpha1
2018-06-28T13:52:34.426Z	INFO	template/load.go:145	Elasticsearch template with name 'metricbeat-7.0.0-alpha1' loaded
Loaded index template
Loading dashboards (Kibana must be running and reachable)
2018-06-28T13:52:34.441Z	INFO	elasticsearch/client.go:162	Elasticsearch url: http://localhost:9200
2018-06-28T13:52:34.473Z	INFO	elasticsearch/client.go:707	Connected to Elasticsearch version 7.0.0-alpha1
2018-06-28T13:52:34.488Z	INFO	kibana/client.go:113	Kibana url: http://10.0.2.15:5601
2018-06-28T13:52:58.935Z	INFO	instance/beat.go:648	Kibana dashboards successfully loaded.
Loaded dashboards

Cannot find Top Processes By CPU [Metricbeat System] under visualizations:

Saved object JSON for above viz ^:
export_saved_missing_viz.json.txt

Saved object JSON for metricbeat dashboard:
export_missing.json.txt

[bhavyarm]

cc @LeeDr

[ruflin]

@bhavyarm I tried to reproduce it with our own snapshot builds: https://beats-package-snapshots.s3.amazonaws.com/index.html?prefix=metricbeat/ but was not successful so far.

Update: Just saw that you run /c/windowsInstalls/7.0.0-alpha1/metricbeat/metricbeat setup as command which looks good. I tried to reproduce it on OS X and not Windows.

One thing I wonder if you potentially catched a bad snapshot build. We change a few things recently and also merged 1 commit which we reverted. Could you retry with the above snapshot link?

[bhavyarm]

@ruflin I reproduced the same bug on os x artifacts on the last successful unified snapshot build. But I couldn't reproduce it on beats team snapshot builds. I am just going to wait for a successful unified snapshot build, verify that it works in os x and windows and then close this bug. Thanks!

[bhavyarm]

This works fine. Thanks!