Gaps in moving to Lens

[andresrc]

The goal of this issue is to collect the different issues / gaps that we might find when building new dashboards to Lens or migrating existing ones.

Please add comments withe the issues you find, they will be consolidated in the main comment.

• Group by filter
• Percentile aggregation
• load lens assets in Kibana
• Dashboard input controls

[elasticmachine]

Pinging @elastic/integrations (Team:Integrations)

[kaiyan-sheng]

It's very convenient to use group by terms in lens but not group by filter like this shown in TSVB:

[ChrsMark]

Lens does not provide support for percentile aggregation:

TSVB is the way to go when one want to visualise histograms:

[AlonaNadler]

@kaiyan-sheng filter aggregation is supported in Lens in 7.10
please let me know if you managed to create what you wanted

[kaiyan-sheng]

Thanks @AlonaNadler I used TSVB for this use case. Do you know if we are planning to add filter aggregation into Lens soon?

[AlonaNadler]

Sorry I had a typo. Filter aggregation is supported in Lens in 7.10

[kaiyan-sheng]

This is not a gap but more of an enhancement request: when we create a lens visualization and plot a field with break down by container.id, is it possible to add a display name field to be container.name instead? For this case, container.id is just a random string that's not human readable but container.name is actually a meaningful keyword. But container.name can be the same for different containers running in different clusters so we have to plot with container.id instead. Similar use case for host.id and host.name as well.

[mtojek]

Currently Kibana doesn't support Lens type in fleet (/cc @ph).

Also, I've just opened a PR to enable it in the package-spec: elastic/package-spec#94

[ph]

We aren't support lens assets installation yet, I've created this on our side elastic/kibana#85428 , I've marked it as 77.12 because I think its low effort to add and is required to use lens in integration.

[skh]

PR open merged for EPM support for Lens assets ( elastic/kibana#85428 ): elastic/kibana#88189

[ph]

Everything is done in the package integration to support LEns FYI @masci

[kaiyan-sheng]

Not sure if this is a gap for Lens or it is by design. We actually use a lot of Controls visualization in dashboards to allow users to filter on cloud account ID, regions, zones and etc. Currently, we are using Controls visualization for this and Controls is still marked as experimental(in 7.10). Will this be a part of Lens eventually?

[timductive]

Hi @kaiyan-sheng it looks like this is Dashboard Input Controls, this is on our radar to bring out of experimental and GA sometime soon. This is not part of Lens though, this will likely stay a part of the Dashboard. You can follow along here: elastic/kibana#17231

[kaiyan-sheng]

Awesome! @timductive Thank you for the info!

[wylieconlon]

Lens will support the Histogram data type in 7.12 for all the standard numeric operations except Cardinality.

[rayafratkina]

Looks like at this point all Lens gaps have been resolved and the only remaining issue is around Input controls. Should we close this issue and start tracking Dashboard-level dependencies (including Input controls)?
See elastic/kibana#17231 and elastic/kibana#59821 for the input controls plan.

[matschaffer]

Did something like TSVBs "Positive Rate" land somewhere? We use that a lot in Cloud (often for plotting deeper parts of stack monitoring data).

[wylieconlon]

Yes, counter rate was merged for 7.12. It's also called counter rate in TSVB now: https://www.elastic.co/guide/en/kibana/current/whats-new.html#lens-7-12

[matschaffer]

Oh, and share-without-save was another one on my nice-to-haves list, though that's more just for general workflow (so we can paste to slack) rather than something that'd block an integration moving over

[wylieconlon]

@matschaffer It sounds like you have other items that you're asking for, can you list all of them? We have never discussed sharing without saving before, so I think we will need to do some investigation into it.

Edit: It turns out that we have an existing issue tracking the request you mentioned, sharing links to Lens

[tbragin]

@drewpost @sorantis @mukeshelastic Are you comfortable with this issue being closed? I am not sure if this is the only place we are tracking the delta between Lens capabilities today and what we need for Observability Integrations & Data Exploration use cases.

[drewpost]

@tbragin

Shahzad and the team are working off this meta issue that's broken down by our iterations. In terms of being happy to close this issue, from our perspective, I'm OK with this issue being closed as we have the exploratory view specific tracking in the meta issue below.

https://github.com/elastic/observability-dev/issues/1422

FWIW - We currently have three remaining open issues

• Time Offsets for comparing time periods in multiple series [Lens] Compare against time offsets kibana#68458

• Thresholds/Annotations based on aggregated data [Lens] Support dynamic thresholds based on a query kibana#87551

• Formula overall metric could be calculated client side by adding up all buckets along one dimension, Could also be an elastic-charts feature (a special mode like percentage mode) [Lens] Formula: Overall metrics kibana#94597

[gimmic]

@drewpost I think kibana/issues/75316 was overlooked here potentially. I currently cannot find a way to share a link to a viz created explicitly in lens. This is different from other visualization user experiences with the existing 'share' submenu options.

(sorry about the mis-tag, drew0552!)

[Drew0522]

@iankoetter I think you tagged the wrong Drew :)

[botelastic]

Hi! We just realized that we haven't looked into this issue in a while. We're sorry! We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

[ruflin]

Checked off the last box in the issue description around "dashboard input controls" as it is available now: https://www.elastic.co/guide/en/kibana/master/add-controls.html Going to close this.

@andrewctate There is one open issue that is discussed above which is elastic/kibana#75316 Would be great if could have a look at this in the context of Lens adoption.

[drewdaemon]

@ruflin elastic/kibana#75316 is on our immediate roadmap. Planned for 8.7.