Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[APM] Add APM performance journeys #153844

Closed
dgieselaar opened this issue Mar 28, 2023 · 7 comments
Closed

[APM] Add APM performance journeys #153844

dgieselaar opened this issue Mar 28, 2023 · 7 comments
Assignees
@achyutjhunjhunwala
Labels
8.10 candidate apm:performance APM UI - Performance Work apm:test-plan-done Pull request that was successfully tested during the test plan Team:APM All issues that need APM UI Team support

Comments

@dgieselaar
Copy link
Member

The Kibana team runs a set of user journeys to find performance regressions. We should add our own performance journeys so the Kibana team as a whole has a more realistic data set to benchmark against and it will allow us to monitor performance regressions specific to APM use cases.
@dgieselaar dgieselaar added the Team:APM All issues that need APM UI Team support label Mar 28, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/apm-ui (Team:APM)

@gbamparop gbamparop added apm:performance APM UI - Performance Work 8.9 candidate labels Mar 30, 2023
@achyutjhunjhunwala
Copy link
Contributor

I spent some time analysing it. Currently the kibana team uses archives to run these tests. I was looking at option to use synthtrace. The beforeSteps provides an opportunity to run synthtrace but we might have to do some work there to make Synthtrace work with it.
@dgieselaar Do you think adding synthtrace is a good idea? On one side it gives us the flexibility to generate as we like data but on the other side, the number of journeys we will be adding would be limited and may be to start with we can use archives ?

@sorenlouv
Copy link
Member

It might be too slow to generate big data sets at runtime with synthtrace so in this specific case archives could be a better fit

@achyutjhunjhunwala
Copy link
Contributor

It might be too slow to generate big data sets at runtime with synthtrace so in this specific case archives could be a better fit

I had the same feeling, also the journeys mostly would be fixed 👍🏼

@achyutjhunjhunwala achyutjhunjhunwala self-assigned this Jun 29, 2023
@achyutjhunjhunwala achyutjhunjhunwala mentioned this issue Jun 29, 2023
Closed
@achyutjhunjhunwala achyutjhunjhunwala mentioned this issue Jul 28, 2023
Merged
achyutjhunjhunwala added a commit that referenced this issue Jul 31, 2023
@achyutjhunjhunwala @kibanamachine
[APM] Implementing Journey for APM (#162721)
6b44fff 
## Summary

Closes - #153844

As part of this PR, as its just the stepping stone, we will only cover a
basic navigation flow and analyze the result obtained from Steps
Dashboard and data collected by the APM Agents for this journey

## Scope

- Generating a data set using Synthtrace instead of Archives
- Capturing the flow from Service Inventory to Trace Waterfall loading
on Transaction page
- Capturing Event loop utilisation metrics enabled for APM Journey

## How to run it

```
node scripts/run_performance.js --journey-path x-pack/performance/journeys/apm_service_inventory.ts --skip-warmup
```

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
ThomThomson pushed a commit to ThomThomson/kibana that referenced this issue Aug 1, 2023
@achyutjhunjhunwala @kibanamachine
[APM] Implementing Journey for APM (elastic#162721)
a1f7c58 
## Summary

Closes - elastic#153844

As part of this PR, as its just the stepping stone, we will only cover a
basic navigation flow and analyze the result obtained from Steps
Dashboard and data collected by the APM Agents for this journey

## Scope

- Generating a data set using Synthtrace instead of Archives
- Capturing the flow from Service Inventory to Trace Waterfall loading
on Transaction page
- Capturing Event loop utilisation metrics enabled for APM Journey

## How to run it

```
node scripts/run_performance.js --journey-path x-pack/performance/journeys/apm_service_inventory.ts --skip-warmup
```

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
@gbamparop
Copy link
Contributor

Can we close this since #162721 was merged? I think this was the scope for 8.10, we could have another meta issue if we'd like to introduce more journeys.

@gbamparop
Copy link
Contributor

As discussed today, this is closed by #162721.

@achyutjhunjhunwala
Copy link
Contributor

achyutjhunjhunwala commented Aug 16, 2023 •
edited
Loading

The Journeys are running successfully and capturing data

  1. Link To Dashboards - https://kibana-ops-e2e-perf.kb.us-central1.gcp.cloud.es.io:9243/app/dashboards#/view/ad7736c0-ae19-11ed-bdf7-b3e90191c37d?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-10d,to:now))

P.S. - Please select labels.journeyName: apm_service_inventory from the dropdown and de-select any other selected value

  1. APM Agent Data - https://kibana-ops-e2e-perf.kb.us-central1.gcp.cloud.es.io:9243/app/apm/services/functional%20test%20runner/transactions/view?kuery=&rangeFrom=now-7d&rangeTo=now&environment=ENVIRONMENT_ALL&serviceGroup=&transactionName=Journey:%20apm_service_inventory&transactionType=performance&comparisonEnabled=true&offset=1w&latencyAggregationType=avg&transactionId=41582176bc9d58e3&traceId=c114b153448ebb56e110910178ea888d

@achyutjhunjhunwala achyutjhunjhunwala added the apm:test-plan-done Pull request that was successfully tested during the test plan label Aug 16, 2023
@achyutjhunjhunwala achyutjhunjhunwala mentioned this issue Sep 4, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@achyutjhunjhunwala achyutjhunjhunwala

Labels
8.10 candidate apm:performance APM UI - Performance Work apm:test-plan-done Pull request that was successfully tested during the test plan Team:APM All issues that need APM UI Team support
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@sorenlouv @dgieselaar @gbamparop @achyutjhunjhunwala @elasticmachine