[APM] Generate stack monitoring data #118302

dgieselaar · 2021-11-11T09:35:18Z

matschaffer

I ran into a bunch of bootstrap reference errors here (looks like the apm integration and e2e tests rely on this code).

Can I just ignore these and use the code you have here to produce some documents?

matschaffer · 2021-11-15T07:05:41Z

packages/elastic-apm-synthtrace/src/lib/utils/logger.ts

@@ -1,67 +0,0 @@
-/*


Was this supposed to be deleted? Looks like clean_write_targets.ts still imports it.

I had duplicated files, renaming that import to create_logger.ts should work. And yeah you can safely ignore the bootstrap reference errors (I've disabled those in my local setup).

Gotcha. How do you disable those? For now I've just ignored them.

matschaffer · 2021-11-17T07:07:58Z

I tried running this with

node packages/elastic-apm-synthtrace/src/scripts/run packages/elastic-apm-synthtrace/src/scripts/examples/01_simple_trace.ts --target=http://elastic:changeme@localhost:9200 --writeTarget=.monitoring-es

But I just get the same Write targets could not be determined as before.

Do you have an example on how to run this with a monitoring write target?

miltonhultgren · 2021-11-24T10:17:46Z

The command I'm running is node ./src/scripts/run ./src/scripts/examples/02_kibana_stats.ts --target=http://elastic:changeme@localhost:9200 --writeTarget=.monitoring-kibana-7-2021.11.24 (inside of the synthtrace package folder)

(The 01_simple_trace.ts scenario seems wired for APM data which expects the indices to be pre-setup)

matschaffer · 2021-11-25T02:49:14Z

@elasticmachine merge upstream

kibanamachine · 2021-11-25T02:49:16Z

merge conflict between base and head

matschaffer · 2021-11-25T07:31:34Z

Marking as "fixes" for SM generation - what we have isn't complete but it does work. So we can probably call the issue done once this is merged.

dgieselaar · 2021-11-25T11:47:04Z

@matschaffer @miltonhultgren cool, I'll clean up and pull this out of draft.

…ient

elasticmachine · 2021-11-25T14:30:10Z

Pinging @elastic/apm-ui (Team:apm)

matschaffer · 2021-11-29T04:49:18Z

@elasticmachine merge upstream

miltonhultgren · 2021-11-29T07:58:14Z

@elasticmachine merge upstream

dgieselaar

looks good! (can't approve, as it's my own PR)

kibana-ci · 2021-11-29T09:14:33Z

💚 Build Succeeded

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
`@elastic/apm-synthtrace`	43	47	+4

Public APIs missing exports

Total count of every type that is part of your API that should be exported but is not. This will cause broken links in the API documentation system. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats exports for more detailed information.

id	before	after	diff
`@elastic/apm-synthtrace`	6	7	+1

Unknown metric groups

API count

id	before	after	diff
`@elastic/apm-synthtrace`	43	47	+4

History

💔 Build #9479 failed c25d29e
💚 Build #9291 succeeded 7cc9b2e
💔 Build #9285 failed f7063d1
💔 Build #9212 failed 90dc633
💔 Build #9210 failed 98114bd

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

* Generate stack monitoring data * Update file import * Fix imports after bad merge from upstream * A cluster stats generator * Wiring kibana docs to ES docs * Adding fields to get kibana cards rendering * [apm-synthtrace] Export types Fields, ApmException, ApmSynthtraceEsClient * [APM] Update integration tests with synthtrace changes * [APM] Update Cypress E2E tests with synthtrace changes * Fix lint errors Co-authored-by: Milton Hultgren <milton.hultgren@elastic.co> Co-authored-by: Mat Schaffer <mat@elastic.co>

kibanamachine · 2021-11-30T21:17:48Z

💚 Backport successful

Status	Branch	Result
✅	8.0

This backport PR will be merged automatically after passing CI.

* Generate stack monitoring data * Update file import * Fix imports after bad merge from upstream * A cluster stats generator * Wiring kibana docs to ES docs * Adding fields to get kibana cards rendering * [apm-synthtrace] Export types Fields, ApmException, ApmSynthtraceEsClient * [APM] Update integration tests with synthtrace changes * [APM] Update Cypress E2E tests with synthtrace changes * Fix lint errors Co-authored-by: Milton Hultgren <milton.hultgren@elastic.co> Co-authored-by: Mat Schaffer <mat@elastic.co> Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co> Co-authored-by: Milton Hultgren <milton.hultgren@elastic.co> Co-authored-by: Mat Schaffer <mat@elastic.co>

* Generate stack monitoring data * Update file import * Fix imports after bad merge from upstream * A cluster stats generator * Wiring kibana docs to ES docs * Adding fields to get kibana cards rendering * [apm-synthtrace] Export types Fields, ApmException, ApmSynthtraceEsClient * [APM] Update integration tests with synthtrace changes * [APM] Update Cypress E2E tests with synthtrace changes * Fix lint errors Co-authored-by: Milton Hultgren <milton.hultgren@elastic.co> Co-authored-by: Mat Schaffer <mat@elastic.co>

Generate stack monitoring data

3a38fa1

dgieselaar added Team:APM All issues that need APM UI Team support v8.0.0 release_note:skip Skip the PR/issue when compiling release notes v8.1.0 labels Nov 11, 2021

matschaffer reviewed Nov 15, 2021

View reviewed changes

matschaffer mentioned this pull request Nov 15, 2021

[Stack Monitoring] Create simulator for stack monitoring data #117615

Closed

Update file import

030ab60

elastic deleted a comment from kibanamachine Nov 24, 2021

matschaffer added 5 commits November 25, 2021 11:52

Merge remote-tracking branch 'upstream/main' into synthtrace-sm

790d274

Fix imports after bad merge from upstream

dff7d42

A cluster stats generator

e65dffc

Wiring kibana docs to ES docs

98114bd

Adding fields to get kibana cards rendering

90dc633

matschaffer mentioned this pull request Nov 25, 2021

[Infrastructure Monitoring] Better data generation #119491

Closed

1 task

matschaffer mentioned this pull request Nov 25, 2021

Stack Monitoring cluster generator elastic/slingshot#18

Closed

Merge branch 'main' of github.com:elastic/kibana into synthtrace-sm

f7c8128

miltonhultgren added 5 commits November 25, 2021 13:43

[apm-synthtrace] Export types Fields, ApmException, ApmSynthtraceEsCl…

6996392

…ient

[APM] Update integration tests with synthtrace changes

c1cca6b

[APM] Update Cypress E2E tests with synthtrace changes

e118ad4

Fix lint errors

f7063d1

Merge branch 'main' of github.com:elastic/kibana into synthtrace-sm

7cc9b2e

miltonhultgren marked this pull request as ready for review November 25, 2021 14:30

miltonhultgren requested a review from a team as a code owner November 25, 2021 14:30

sorenlouv approved these changes Nov 26, 2021

View reviewed changes

Merge branch 'main' into synthtrace-sm

c25d29e

matschaffer enabled auto-merge (squash) November 29, 2021 04:49

Merge branch 'main' into synthtrace-sm

f3912e9

dgieselaar commented Nov 29, 2021

View reviewed changes

matschaffer merged commit 39a29cc into elastic:main Nov 29, 2021

dgieselaar added the auto-backport Deprecated - use backport:version if exact versions are needed label Nov 30, 2021

kibanamachine mentioned this pull request Nov 30, 2021

[8.0] [APM] Generate stack monitoring data (#118302) #120030

Merged

miltonhultgren mentioned this pull request Jan 19, 2022

[Infra Monitoring UI] Create functional test for Stack Monitoring Agent collection using generated data #123345

Open

klacabane mentioned this pull request Mar 30, 2023

[Asset Manager] Synthtrace document generation #154081

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[APM] Generate stack monitoring data #118302

[APM] Generate stack monitoring data #118302

dgieselaar commented Nov 11, 2021 •

edited by matschaffer

Loading

matschaffer left a comment

matschaffer Nov 15, 2021

dgieselaar Nov 15, 2021

matschaffer Nov 17, 2021

matschaffer commented Nov 17, 2021

miltonhultgren commented Nov 24, 2021 •

edited

Loading

matschaffer commented Nov 25, 2021

kibanamachine commented Nov 25, 2021

matschaffer commented Nov 25, 2021

dgieselaar commented Nov 25, 2021

elasticmachine commented Nov 25, 2021

matschaffer commented Nov 29, 2021

miltonhultgren commented Nov 29, 2021

dgieselaar left a comment

kibana-ci commented Nov 29, 2021

API count

kibanamachine commented Nov 30, 2021

[APM] Generate stack monitoring data #118302

[APM] Generate stack monitoring data #118302

Conversation

dgieselaar commented Nov 11, 2021 • edited by matschaffer Loading

matschaffer left a comment

Choose a reason for hiding this comment

matschaffer Nov 15, 2021

Choose a reason for hiding this comment

dgieselaar Nov 15, 2021

Choose a reason for hiding this comment

matschaffer Nov 17, 2021

Choose a reason for hiding this comment

matschaffer commented Nov 17, 2021

miltonhultgren commented Nov 24, 2021 • edited Loading

matschaffer commented Nov 25, 2021

kibanamachine commented Nov 25, 2021

matschaffer commented Nov 25, 2021

dgieselaar commented Nov 25, 2021

elasticmachine commented Nov 25, 2021

matschaffer commented Nov 29, 2021

miltonhultgren commented Nov 29, 2021

dgieselaar left a comment

Choose a reason for hiding this comment

kibana-ci commented Nov 29, 2021

💚 Build Succeeded

Metrics [docs]

Public APIs missing comments

Public APIs missing exports

API count

History

kibanamachine commented Nov 30, 2021

💚 Backport successful

dgieselaar commented Nov 11, 2021 •

edited by matschaffer

Loading

miltonhultgren commented Nov 24, 2021 •

edited

Loading