Code

CI: performance impact measurements#2171

Code

Merged

marandaneto merged 70 commits intomaingetsentry/sentry-java:mainfrom ci/perf-testsgetsentry/sentry-java:ci/perf-testsCopy head branch name to clipboardSep 17, 2022

+1,524-6

Commits

Commits on Jul 20, 2022

• test: appium-based android startup test (WIP)

  vaind

  committed
  466d695

• chore: update appium test dependencies

  vaind

  committed
  be814f5

• test: add performance test apps

  vaind

  committed
  5de4fcc

• chore: perf test apps - add signing configs

  vaind

  committed
  3fe51dc

• test: use appId

  vaind

  committed
  cca02ea

• Format code

  

  getsentry-bot

  authored and

  vaind

  committed
  3693a71

• refactor: switch appium tests to TS

  vaind

  committed
  93eaf86

• chore: appium TS package cleanup

  vaind

  committed
  dcc86bf

• chore: finish migration to nodejs appium

  vaind

  committed
  08839af

• chore: use simple-statistics in the appium test

  vaind

  committed
  7413898

• chore: lints

  vaind

  committed
  d7cb38a

• chore: update appium test to multi-app

  vaind

  committed
  1f2973f

• chore: update appium test scripts

  vaind

  committed
  d1f36f7

• wip: upload apps to saucelabs

  vaind

  committed
  31259c1

• make gradlew executable in test apps

  vaind

  committed
  99650f9

• fixup: saucelabs app upload

  vaind

  committed
  b2f337f

• refactor: use appium:otherApps instead of installApp

  Show description for d935121
  vaind

  committed
  d935121

• ci: run appium perf test in CI

  vaind

  committed
  4954245

• test: add sentry to the startup test app

  vaind

  committed
  f4850c6

• Format code

  

  getsentry-bot

  authored and

  vaind

  committed
  891f3ee

• app-startup tests: run more iterations and filter outliers

  vaind

  committed
  b4639f5

• test: compare startup times

  vaind

  committed
  8b3a72d

• chore: docs

  vaind

  committed
  facd582

• chore: include test-app-plain in the root gradle project

  vaind

  committed
  98915c9

• test: tune logs and saucelabs info

  vaind

  committed
  88c8e74

• test: print app size, add simple assertions, log formatting

  vaind

  committed
  5a19276

• chore: move the new performance tests under sentry-android-integration-tests

  vaind

  committed
  8c296ef

Commits on Aug 1, 2022

• move appium to appium-node

  vaind

  committed
  a6ee6c0

Commits on Aug 2, 2022

• refactor: move appium tests to kotlin (WIP)

  vaind

  committed
  732174d

Commits on Aug 3, 2022

• refactor: move appium tests to kotlin (WIP 2/*)

  vaind

  committed
  fdd1386

• refactor: move appium tests to kotlin (WIP 3/*)

  vaind

  committed
  6a814a7

• fix: SauceLabsClient - switch to ktor where file upload actually works

  Show description for f557687
  vaind

  committed
  f557687

• fix: SauceLabs otherApps format

  vaind

  committed
  b69b9ac

• refactor: remove node-based appium tests

  vaind

  committed
  39d3ad0

• Merge branch 'main' into ci/perf-tests

  vaind

  committed
  e49d9ca

• fix: make sure SauceLabsOnly is always true on CI

  vaind

  committed
  e782e80

• avoid wildcard import to satisfy ktlintCheck

  vaind

  committed
  0163d1c

• Format code

  getsentry-bot

  committed
  a10f433

• ci: add saucelabs env vars

  vaind

  committed
  973b876

• chore: change test-app-* build.gradle to kotlin

  vaind

  committed
  fdfe700

• Merge remote-tracking branch 'origin/ci/perf-tests' into ci/perf-tests

  vaind

  committed
  5793888

• chore: appium test - print test output logs

  vaind

  committed
  01ab854

Commits on Aug 4, 2022

• chore: appium test docs & minor cleanup

  vaind

  committed
  bd43723

• refactor: change android time collection to logcat-based

  vaind

  committed
  47faa49

• chore: set measured app info as CI job outputs

  vaind

  committed
  acea7c9

• chore: add performance metrics to the PR comment

  vaind

  committed
  95d5c39

• Merge branch 'main' into ci/perf-tests

  vaind

  committed
  7a62adf

• chore: remove wildcard import

  vaind

  committed
  86aa314

• fix: startup tests using logcat on SauceLabs

  vaind

  committed
  add51e8

• chore: format GHA output StartTime

  vaind

  committed
  6875b2d

• chore: stick to Android 12 for the startup test

  vaind

  committed
  6a3e607

• fixup: number of runs for StartupTests on SauceLabs

  vaind

  committed
  7fc951f

Commits on Aug 10, 2022

• appium tests - ios support

  vaind

  committed
  639a9e8

Commits on Aug 11, 2022

• switch app integration test to use a github action

  vaind

  committed
  634cdb2

• chore: use comment-update logic in the metrics action

  vaind

  committed
  316b5f3

• fix ci yaml

  vaind

  committed
  153e2f2

Commits on Aug 12, 2022

• update metrics GHA

  vaind

  committed
  8d31406

• Merge branch 'main' into ci/perf-tests

  vaind

  committed
  bbeb60d

• chore: update metrics GHA

  vaind

  committed
  5e9c63a

• update perf test config

  vaind

  committed
  935e208

Commits on Aug 14, 2022

• ci: cache benchmark plain app

  vaind

  committed
  9e63c21

Commits on Aug 15, 2022

• switch metrics action to internal repo

  vaind

  committed
  f6723f6

Commits on Aug 17, 2022

• Merge branch 'main' into ci/perf-tests

  vaind

  authored
  3f8cf60

Commits on Sep 7, 2022

• Merge branch 'main' into ci/perf-tests

  vaind

  committed
  a43974f

Commits on Sep 9, 2022

• Merge branch 'main' into ci/perf-tests

  marandaneto

  authored
  ffeb2a5

Commits on Sep 16, 2022

• chore: build only arm64 metrics test apps

  vaind

  committed
  0e00c1a

• chore: use Config.Android version constants in the metrics test apps

  vaind

  committed
  da971d2

• fix: metrics test apps compat with old android

  vaind

  committed
  059f3ea

• test: metrics binary size test range

  vaind

  committed
  f40bb1a

• fix: metrics test apps old android compat

  vaind

  committed
  fde4c27