Skip to content

Benchmark

Benchmark #5217

Triggered via pull request August 22, 2024 17:06
@mkolopanismkolopanis
synchronize #1463
benchmark
Status Failure
Total duration 46m 40s
Artifacts

macosx_windows_ci.yaml

on: pull_request
Matrix: Run Tests
Matrix: Performance Benchmark
Fit to window
Zoom out
Zoom in

Annotations

1 error and 10 warnings
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: 33c24bf33ce5f1bbdf096cf801bb96fa48905fb3 | Previous: 8f0a6dd1471a2a1c2bae2118f25bf69a6a530732 | Ratio | |-|-|-|-| | `tests/utils/test_bls.py::test_bls_to_ant[min=0-len=1]` | `34215.328868097386` iter/sec (`stddev: 0.00003323084597350542`) | `135560.75648249776` iter/sec (`stddev: 0.0000010007643229823786`) | `3.96` | | `tests/utils/test_bls.py::test_bls_to_ant[min=0-len=10]` | `37317.14078910944` iter/sec (`stddev: 0.00003112087896035666`) | `115417.24977814876` iter/sec (`stddev: 0.00009054216496795876`) | `3.09` | | `tests/utils/test_bls.py::test_bls_to_ant[min=0-len=100]` | `36062.06330868617` iter/sec (`stddev: 0.000023972680751498185`) | `120908.0807467649` iter/sec (`stddev: 0.0000677089216641196`) | `3.35` | | `tests/utils/test_bls.py::test_bls_to_ant[min=0-len=1000]` | `28678.132388475293` iter/sec (`stddev: 0.00003814353918030437`) | `113053.6506960294` iter/sec (`stddev: 0.0000011238443209663437`) | `3.94` | | `tests/utils/test_bls.py::test_bls_to_ant[min=0-len=10000]` | `13282.665066126456` iter/sec (`stddev: 0.00012090803290660262`) | `37289.42532204422` iter/sec (`stddev: 0.00015177269637910257`) | `2.81` | | `tests/utils/test_bls.py::test_bls_to_ant[min=65536-len=1]` | `36726.51799381056` iter/sec (`stddev: 0.000268322000646915`) | `114941.54803807271` iter/sec (`stddev: 0.00007466093536455636`) | `3.13` | | `tests/utils/test_bls.py::test_bls_to_ant[min=65536-len=10]` | `34707.23575202267` iter/sec (`stddev: 0.00005488100211892541`) | `116877.54209194596` iter/sec (`stddev: 0.00004663350421774059`) | `3.37` | | `tests/utils/test_bls.py::test_bls_to_ant[min=65536-len=100]` | `31084.33855029476` iter/sec (`stddev: 0.00011152402798676639`) | `103588.66792769519` iter/sec (`stddev: 0.00003514571582068568`) | `3.33` | | `tests/utils/test_bls.py::test_bls_to_ant[min=65536-len=1000]` | `26585.188673855257` iter/sec (`stddev: 0.00007763086920372659`) | `86834.39425750582` iter/sec (`stddev: 0.000017081591572176304`) | `3.27` | | `tests/utils/test_bls.py::test_bls_to_ant[min=65536-len=1000000]` | `71.68619852370344` iter/sec (`stddev: 0.003657794870980732`) | `163.4054909718399` iter/sec (`stddev: 0.0028435972735708494`) | `2.28` | | `tests/utils/test_bls.py::test_bls_to_ant[min=4259840-len=1]` | `37683.32014500323` iter/sec (`stddev: 0.000030903382986439436`) | `115267.09020120505` iter/sec (`stddev: 0.000021185619997694618`) | `3.06` | | `tests/utils/test_bls.py::test_bls_to_ant[min=4259840-len=10]` | `38639.52413489269` iter/sec (`stddev: 0.000020045888892202288`) | `137652.41968500923` iter/sec (`stddev: 0.0000018151567562975771`) | `3.56` | | `tests/utils/test_bls.py::test_bls_to_ant[min=4259840-len=100]` | `37701.43288234455` iter/sec (`stddev: 0.000013468271485484657`) | `104636.8773837416` iter/sec (`stddev: 0.00014657251368956694`) | `2.78` | | `tests/utils/test_bls.py::test_bls_to_ant[min=4259840-len=1000]` | `28276.02040473844` iter/sec (`stddev: 0.0002780709218041306`) | `109483.75959683652` iter/sec (`stddev: 0.0000031193778236392344`) | `3.87` | | `tests/utils/test_bls.py::test_ants_to_bls[min=0-len=1]` | `13282.550541115179` iter/sec (`stddev: 0.000040925817430920064`) | `55646.598434271225` iter/sec (`stddev: 0.000009238047757914599`) | `4.19` | | `tests/utils/test_bls.py::test_ants_to_bls[min=0-len=10]` | `14941.827201585953` iter/sec (`stddev: 0.000020443265003505116`) | `46399.51525950697` iter/sec (`stddev: 0.00016650379338238496`) | `3.11` | | `tests/utils/test_bls.py::test_ants_to_bls[min=0-len=100]` | `14439.751339090015` iter/sec (`stddev: 0.000019471835558761287`) | `43817.71003212206` iter/sec (`stddev: 0.00012098913706637513`) | `3.03` | | `tests/utils/test_bls.py::test_ants_to_bls[min=65536-len=1]` | `17123.27089943579` iter/sec (`stddev: 0.000014266852273742748`) | `48780.10319539009` iter/sec (`stddev: 0.00015020494595267773`) | `2.85` | | `tests/utils/te
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 135560.75648249776 and current value is 34215.328868097386. It is 3.961988996367519x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 115417.24977814876 and current value is 37317.14078910944. It is 3.092874945334287x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 120908.0807467649 and current value is 36062.06330868617. It is 3.3527776741948676x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 113053.6506960294 and current value is 28678.132388475293. It is 3.942155268850826x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 37289.42532204422 and current value is 13282.665066126456. It is 2.807375262148254x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 114941.54803807271 and current value is 36726.51799381056. It is 3.1296609185069917x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 116877.54209194596 and current value is 34707.23575202267. It is 3.3675266715856087x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 103588.66792769519 and current value is 31084.33855029476. It is 3.332503529392711x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 86834.39425750582 and current value is 26585.188673855257. It is 3.266269625646915x worse than previous exceeding a ratio threshold 2
Performance Benchmark (macos-13, 3.12, pyuvdata_tests)
Performance alert! Previous value was 163.4054909718399 and current value is 71.68619852370344. It is 2.279455381049519x worse than previous exceeding a ratio threshold 2