Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The Operation will be canceled. The next steps may not contain expected logs. #3008

Open
3 tasks
tarekgh opened this issue Jun 4, 2024 · 3 comments
Open
3 tasks

Comments

@tarekgh
Copy link
Member

tarekgh commented Jun 4, 2024

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build Definition Step Name Console log Pull Request
2643199 dotnet-arcade Validate Hosted Pool Information (1ES PT) Log
952307 dotnet/aspnetcore Run project template tests Log dotnet/aspnetcore#60326
952132 dotnet/runtime Send tests to Helix (Windows) Log dotnet/runtime#112550
952127 dotnet/runtime Send tests to Helix (Windows) Log dotnet/runtime#112549
952116 dotnet/runtime Send tests to Helix (Windows) Log dotnet/runtime#112543
952081 dotnet/aspire Gather code coverage results Log
952108 dotnet/runtime Send tests to Helix (Windows) Log dotnet/runtime#112548
2642705 dotnet-runtime Run performance job script Log
2642701 dotnet-installer Build Log #47673
2642695 dotnet-extensions Secure Supply Chain Analysis (auto-injected by policy) Log
2642485 dotnet-runtime Run performance job script Log
2642037 dotnet-runtime Run performance job script Log
2642422 dotnet-dotnet 🔒 Publish Artifacts (On Success) Log
2642402 dotnet-sdk Run Tests in Helix Log #47645
2642401 dotnet-sdk Run dotnet new Integration Tests Log #47644
951714 dotnet/aspnetcore Run project template tests Log dotnet/aspnetcore#60326
2642451 dotnet-runtime Send job to Helix (Unix) Log
949786 dotnet/runtime Send tests to Helix (Unix) Log
2642437 dotnet-performance Send job to Helix (Unix) Log
2642423 dotnet-performance Send job to Helix (Unix) Log
2642409 dotnet-arcade-validation PowerShell@2 Log
951341 dotnet/runtime Send to Helix Log dotnet/runtime#112513
2642271 dotnet-runtime Send job to Helix (Windows) Log
2642207 dotnet-performance Send job to Helix (Unix) Log
951204 dotnet/performance Send job to Helix (Windows) Log
951118 dotnet/runtime Send to Helix Log dotnet/runtime#112480
2642074 dotnet-runtime ⏬ Pipeline Artifact Download Log
951064 dotnet/runtime Send to Helix Log
950719 dotnet/runtime Send to Helix Log dotnet/runtime#111910
2642036 dotnet-sdk Secure Supply Chain Analysis (auto-injected by policy) Log
950896 dotnet/runtime Send to Helix Log dotnet/runtime#112513
950897 dotnet/runtime Send to Helix Log dotnet/runtime#112393
950902 dotnet/runtime Download unified artifacts Log dotnet/runtime#112514
950678 dotnet/runtime Send to Helix Log dotnet/runtime#112295
2641829 dotnet-runtime Send job to Helix (Windows) Log
950783 dotnet/aspire Run helix tests Log
2641807 dotnet-sdk Publish Using Darc Log
2641763 dotnet-winforms Publish Using Darc Log
949854 dotnet/runtime Send to Helix Log dotnet/runtime#112050
2641761 dotnet-winforms Publish Using Darc Log
2641803 dotnet-emsdk Build and Publish Log
2641718 dotnet-aspnetcore Publish Using Darc Log
2641748 dotnet-arcade-validation Publish Using Darc Log
950749 dotnet/runtime Send to Helix Log dotnet/runtime#112509
2641792 dotnet-sdk Publish Using Darc Log
2641722 dotnet-windowsdesktop Publish Using Darc Log
2641794 dotnet-winforms Publish Using Darc Log
2641698 dotnet-aspnetcore Publish Using Darc Log
2641741 dotnet-symreader-converter Publish Using Darc Log
2641644 dotnet-node Publish Using Darc Log
950328 dotnet/runtime Send to Helix Log dotnet/runtime#112500
950690 dotnet/runtime Send to Helix Log dotnet/runtime#110818
950725 dotnet/aspire Run helix tests Log
950584 dotnet/runtime Send to Helix Log dotnet/runtime#112352
2641738 dotnet-performance Send job to Helix (Windows) Log
950593 dotnet/aspnetcore Build x64 Log
2641686 dotnet-sdk Setup Private Feeds Credentials Log #47596
2641687 dotnet-sdk Generate delegation SAS Token for dotnetbuilds/internal Log #47595
2641688 dotnet-sdk Generate delegation SAS Token for dotnetbuilds/internal Log #47594
950480 dotnet/runtime Send tests to Helix (Unix) Log dotnet/runtime#112505
950365 dotnet/runtime Send to Helix Log
950529 dotnet/aspnetcore Build x64 Log
950461 dotnet/aspnetcore Run E2E tests Log dotnet/aspnetcore#60356
2641575 dotnet-performance Send job to Helix (Unix) Log
950459 dotnet/roslyn Build and Test Log dotnet/roslyn#77191
950270 dotnet/runtime Send to Helix Log dotnet/runtime#112372
950266 dotnet/runtime Send to Helix Log dotnet/runtime#112496
950331 dotnet/runtime Send to Helix Log
950320 dotnet/aspnetcore Run E2E tests Log dotnet/aspnetcore#60353
950255 dotnet/runtime Send to Helix Log
950219 dotnet/runtime Send to Helix Log dotnet/runtime#111759
950206 dotnet/runtime Send to Helix Log dotnet/runtime#112440
2641474 dotnet-runtime Send job to Helix (Unix) Log
2641508 dotnet-efcore Checkout dotnet-efcore@refs/pull/47589/merge to s Log #47589
2641418 dotnet-dotnet-docker Download secrets: EngKeyVault Log
950227 dotnet/runtime Send job to Helix (Unix) Log
950119 dotnet/runtime Send to Helix Log
2641450 dotnet-arcade Publish packages, blobs and symbols Log
950161 dotnet/runtime Send tests to Helix (Unix) Log
2641416 dotnet-dotnet-docker Build Projects Log
2641415 dotnet-dotnet-docker 🛡 Guardian: CredScan (Source) Log
2641414 dotnet-dotnet-docker 🛡 Guardian: AntiMalware Scanner (Source) Log
2641404 dotnet-dotnet-docker Checkout dotnet-dotnet-docker@main to s Log
950034 dotnet/runtime Send to Helix Log dotnet/runtime#112439
950015 dotnet/runtime Send tests to Helix (Unix) Log dotnet/runtime#110622
950080 dotnet/runtime Send to Helix Log
2641354 dotnet-runtime Send job to Helix (Unix) Log
2641346 dotnet-arcade-validation 🛡 Generate SBoM Manifest Log
2641336 dotnet-wpf Pre-Build - Set VSO Variables Log #47577
2641334 dotnet-wpf Generate delegation SAS Token for dotnetbuilds/internal Log #47576
2641335 dotnet-wpf Generate delegation SAS Token for dotnetbuilds/internal Log #47577
2641333 dotnet-wpf Generate delegation SAS Token for dotnetbuilds/internal Log #47576
2641338 dotnet-aspnetcore Generate delegation SAS Token for dotnetbuilds/internal Log #47578
2641337 dotnet-aspnetcore Add dotnet tools to path Log #47575
949930 dotnet/runtime Send to Helix Log dotnet/runtime#112480
949904 dotnet/runtime Send to Helix Log dotnet/runtime#112352
949878 dotnet/runtime Send to Helix Log
949867 dotnet/runtime Send tests to Helix (Unix) Log
949875 dotnet/runtime Send to Helix Log
949877 dotnet/runtime Send to Helix Log
Displaying 100 of 2103 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
19 440 2103
@dkurepa
Copy link
Member

dkurepa commented Feb 13, 2025

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

@dkurepa
Copy link
Member

dkurepa commented Feb 13, 2025

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

@dkurepa
Copy link
Member

dkurepa commented Feb 13, 2025

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants