Failed to publish artifact

[ulisesh]

Build

https://dev.azure.com/dnceng/public/_build/results?buildId=1711221

Build leg reported

CoreCLR Product Build OSX x64 checked

Pull Request

No response

Action required for the engineering services team

To triage this issue (First Responder / @dotnet/dnceng):

• Open the failing build above and investigate
• Add a comment explaining your findings

If this is an issue that is causing build breaks across multiple builds and would get benefit from being listed on the build analysis check, follow the next steps:

1. Add the label "Known Build Error"
2. Edit this issue and add an error string in the Json below that can help us match this issue with future build breaks. You should use the known issues documentation

{
   "ErrorMessage" : "[error]File upload failed even after retry."
}

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log
16112	dotnet/runtime	Build Browser wasm Linux Release _Threading_PerfTracing_BuildOnly	Log
14642	dotnet/sdk	Build	Log
14636	dotnet/sdk	Build	Log
14446	dotnet/sdk	Build	Log
13987	dotnet/sdk	Build	Log
13805	dotnet/sdk	Build	Log
11676	dotnet/sdk	Build	Log
11654	dotnet/sdk	Build	Log
11607	dotnet/sdk	Build	Log
11392	dotnet/sdk	Build	Log
10842	dotnet/sdk	Build	Log
10659	dotnet/sdk	Build	Log
10145	dotnet/sdk	Build	Log
10051	dotnet/sdk	Build	Log
9909	dotnet/sdk	Build	Log
9875	dotnet/sdk	Build	Log
9801	dotnet/sdk	Build	Log
9780	dotnet/sdk	Build	Log
9447	dotnet/sdk	Build	Log
9403	dotnet/sdk	Build	Log
9145	dotnet/sdk	Build	Log
8562	dotnet/sdk	Build	Log
8481	dotnet/sdk	Build	Log
8143	dotnet/sdk	Build	Log
8095	dotnet/sdk	Build	Log
7172	dotnet/sdk	Build	Log
6914	dotnet/sdk	Build	Log
6902	dotnet/sdk	Build	Log
5562	dotnet/sdk	Build	Log
6586	dotnet/sdk	Build	Log
5784	dotnet/sdk	Build	Log
5346	dotnet/sdk	Build	Log
5309	dotnet/sdk	Build	Log
5307	dotnet/sdk	Build	Log
5299	dotnet/sdk	Build	Log
5267	dotnet/sdk	Build	Log
5246	dotnet/sdk	Build	Log
5211	dotnet/sdk	Build	Log
5087	dotnet/sdk	Build	Log
4883	dotnet/sdk	Build	Log
4854	dotnet/sdk	Build	Log
4819	dotnet/sdk	Build	Log
4760	dotnet/sdk	Build	Log
4737	dotnet/sdk	Build	Log
4719	dotnet/sdk	Build	Log
4682	dotnet/sdk	Build	Log
4654	dotnet/sdk	Build	Log
4649	dotnet/sdk	Build	Log
4647	dotnet/sdk	Build	Log
4644	dotnet/sdk	Build	Log
4638	dotnet/sdk	Build	Log
3966	dotnet/sdk	Build	Log
4631	dotnet/sdk	Build	Log
4603	dotnet/sdk	Build	Log
4599	dotnet/sdk	Build	Log
4051	dotnet/sdk	Build	Log
4034	dotnet/sdk	Build	Log
3975	dotnet/sdk	Build	Log
3943	dotnet/sdk	Build	Log
3863	dotnet/sdk	Build	Log
3797	dotnet/sdk	Build	Log
3791	dotnet/sdk	Build	Log
3783	dotnet/sdk	Build	Log
3751	dotnet/sdk	Build	Log
3715	dotnet/sdk	Build	Log
3654	dotnet/sdk	Build	Log
3650	dotnet/sdk	Build	Log
3615	dotnet/sdk	Build	Log
3462	dotnet/sdk	Build	Log
3287	dotnet/sdk	Build	Log
3150	dotnet/sdk	Build	Log
2856	dotnet/sdk	Build	Log
2769	dotnet/sdk	Build	Log
2704	dotnet/sdk	Build	Log
2666	dotnet/sdk	Build	Log
2642	dotnet/sdk	Build	Log
2622	dotnet/sdk	Build	Log
2554	dotnet/sdk	Build	Log
2520	dotnet/sdk	Build	Log
2507	dotnet/sdk	Build	Log
2486	dotnet/sdk	Build	Log
2483	dotnet/sdk	Build	Log
2442	dotnet/sdk	Build	Log
2437	dotnet/sdk	Build	Log
2413	dotnet/sdk	Build	Log
2388	dotnet/sdk	Build	Log
2245	dotnet/sdk	Build	Log
2143	dotnet/sdk	Build	Log
1977	dotnet/sdk	Build	Log
1797	dotnet/sdk	Build	Log
494	dotnet/sdk	Build	Log
1980193	dotnet/sdk	Build	Log
1980185	dotnet/sdk	Build	Log
1980157	dotnet/sdk	Build	Log
1979982	dotnet/sdk	Build	Log
1979949	dotnet/sdk	Build	Log
1979903	dotnet/sdk	Build	Log
1979639	dotnet/sdk	Build	Log
1979300	dotnet/sdk	Build	Log
1979301	dotnet/sdk	Build	Log
Displaying 100 of 327 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
1	25	327

[epananth]

Created ICM https://portal.microsofticm.com/imp/v3/incidents/details/311836761/home

[ilyas1974]

Work item created by team - https://mseng.visualstudio.com/AzureDevOps/_workitems/edit/1971465

[ilyas1974]

Currently being worked on.

[Tarrasse]

• Each pipeline run maps to a file container in ADO
• File container has a tree of files in a file system like structure
• Each file is identified by its path/name

The problem here is that, this pipeline had multiple jobs, all of them are generating the same file and uploading it. Occasionally two jobs would catch up to each other and upload the same file concurrently, that would result in this issue

you can see from the logs of this pipeline, that stages Ubuntu_20_04_TemplateEngine and Ubuntu_20_04 was uploading the file named BlobArtifacts/dotnet-toolset-internal-7.0.100-ci.zip at the same time.

[mmitche]

• Each pipeline runs maps to a file container in ADO
• File container has a tree of files in a file system like structure
• Each file is identified by its path/name

The problem here is that this pipeline had multiple jobs, all of them were generating the same file and uploading it. Occasionally two jobs would catch up to each other and upload the same file concurrently, that would result in this issue

you can see from the logs of this pipeline, that stages Ubuntu_20_04_TemplateEngine and Ubuntu_20_04 was uploading the file named at the same time BlobArtifacts/dotnet-toolset-internal-7.0.100-ci.zip

This is correct. Think this may have been fixed in the past but regressed. Only one of the SDK's PR jobs should pass -publish