Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test_EventSource_EtwManifestGeneration* tests failing in CI #48798

Closed
eerhardt opened this issue Feb 26, 2021 · 29 comments · Fixed by #96816
Closed

Test_EventSource_EtwManifestGeneration* tests failing in CI #48798

eerhardt opened this issue Feb 26, 2021 · 29 comments · Fixed by #96816
Assignees
Labels
area-System.Diagnostics.Tracing blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab
Milestone

Comments

@eerhardt
Copy link
Member

eerhardt commented Feb 26, 2021

https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-48790-merge-edcfc19254cd4fb0b6/System.Diagnostics.Tracing.Tests/console.66fb11a3.log?sv=2019-07-07&se=2021-03-18T01%3A00%3A06Z&sr=c&sp=rl&sig=z8YRPOAcP9iOzDQfqW8tDy%2FsDDp%2BP2rxIxvaQmGWTrw%3D

Callstack
C:\h\w\BD2109D5\w\9DBE08F2\e>"C:\h\w\BD2109D5\p\dotnet.exe" exec --runtimeconfig System.Diagnostics.Tracing.Tests.runtimeconfig.json --depsfile System.Diagnostics.Tracing.Tests.deps.json xunit.console.dll System.Diagnostics.Tracing.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing  
  Discovering: System.Diagnostics.Tracing.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Diagnostics.Tracing.Tests (found 39 of 43 test cases)
  Starting:    System.Diagnostics.Tracing.Tests (parallel test collections = on, max threads = 2)
    BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover [FAIL]
      Half-way through waiting for remote process.
      Memory load: 24
      
      Nombre de imagen               PID Servicios                                    
      ========================= ======== =============================================
      svchost.exe                    824 PlugPlay                                     
      svchost.exe                    908 BrokerInfrastructure, DcomLaunch, Power,     
                                         SystemEventsBroker                           
      svchost.exe                    948 RpcEptMapper, RpcSs                          
      svchost.exe                    996 LSM                                          
      svchost.exe                    820 CryptSvc                                     
      svchost.exe                    432 AppIDSvc                                     
      svchost.exe                   1080 CoreMessagingRegistrar                       
      svchost.exe                   1096 TermService                                  
      svchost.exe                   1108 lmhosts                                      
      svchost.exe                   1120 NcbService                                   
      svchost.exe                   1268 vmicheartbeat                                
      svchost.exe                   1276 vmickvpexchange                              
      svchost.exe                   1284 vmicshutdown                                 
      svchost.exe                   1340 vmictimesync                                 
      svchost.exe                   1396 DispBrokerDesktopSvc                         
      svchost.exe                   1480 FontCache                                    
      svchost.exe                   1568 EventLog                                     
      svchost.exe                   1620 nsi                                          
      svchost.exe                   1668 gpsvc                                        
      svchost.exe                   1676 Dhcp                                         
      svchost.exe                   1684 ProfSvc                                      
      svchost.exe                   1720 EventSystem                                  
      svchost.exe                   1728 Themes                                       
      svchost.exe                   1836 SENS                                         
      svchost.exe                   1860 UmRdpService                                 
      svchost.exe                   1892 Schedule                                     
      svchost.exe                   1912 Dnscache                                     
      svchost.exe                   1920 Wcmsvc                                       
      svchost.exe                   1964 NlaSvc                                       
      svchost.exe                   1032 ShellHWDetection                             
      svchost.exe                   2168 BFE, mpssvc                                  
      svchost.exe                   2180 WinHttpAutoProxySvc                          
      svchost.exe                   2204 CertPropSvc                                  
      svchost.exe                   2244 netprofm                                     
      svchost.exe                   2292 LanmanWorkstation                            
      svchost.exe                   2320 TimeBrokerSvc                                
      svchost.exe                   2452 SessionEnv                                   
      svchost.exe                   2576 UserManager                                  
      svchost.exe                   2696 DiagTrack                                    
      svchost.exe                   2704 Winmgmt                                      
      svchost.exe                   2744 SysMain                                      
      svchost.exe                   2776 TrkWks                                       
      svchost.exe                   2784 W32Time                                      
      svchost.exe                   2896 WinRM                                        
      svchost.exe                   2944 iphlpsvc                                     
      svchost.exe                   2952 WpnService                                   
      svchost.exe                   3012 LanmanServer                                 
      svchost.exe                   3112 UsoSvc                                       
      svchost.exe                   4864 CDPUserSvc_5d640                             
      svchost.exe                   4892 WpnUserService_5d640                         
      svchost.exe                   5012 TokenBroker                                  
      svchost.exe                   3724 StateRepository                              
      svchost.exe                   4332 TabletInputService                           
      svchost.exe                   4592 CDPSvc                                       
      svchost.exe                   3860 pla                                          
      svchost.exe                   4016 Appinfo                                      
      svchost.exe                   7156 PcaSvc                                       
      svchost.exe                   2732 DPS                                          
      svchost.exe                   2884 WdiSystemHost                                
      svchost.exe                   3504 UALSVC                                       
      svchost.exe                   6236 PrintWorkflowUserSvc_5d640                   
      svchost.exe                   6332 StorSvc                                      
      svchost.exe                    716 wuauserv                                     
      svchost.exe                   1580 AppXSvc                                      
      svchost.exe                   3248 ClipSVC                                      
      svchost.exe                   2468 camsvc                                       
      svchost.exe                   1788 NgcCtnrSvc                                   
      svchost.exe                   4328 NetSetupSvc                                  
      Timed out at 26/02/2021 1:20:11 after 60000ms waiting for remote process.
      Wrote mini dump to: C:\h\w\BD2109D5\w\9DBE08F2\uploads\1156.adgssf0f.fgj.dmp
      	Process ID: 1156
      	Handle: 1232
      	Name: dotnet
      	MainModule: C:\h\w\BD2109D5\p\dotnet.exe
      	StartTime: 26/02/2021 1:19:11
      	TotalProcessorTime: 00:00:00.5468750
      	Threads:
      		Thread #1 (OS 0x544)   [MTA]
      			[HelperMethodFrame] (System.Threading.Thread.SleepInternal)
      			BasicEventSourceTests.TestsManifestGeneration.<Test_EventSource_EtwManifestGenerationRollover>b__6_0()
      			[DebuggerU2MCatchHandlerFrame]
      			[HelperMethodFrame_PROTECTOBJ] (System.RuntimeMethodHandle.InvokeMethod)
      			System.Reflection.MethodBase.Invoke(System.Object, System.Object[])
      			Microsoft.DotNet.RemoteExecutor.Program.Main(System.String[])
      		Thread #2 (OS 0x18DC) [Finalizer] [Background] [MTA]
      			[DebuggerU2MCatchHandlerFrame]
      
      Stack Trace:
        /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(224,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose(Boolean disposing)
        /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(57,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose()
        /_/src/libraries/System.Diagnostics.Tracing/tests/BasicEventSourceTest/TestsManifestGeneration.Etw.cs(81,0): at BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover()
  Finished:    System.Diagnostics.Tracing.Tests
=== TEST EXECUTION SUMMARY ===
   System.Diagnostics.Tracing.Tests  Total: 39, Errors: 0, Failed: 1, Skipped: 0, Time: 112,708s
----- end 26/02/2021  1:20:34,55 ----- exit code 1 ----------------------------------------------------------
 {
    "ErrorMessage" : "BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGeneration",
    "BuildRetry": false
 }

Report

Build Definition Test Pull Request
510252 dotnet/runtime BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover #96121
503555 dotnet/runtime BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover #96148
499754 dotnet/runtime BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover #96037
490642 dotnet/runtime BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 1 4

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=524959
Error message validated: BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGeneration
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 1/15/2024 9:11:22 AM UTC

@ghost
Copy link

ghost commented Feb 26, 2021

Tagging subscribers to this area: @tarekgh, @tommcdon, @pjanotti
See info in area-owners.md if you want to be subscribed.

Issue Details

https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-48790-merge-edcfc19254cd4fb0b6/System.Diagnostics.Tracing.Tests/console.66fb11a3.log?sv=2019-07-07&se=2021-03-18T01%3A00%3A06Z&sr=c&sp=rl&sig=z8YRPOAcP9iOzDQfqW8tDy%2FsDDp%2BP2rxIxvaQmGWTrw%3D


C:\h\w\BD2109D5\w\9DBE08F2\e>"C:\h\w\BD2109D5\p\dotnet.exe" exec --runtimeconfig System.Diagnostics.Tracing.Tests.runtimeconfig.json --depsfile System.Diagnostics.Tracing.Tests.deps.json xunit.console.dll System.Diagnostics.Tracing.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing  
  Discovering: System.Diagnostics.Tracing.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Diagnostics.Tracing.Tests (found 39 of 43 test cases)
  Starting:    System.Diagnostics.Tracing.Tests (parallel test collections = on, max threads = 2)
    BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover [FAIL]
      Half-way through waiting for remote process.
      Memory load: 24
      
      Nombre de imagen               PID Servicios                                    
      ========================= ======== =============================================
      svchost.exe                    824 PlugPlay                                     
      svchost.exe                    908 BrokerInfrastructure, DcomLaunch, Power,     
                                         SystemEventsBroker                           
      svchost.exe                    948 RpcEptMapper, RpcSs                          
      svchost.exe                    996 LSM                                          
      svchost.exe                    820 CryptSvc                                     
      svchost.exe                    432 AppIDSvc                                     
      svchost.exe                   1080 CoreMessagingRegistrar                       
      svchost.exe                   1096 TermService                                  
      svchost.exe                   1108 lmhosts                                      
      svchost.exe                   1120 NcbService                                   
      svchost.exe                   1268 vmicheartbeat                                
      svchost.exe                   1276 vmickvpexchange                              
      svchost.exe                   1284 vmicshutdown                                 
      svchost.exe                   1340 vmictimesync                                 
      svchost.exe                   1396 DispBrokerDesktopSvc                         
      svchost.exe                   1480 FontCache                                    
      svchost.exe                   1568 EventLog                                     
      svchost.exe                   1620 nsi                                          
      svchost.exe                   1668 gpsvc                                        
      svchost.exe                   1676 Dhcp                                         
      svchost.exe                   1684 ProfSvc                                      
      svchost.exe                   1720 EventSystem                                  
      svchost.exe                   1728 Themes                                       
      svchost.exe                   1836 SENS                                         
      svchost.exe                   1860 UmRdpService                                 
      svchost.exe                   1892 Schedule                                     
      svchost.exe                   1912 Dnscache                                     
      svchost.exe                   1920 Wcmsvc                                       
      svchost.exe                   1964 NlaSvc                                       
      svchost.exe                   1032 ShellHWDetection                             
      svchost.exe                   2168 BFE, mpssvc                                  
      svchost.exe                   2180 WinHttpAutoProxySvc                          
      svchost.exe                   2204 CertPropSvc                                  
      svchost.exe                   2244 netprofm                                     
      svchost.exe                   2292 LanmanWorkstation                            
      svchost.exe                   2320 TimeBrokerSvc                                
      svchost.exe                   2452 SessionEnv                                   
      svchost.exe                   2576 UserManager                                  
      svchost.exe                   2696 DiagTrack                                    
      svchost.exe                   2704 Winmgmt                                      
      svchost.exe                   2744 SysMain                                      
      svchost.exe                   2776 TrkWks                                       
      svchost.exe                   2784 W32Time                                      
      svchost.exe                   2896 WinRM                                        
      svchost.exe                   2944 iphlpsvc                                     
      svchost.exe                   2952 WpnService                                   
      svchost.exe                   3012 LanmanServer                                 
      svchost.exe                   3112 UsoSvc                                       
      svchost.exe                   4864 CDPUserSvc_5d640                             
      svchost.exe                   4892 WpnUserService_5d640                         
      svchost.exe                   5012 TokenBroker                                  
      svchost.exe                   3724 StateRepository                              
      svchost.exe                   4332 TabletInputService                           
      svchost.exe                   4592 CDPSvc                                       
      svchost.exe                   3860 pla                                          
      svchost.exe                   4016 Appinfo                                      
      svchost.exe                   7156 PcaSvc                                       
      svchost.exe                   2732 DPS                                          
      svchost.exe                   2884 WdiSystemHost                                
      svchost.exe                   3504 UALSVC                                       
      svchost.exe                   6236 PrintWorkflowUserSvc_5d640                   
      svchost.exe                   6332 StorSvc                                      
      svchost.exe                    716 wuauserv                                     
      svchost.exe                   1580 AppXSvc                                      
      svchost.exe                   3248 ClipSVC                                      
      svchost.exe                   2468 camsvc                                       
      svchost.exe                   1788 NgcCtnrSvc                                   
      svchost.exe                   4328 NetSetupSvc                                  
      Timed out at 26/02/2021 1:20:11 after 60000ms waiting for remote process.
      Wrote mini dump to: C:\h\w\BD2109D5\w\9DBE08F2\uploads\1156.adgssf0f.fgj.dmp
      	Process ID: 1156
      	Handle: 1232
      	Name: dotnet
      	MainModule: C:\h\w\BD2109D5\p\dotnet.exe
      	StartTime: 26/02/2021 1:19:11
      	TotalProcessorTime: 00:00:00.5468750
      	Threads:
      		Thread #1 (OS 0x544)   [MTA]
      			[HelperMethodFrame] (System.Threading.Thread.SleepInternal)
      			BasicEventSourceTests.TestsManifestGeneration.<Test_EventSource_EtwManifestGenerationRollover>b__6_0()
      			[DebuggerU2MCatchHandlerFrame]
      			[HelperMethodFrame_PROTECTOBJ] (System.RuntimeMethodHandle.InvokeMethod)
      			System.Reflection.MethodBase.Invoke(System.Object, System.Object[])
      			Microsoft.DotNet.RemoteExecutor.Program.Main(System.String[])
      		Thread #2 (OS 0x18DC) [Finalizer] [Background] [MTA]
      			[DebuggerU2MCatchHandlerFrame]
      
      Stack Trace:
        /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(224,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose(Boolean disposing)
        /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(57,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose()
        /_/src/libraries/System.Diagnostics.Tracing/tests/BasicEventSourceTest/TestsManifestGeneration.Etw.cs(81,0): at BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover()
  Finished:    System.Diagnostics.Tracing.Tests
=== TEST EXECUTION SUMMARY ===
   System.Diagnostics.Tracing.Tests  Total: 39, Errors: 0, Failed: 1, Skipped: 0, Time: 112,708s
----- end 26/02/2021  1:20:34,55 ----- exit code 1 ----------------------------------------------------------
Author: eerhardt
Assignees: -
Labels:

area-System.Diagnostics.Tracing

Milestone: -

@dotnet-issue-labeler dotnet-issue-labeler bot added the untriaged New issue has not been triaged by the area owner label Feb 26, 2021
@eerhardt eerhardt added the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Feb 26, 2021
@tommcdon tommcdon removed the untriaged New issue has not been triaged by the area owner label Mar 3, 2021
@tommcdon tommcdon added this to the 6.0.0 milestone Mar 3, 2021
@VincentBu
Copy link
Contributor

Failed again in runtime-coreclr libraries-jitstress 20210525.1

Failed test:

net6.0-windows-Release-x64-CoreCLR_checked-jitstress2_tiered-Windows.10.Amd64.Open

- BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover

Error message:

Half-way through waiting for remote process.
Memory load: 11

Image Name                     PID Services

========================= ======== ============================================
svchost.exe                    772 BrokerInfrastructure, DcomLaunch, LSM,

PlugPlay, Power, SystemEventsBroker

svchost.exe                    832 RpcEptMapper, RpcSs

svchost.exe                    956 TermService

svchost.exe                    976 Appinfo, CertPropSvc, DsmSvc, gpsvc,

iphlpsvc, lfsvc, ProfSvc, sacsvr, Schedule,
SENS, SessionEnv, ShellHWDetection, Themes,
UserManager, Winmgmt, WpnService, wuauserv

svchost.exe                    340 Dhcp, EventLog, lmhosts, TimeBrokerSvc,

vmictimesync

svchost.exe                    476 NcbService, PcaSvc, TrkWks, UALSVC,

UmRdpService, vmickvpexchange,

vmicshutdown, WdiSystemHost

svchost.exe                   1052 CDPSvc, EventSystem, FontCache, netprofm,

nsi, W32Time, WinHttpAutoProxySvc

svchost.exe                   1084 BFE, CoreMessagingRegistrar, DPS, MpsSvc,

pla

svchost.exe                   1224 CryptSvc, Dnscache, LanmanWorkstation,

NlaSvc, WinRM

svchost.exe                   1260 vmicheartbeat

svchost.exe                   1552 Wcmsvc

svchost.exe                   2000 AppHostSvc

svchost.exe                   2024 LanmanServer

svchost.exe                   2032 DiagTrack

svchost.exe                   1512 W3SVC, WAS

svchost.exe                   2064 StateRepository, tiledatamodelsvc

svchost.exe                   3196 CDPUserSvc_6317d, OneSyncSvc_6317d

svchost.exe                    784 AppReadiness

Timed out at 5/25/2021 8:14:10 AM after 60000ms waiting for remote process.
Wrote mini dump to: C:\h\w\B12409BB\w\B54909A0\uploads\4628.mfivcd45.ppy.dmp
Process ID: 4628
Handle: 1076
Name: dotnet
MainModule: C:\h\w\B12409BB\p\dotnet.exe
StartTime: 5/25/2021 8:13:07 AM
TotalProcessorTime: 00:00:03.7343750
Threads:
Thread #1 (OS 0x378)   [MTA]
[HelperMethodFrame] (System.Threading.Thread.SleepInternal)
System.Threading.Thread.Sleep(Int32)
BasicEventSourceTests.TestsManifestGeneration.<Test_EventSource_EtwManifestGenerationRollover>b__6_0()
[DebuggerU2MCatchHandlerFrame]
[HelperMethodFrame_PROTECTOBJ] (System.RuntimeMethodHandle.InvokeMethod)
System.Reflection.RuntimeMethodInfo.Invoke(System.Object, System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo)
System.Reflection.MethodBase.Invoke(System.Object, System.Object[])
Microsoft.DotNet.RemoteExecutor.Program.Main(System.String[])
Thread #2 (OS 0x838) [Finalizer] [Background]
[DebuggerU2MCatchHandlerFrame]


Stack trace
   at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose(Boolean disposing) in /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs:line 224
   at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose() in /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs:line 57
   at BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover() in /_/src/libraries/System.Diagnostics.Tracing/tests/BasicEventSourceTest/TestsManifestGeneration.Etw.cs:line 81

@noahfalk noahfalk modified the milestones: 6.0.0, 7.0.0 Jul 21, 2021
@krwq
Copy link
Member

krwq commented Sep 30, 2021

Is this still an issue? Runfo shows 0 failures in the last month

@krwq krwq removed the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Oct 1, 2021
@krwq
Copy link
Member

krwq commented Oct 1, 2021

Removing label because of no occurrences recently

@danmoseley
Copy link
Member

Happened just now in runtimelab regexsrm branch, but the code there is at least a week or two old vs runtime.

@krwq if we don't see instances in a month, and hav e no data to go on or theories, should we simply close?

@adamsitnik
Copy link
Member

Failed again in runtime-extra-platforms:

From the console log:

C:\h\w\A6B30942\w\BF1F0A14\e>"C:\h\w\A6B30942\p\dotnet.exe" exec --runtimeconfig System.Diagnostics.Tracing.Tests.runtimeconfig.json --depsfile System.Diagnostics.Tracing.Tests.deps.json xunit.console.dll System.Diagnostics.Tracing.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing  
  Discovering: System.Diagnostics.Tracing.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Diagnostics.Tracing.Tests (found 45 of 49 test cases)
  Starting:    System.Diagnostics.Tracing.Tests (parallel test collections = on, max threads = 2)
    BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover [FAIL]
      Half-way through waiting for remote process.
      Memory load: 24
      
      Image Name                     PID Services                                    
      ========================= ======== ============================================
      svchost.exe                    860 BrokerInfrastructure, DcomLaunch, PlugPlay, 
                                         Power, SystemEventsBroker                   
      svchost.exe                    968 RpcEptMapper, RpcSs                         
      svchost.exe                    364 LSM                                         
      svchost.exe                    900 TermService                                 
      svchost.exe                   1048 lmhosts                                     
      svchost.exe                   1116 TimeBrokerSvc                               
      svchost.exe                   1128 CoreMessagingRegistrar                      
      svchost.exe                   1136 NcbService                                  
      svchost.exe                   1280 vmicheartbeat                               
      svchost.exe                   1288 vmickvpexchange                             
      svchost.exe                   1296 vmicshutdown                                
      svchost.exe                   1376 vmictimesync                                
      svchost.exe                   1412 FontCache                                   
      svchost.exe                   1464 DispBrokerDesktopSvc                        
      svchost.exe                   1540 EventLog                                    
      svchost.exe                   1588 gpsvc                                       
      svchost.exe                   1596 ProfSvc                                     
      svchost.exe                   1620 EventSystem                                 
      svchost.exe                   1648 Themes                                      
      svchost.exe                   1668 nsi                                         
      svchost.exe                   1760 Dhcp                                        
      svchost.exe                   1796 UmRdpService                                
      svchost.exe                   1828 Schedule                                    
      svchost.exe                   1836 SENS                                        
      svchost.exe                   1928 Dnscache                                    
      svchost.exe                   1940 Wcmsvc                                      
      svchost.exe                   2040 ShellHWDetection                            
      svchost.exe                   1400 BFE, mpssvc                                 
      svchost.exe                   1708 LanmanWorkstation                           
      svchost.exe                   2088 CertPropSvc                                 
      svchost.exe                   2112 NlaSvc                                      
      svchost.exe                   2232 WinHttpAutoProxySvc                         
      svchost.exe                   2324 SessionEnv                                  
      svchost.exe                   2344 netprofm                                    
      svchost.exe                   2472 UserManager                                 
      svchost.exe                   2636 hns                                         
      svchost.exe                   2656 AppHostSvc                                  
      svchost.exe                   2696 CryptSvc                                    
      svchost.exe                   2704 DiagTrack                                   
      svchost.exe                   2732 iphlpsvc                                    
      svchost.exe                   2836 LanmanServer                                
      svchost.exe                   2852 RemoteRegistry                              
      svchost.exe                   2860 sacsvr                                      
      svchost.exe                   2888 StateRepository                             
      svchost.exe                   2900 SysMain                                     
      svchost.exe                   2924 TrkWks                                      
      svchost.exe                   2932 W32Time                                     
      svchost.exe                   2960 W3SVC, WAS                                  
      svchost.exe                   2220 Winmgmt                                     
      svchost.exe                   2196 WinRM                                       
      svchost.exe                   2200 WpnService                                  
      svchost.exe                   3200 nvagent                                     
      svchost.exe                   3836 NetSetupSvc                                 
      svchost.exe                   3180 pla                                         
      svchost.exe                   4116 wuauserv                                    
      svchost.exe                   4264 CDPUserSvc_7954c                            
      svchost.exe                   4340 WpnUserService_7954c                        
      svchost.exe                   4560 TokenBroker                                 
      svchost.exe                   4548 TabletInputService                          
      svchost.exe                   4784 AppXSvc                                     
      svchost.exe                   4048 CDPSvc                                      
      svchost.exe                   4044 camsvc                                      
      svchost.exe                   5528 AppReadiness                                
      svchost.exe                   5608 ClipSVC                                     
      svchost.exe                   5952 wlidsvc                                     
      svchost.exe                   6288 Appinfo                                     
      svchost.exe                   6036 PcaSvc                                      
      svchost.exe                   4540 UsoSvc                                      
      svchost.exe                   6720 WaaSMedicSvc                                
      svchost.exe                   1504 DPS                                         
      svchost.exe                   5624 WdiSystemHost                               
      svchost.exe                   3868 StorSvc                                     
      svchost.exe                   7188 UALSVC                                      
      svchost.exe                   7536 cbdhsvc_7954c                               
      svchost.exe                   2772 WerSvc                                      
      svchost.exe                   6580 DoSvc                                       
      Timed out at 3/21/2022 10:07:01 PM after 60000ms waiting for remote process.
      Wrote mini dump to: C:\h\w\A6B30942\w\BF1F0A14\uploads\5368.5zr2ddn4.3yo.dmp
      	Process ID: 5368
      	Handle: 1232
      	Name: dotnet
      	MainModule: C:\h\w\A6B30942\p\dotnet.exe
      	StartTime: 3/21/2022 10:06:01 PM
      	TotalProcessorTime: 00:00:00.5312500
      	Threads:
      		Thread #1 (OS 0x1C2C)   [MTA]
      			[HelperMethodFrame] (System.Threading.Thread.SleepInternal)
      			System.Threading.Thread.Sleep(Int32)
      			BasicEventSourceTests.TestsManifestGeneration.<Test_EventSource_EtwManifestGenerationRollover>b__6_0()
      			[DebuggerU2MCatchHandlerFrame]
      			[HelperMethodFrame_PROTECTOBJ] (System.RuntimeMethodHandle.InvokeMethod)
      			System.Reflection.RuntimeMethodInfo.Invoke(System.Object, System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo)
      			System.Reflection.MethodBase.Invoke(System.Object, System.Object[])
      			Microsoft.DotNet.RemoteExecutor.Program.Main(System.String[])
      		Thread #2 (OS 0x1288) [Finalizer] [Background] 
      			[DebuggerU2MCatchHandlerFrame]
      
      Stack Trace:
        /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(224,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose(Boolean disposing)
        /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(57,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose()
        /_/src/libraries/System.Diagnostics.Tracing/tests/BasicEventSourceTest/TestsManifestGeneration.Etw.cs(83,0): at BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGenerationRollover()
  Finished:    System.Diagnostics.Tracing.Tests
=== TEST EXECUTION SUMMARY ===
   System.Diagnostics.Tracing.Tests  Total: 46, Errors: 0, Failed: 1, Skipped: 0, Time: 97.093s

@carlossanlop
Copy link
Member

Hit this today.

...
Did not see ManifestData event from SimpleEventSource, test will fail. Additional info:
    file name file.etl
    total event count 0
    total providers 0
Unhandled exception. Xunit.Sdk.TrueException: Assert.True() Failure
Expected: True
Actual:   False
   at Xunit.Assert.True(Boolean condition) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 97
   at BasicEventSourceTests.TestsManifestGeneration.<Test_EventSource_EtwManifestGeneration>b__2_0() in /_/src/libraries/System.Diagnostics.Tracing/tests/BasicEventSourceTest/TestsManifestGeneration.Etw.cs:line 73
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args) in /_/src/coreclr/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.CoreCLR.cs:line 36
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 57
--- End of stack trace from previous location ---
   at Microsoft.DotNet.RemoteExecutor.Program.Main(String[] args) in /_/src/Microsoft.DotNet.RemoteExecutor/src/Program.cs:line 97
    BasicEventSourceTests.TestsManifestGeneration.Test_EventSource_EtwManifestGeneration [FAIL]
      Microsoft.DotNet.RemoteExecutor.RemoteExecutionException : Remote process failed with an unhandled exception.
      Stack Trace:
        
        Child exception:
          Xunit.Sdk.TrueException: Assert.True() Failure
        Expected: True
        Actual:   False
        /_/src/libraries/System.Diagnostics.Tracing/tests/BasicEventSourceTest/TestsManifestGeneration.Etw.cs(73,0): at BasicEventSourceTests.TestsManifestGeneration.<Test_EventSource_EtwManifestGeneration>b__2_0()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
        /_/src/coreclr/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.CoreCLR.cs(36,0): at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
        /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs(57,0): at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
        
        Child process:
          System.Diagnostics.Tracing.Tests, Version=9.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 BasicEventSourceTests.TestsManifestGeneration Void <Test_EventSource_EtwManifestGeneration>b__2_0()
        
        
  Finished:    System.Diagnostics.Tracing.Tests
=== TEST EXECUTION SUMMARY ===
   System.Diagnostics.Tracing.Tests  Total: 46, Errors: 0, Failed: 1, Skipped: 0, Time: 181.599s
----- end Tue 11/28/2023 22:50:29.64 ----- exit code 1 ----------------------------------------------------------

@davmason
Copy link
Member

davmason commented Dec 1, 2023

The tests are likely failing because the hardcoded sleeps are not long enough for jitstress, gcstress, or runs on single core machines. Opened #95498 to disable to get off the blocking CI list

@jakobbotsch jakobbotsch added disabled-test The test is disabled in source code against the issue and removed blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' blocking-clean-ci-optional Blocking optional rolling runs labels Dec 1, 2023
@jakobbotsch
Copy link
Member

@davmason Are those tests tracked by this issue? I think #95389 disabled the two tests being tracked here.

@davmason
Copy link
Member

davmason commented Dec 1, 2023

@jakobbotsch There are some older failures on x64, and the timing issue should affect all architectures.

@tommcdon tommcdon removed the Known Build Error Use this to report build issues in the .NET Helix tab label Jan 4, 2024
@tommcdon tommcdon modified the milestones: 9.0.0, Future Jan 4, 2024
@tommcdon tommcdon closed this as completed Jan 8, 2024
@jkotas
Copy link
Member

jkotas commented Jan 8, 2024

There are tests disabled against this issue:

[ActiveIssue("https://github.com/dotnet/runtime/issues/48798")]

The tests should be either re-enabled or deleted.

@jkotas jkotas reopened this Jan 8, 2024
@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Jan 10, 2024
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Jan 11, 2024
@jakobbotsch
Copy link
Member

jakobbotsch commented Jan 15, 2024

The test is still failing on win-x86. Example: https://dev.azure.com/dnceng-public/public/_build/results?buildId=524959&view=results
I disabled the tests on win-x86 in #95389, but it seems like we ended up losing that. The issue does not seem to be stress related.

@jakobbotsch jakobbotsch reopened this Jan 15, 2024
@jakobbotsch jakobbotsch added blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab and removed disabled-test The test is disabled in source code against the issue labels Jan 15, 2024
@jakobbotsch
Copy link
Member

Ah, looks like there already is a new open issue #96904 about it, but the known error in it didn't match the case above. I'll adjust that a bit instead.

@github-actions github-actions bot locked and limited conversation to collaborators Feb 15, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-System.Diagnostics.Tracing blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Development

Successfully merging a pull request may close this issue.