Server crash due to upgrading to v1.0.0.10012 / v1.0.0.11194 from v1.0.0.7290

[st860923]

What happened?

After upgrading our server from version 7290 (which was stable) to v1.0.0.10012 and v1.0.0.11194, we have been experiencing intermittent server hangs.
These hangs trigger automatic restarts by txAdmin. Upon investigating with WinDbg, it appears that the issue is related to thread sleep operations.

Expected result

The server should run smoothly without hanging or requiring automatic restarts after the upgrade.

Reproduction steps

1. Open the server.
2. Let player join server and playing.
3. Wait for the crash.

Importancy

Crash

Area(s)

FiveM, FXServer

Specific version(s)

FiveM, v1.0.0.10012 windows / v1.0.0.11194 windows

Additional information

The issue might be relevant below sleep_for module

fivem/code/components/citizen-server-main/src/ServerInstance.cpp

Lines 261 to 265 in 8a6a363

	// tasks should be running in background threads; we'll just wait until someone wants to get rid of us
	while (!m_shouldTerminate)
	{
	std::this_thread::sleep_for(std::chrono::seconds(1));
	}

Here are excerpts from the server console logs during the incidents:

[              server] Error: Loop svNetwork seems hung! (last checkin 45 seconds ago)
[              server] Warning: svNetwork watchdog stack: root
[ citizen-server-impl] sync thread hitch warning: timer interval of 383 milliseconds
[              server] Uploaded a live hang dump to the CitizenFX crash reporting service. The report ID is 6b28501d-4fba-4f91-a044-e5c7cdf75862.
[              server] Error: Loop svMain seems hung! (last checkin 45 seconds ago)
[              server] Warning: svMain watchdog stack: root
[ citizen-server-impl] sync thread hitch warning: timer interval of 321 milliseconds
[              server] Uploaded a live hang dump to the CitizenFX crash reporting service. The report ID is 0d89ceee-faa0-473b-88cb-aadf5ecb116a.
[             TXADMIN] Restarting server: server resources hang detected (HB:61|HC:1) 
[             TXADMIN] txaEvent "serverShuttingDown" "{＂delay＂:5000,＂author＂:＂txAdmin＂,＂message＂:＂Ouch(restarter.hang_detected)。＂}" 

[              server] Error: Loop svNetwork seems hung! (last checkin 45 seconds ago)
[              server] Warning: svNetwork watchdog stack: root
[ citizen-server-impl] sync thread hitch warning: timer interval of 267 milliseconds
[              server] Uploaded a live hang dump to the CitizenFX crash reporting service. The report ID is 186dbb37-7640-4592-9a9e-a12cdc5d1e0d.
[              server] Error: Loop svMain seems hung! (last checkin 45 seconds ago)
[              server] Warning: svMain watchdog stack: root
[ citizen-server-impl] sync thread hitch warning: timer interval of 216 milliseconds
[              server] Uploaded a live hang dump to the CitizenFX crash reporting service. The report ID is 2a17d7bb-acaf-4bfd-ae31-d09468d7600b.
[             TXADMIN] Restarting server: server resources hang detected (HB:61|HC:1) 

00000052`1b9fec98 00007ffe`6cad7aaa     : 112e0be8`26d694b3 000311cd`ad160000 7fffffff`c46535ff 7fffffff`ffffffff : ntdll!NtDelayExecution+0x14
00000052`1b9feca0 00007ffe`6a507531     : 00000052`1b9ff510 00000171`735410c0 00000000`00000001 00007ffe`3de43b1e : ntdll!RtlDelayExecution+0x2a
00000052`1b9fece0 00007ffe`3de42eec     : 00000052`1b9ff0d0 00000171`00000000 ffffffff`ff676980 00007ffe`3de43b1e : KERNELBASE!SleepEx+0x71
00000052`1b9fed60 00007ffe`34326ff4     : 01db3cba`23c215ca 00000171`790f3490 00000171`792548e0 00000171`735410c0 : msvcp140!_Thrd_sleep+0x3c
00000052`1b9fedb0 00007ffe`3431f339     : 00007ff6`7c17db75 00000171`73b0f710 00007ff6`7c19665c 00007ffe`6a54da46 : citizen_server_main!fx::ServerInstance::Run+0x1a14
00000052`1b9ff380 00007ff6`7c17e89a     : 00007ffe`34342028 00000052`1b9ff470 00000052`1b9ff410 00007ff6`7c19665c : citizen_server_main!ServerMain::Run+0x69
00000052`1b9ff410 00007ff6`7c17b991     : 00000171`71846160 00000171`0000003d 00000000`0000003d 00000000`000007a0 : FXServer!fx::Server::Start+0xcfa
00000052`1b9ff6e0 00007ff6`7c17bf0d     : 00007ff6`00000002 00007ff6`7c1962f4 00000171`71846160 00000000`00000004 : FXServer!utf8main+0xd1
00000052`1b9ff880 00007ff6`7c192700     : 00007ff6`7c1988b0 00000000`00000000 00000000`00000000 00000000`00000000 : FXServer!wmain+0x2bd
00000052`1b9ff930 00007ffe`6aa54ed0     : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : FXServer!__scrt_common_main_seh+0x10c
00000052`1b9ff970 00007ffe`6cafe40b     : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : kernel32!BaseThreadInitThunk+0x10
00000052`1b9ff9a0 00000000`00000000     : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : ntdll!RtlUserThreadStart+0x2b

livedump-1732159500.dmp
livedump-1732264810.dmp
livedump-1732255510.dmp
livedump-1732255513.dmp
livedump-1732159496.dmp