F# compiler is really slow when trying to compile .net8.0 project with SDK 8.0.303

[NogginBops]

Repro steps

Provide the steps required to reproduce the problem:

1. Clone this specific commit: https://github.com/BoyBaykiller/opentk/tree/5c9dc6e6f0ec4c911fe05357dbfccc7e81d1842f
2. Try to compile this test project using dotnet build -v:n .\tests\OpenTK.Tests\OpenTK.Tests.fsproj

Expected behavior

The compiler should compile the project (this particular commit has a runtime error, but that shouldn't matter).

Actual behavior

The compiler never finishes compiling the project.

Known workarounds

Switching to .net6.0 fixes the issue.

Related information

I also tried targeting and compiling the project with SDK Version: 9.0.100-preview.6.24328.19 and I still get the hang.

Provide any related information (optional):

• Operating system: Windows 10
• .NET Runtime kind (.NET Core, .NET Framework, Mono): .NET Core 8.0.303
• Editing Tools (e.g. Visual Studio Version, Visual Studio): Visual Studio 2022 Version 17.10.5

[vzarytovskii]

So, the bad news is that I can't reproduce it on my mac, on both net7.0 and net8.0 as targets, compilation takes about a minute (47-55 seconds) on my machine (M2 macbook). net6.0 in main with the same SDK (8.0.100) takes about 4 seconds, which leads me to believe that it is the same sort of issue as described in fsprojects/Fleece#146.

TL;DR of the issue is: around .NET7 BCL rolled out "Static abstracts in interfaces" feature (which led to much bigger interfaces hirearchy), at the same time we rolled out support for static abstracts as well as some changes to SRTPs. And what I think is happening is that once you introduce new BCL, some of the functionality in your tests is making typechecking go brrr, and performance degrades significantly, see discussion in the issue above, as well as Don's comment in fsharp/fslang-design@71cd2e0.

Conclusion: with all this in mind, the the best current course of action (for us or contributors) would be to:

1. Take current compiler from main.
2. Build it (Release).
3. Create a global.json file pointing to latest .NET9 SDK (preview 6 at the moment of me commenting it).
4. Include it in the project from OP (tests project, from master branch, point to custom compiler via UseLocalCompiler.Directory.Build.props importing).
5. Profile it with net6.0 (default) target.
6. Change target to net8.0 (or switch branch to otk5-add-matrx-simd-equal, bba4019df27b0a54ff48ca2205d681dbe990824b at the moment of me commenting it).
7. Include custom compiler there again. Profile it again.
8. See what's different/what's wrong.
9. Try to make it better.

As a temporary workaround(s), there were some comments from @gusty in the original issue in Fleece, which might help.

[vzarytovskii]

The worst part is that the more people will move to net8.0 as TFM, the more people might hit this issue. I will try to collect some profiles once I have some free time, unless someone will beat me to it.

[vzarytovskii]

Profiles for

1. master branch with tests project upgraded to net6.0:
   net6.zip
2. otk5-add-matrx-simd-equal branch built with no changes (net8.0):
   net8.zip

Running via .NET9p6 runtime host, with net8 SDK assemblies, on latest main of compiler.

In case if someone wants to look at it.

[vzarytovskii]

Compiler spent a minute (out of ~2 under profiling) in just getting interfaces for all types:

Additionally, some type directed conversions are involved:

(I presume, when we try to find conversions we need to traverse all interfaces)

[vzarytovskii]

I will experiment with caching stuff more once I'm off of work.

[NogginBops]

Is it possible to link the changes that fixes this issue?

[vzarytovskii]

Is it possible to link the changes that fixes this issue?

#17668 it didn't link for some reason

[hyazinthh]

Is there an ETA on this? Has been bugging me for months and makes working in some repositories pretty much impossible.

[vzarytovskii]

Is there an ETA on this? Has been bugging me for months and makes working in some repositories pretty much impossible.

It will be released with 9.0.200 in January, but will be under preview flag, and only for compilation.

[hyazinthh]

Is this also going to be backported to 8.0? We compile all our repositories with the .NET 8 SDK due to this issue.

[vzarytovskii]

Is this also going to be backported to 8.0? We compile all our repositories with the .NET 8 SDK due to this issue.

It will be up to the team. @T-Gro, @KevinRansom thoughts?

[T-Gro]

Is this also going to be backported to 8.0? We compile all our repositories with the .NET 8 SDK due to this issue.

Can you elaborate please?
The issue is about a binary format mismatch between NET6 and NET7.

Are you encountering the same/similar between NET8 and NET9 ?
If yes, I would prefer to fix that (to benefit everyone) instead of backporting the caching layer.

We would definitely appreciate your support in identifying a problem which prevents you from building using .NET9 SDK.

[hyazinthh]

We could probably use .NET 9 for our builds if we absolutely had to, I'm not aware of any current incompatibilities like with 6 and 7.

But back when .NET 7 was released we had to force the build system in dozens of repositories to .NET 6. Now with the phasing out of .NET 6 we thought it'd be a good idea to keep using the LTS version of the SDK to be resilient against any issues that might arise with the .NET 9 SDK. Also seeing that the issue has never been addressed made us a bit cautious. So in short, we opt to use the .NET 8 to be on the safe side.

But I think that's beside the point anyway. I'd expect a major regression like this one to be fixed in the current LTS version.

[T-Gro]

For this bug, it's has not been a regression of the compiler - it was a consequence of many interface layers added to numeric types in NET. The cache has been added as a brand new feature, even under the language version flag for langversion=preview and NET10 eventually.

In general, we are not backporting preview language features into older versions of the language.

I do understand the desire, but a manually cherry-picked migration of this feature into NET8 SDK, pretending this is a NET8 feature and not a preview feature, would only add more risks. It would also slow down fixes in this area due to inability to automatically backport changes once a conflict like this would be created.