Benchmark suggestions

[jakebailey]

General criteria

A benchmark:

• Must be compile with a simple npm|yarn|pnpm install and tsc -p or tsc -b. No funky build systems, no random external artifacts if possible.
  • Compiling with -p is preferred, to prevent fail-fast behavior.
  • Emitting with tsc is even better. Especially declaration emit
• Should compile in less than 60 seconds or so. If you have a benchmark and it takes like 5 minutes to build, that deserves a bug!

Potential candidates

Pulling this list out of microsoft/TypeScript#44033

• webpack (checked JS)
• mongoose
• styled-components
• @emotion/*
• fp-ts
• aws-sdk
• bunp
• artificial auto-imports benchmark (tsserver)
• prisma
• zod
• Code like in Performance regression from #48044 TypeScript#52345
• vscode
• compiler (updated to current year)
• some repo with lots of ts-ignores
• vuelidate
• something with incremental parsing
• drizzle
• https://github.com/TryGhost/Ghost
• prisma something (Expand Perf Suite Codebases, Expand Perf Suite Operations TypeScript#44033 (comment))
• new angular
• https://github.com/ChromeDevTools/devtools-frontend this build is way too custom; tsconfigs do not actually build
• https://github.com/growthbook/growthbook/blob/main/packages/back-end/tsconfig.json
• https://github.com/bluesky-social/social-app

Being in this list does not guarantee that actually want to add the benchmarks, or that there aren't other benchmarks we could add.

Our benchmarking system uses tuned physical machines for accurate measurement, so benchmarking time is limited. More capacity is on the way, and removing our old legacy internal benchmarks will free up more time.

[jakebailey]

This code apparently takes a super long time to check (with the PR in place): https://github.com/reduxjs/reselect/blob/ce9e875d2437ad1dbb701e0d8945a4fa3665f709/type-tests/deepNesting.test-d.ts#L49

And may represent an interesting benchmark.

[RyanCavanaugh]

https://github.com/growthbook/growthbook/

[jakebailey]

@Jolg42 Do you have any links to what kind of prima benchmark you were looking to add in microsoft/TypeScript#44033 (comment)?