Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retry string completions from the inferred type by default #53481

Merged
merged 1 commit into from
Mar 28, 2023

Conversation

Andarist
Copy link
Contributor

@Andarist Andarist commented Mar 23, 2023

fixes #53475

I'm using the same strategy to retry those requests as the one used in https://github.com/microsoft/TypeScript/pull/52875/files

cc @andrewbranch

@typescript-bot typescript-bot added the For Uncommitted Bug PR for untriaged, rejected, closed or missing bug label Mar 23, 2023
@@ -439,7 +439,7 @@ function getStringLiteralCompletionEntries(sourceFile: SourceFile, node: StringL
const literals = contextualTypes.types.filter(literal => !tracker.hasValue(literal.value));
return { kind: StringLiteralCompletionKind.Types, types: literals, isNewIdentifier: false };
default:
return fromContextualType();
return fromContextualType() || fromContextualType(ContextFlags.None);
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

a more conservative approach would be to do this:

        case SyntaxKind.ArrayLiteralExpression:
            return fromContextualType() || fromContextualType(ContextFlags.None);
        default:
            return fromContextualType();

i went for a broad fix~ but perhaps some node types should not be subjects for those retries?

@jakebailey
Copy link
Member

Is this something we need to be backporting? Per #53475 (comment) this is a 5.0 regression, so it's probably good to get in before we send it out?

@DanielRosenwasser
Copy link
Member

@typescript-bot user test tsserver
@typescript-bot test tsserver top100
@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 27, 2023

Heya @DanielRosenwasser, I've started to run the perf test suite on this PR at ea75390. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 27, 2023

Heya @DanielRosenwasser, I've started to run the diff-based user code test suite (tsserver) on this PR at ea75390. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 27, 2023

Heya @DanielRosenwasser, I've started to run the diff-based top-repos suite (tsserver) on this PR at ea75390. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@DanielRosenwasser Here are the results of running the user test suite comparing main and refs/pull/53481/merge:

Everything looks good!

@typescript-bot
Copy link
Collaborator

@DanielRosenwasser
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..53481
Metric main 53481 Delta Best Worst p-value
Angular - node (v18.10.0, x64)
Memory used 362,330k (± 0.00%) 362,346k (± 0.01%) ~ 362,316k 362,419k p=0.469 n=6
Parse Time 3.37s (± 0.75%) 3.36s (± 0.69%) ~ 3.33s 3.39s p=0.686 n=6
Bind Time 1.12s (± 0.73%) 1.11s (± 0.94%) ~ 1.10s 1.13s p=0.180 n=6
Check Time 8.72s (± 0.74%) 8.70s (± 0.65%) ~ 8.64s 8.79s p=0.575 n=6
Emit Time 7.48s (± 0.47%) 7.45s (± 0.66%) ~ 7.38s 7.49s p=0.222 n=6
Total Time 20.69s (± 0.35%) 20.62s (± 0.50%) ~ 20.47s 20.77s p=0.295 n=6
Compiler-Unions - node (v18.10.0, x64)
Memory used 192,705k (± 1.53%) 193,574k (± 1.59%) ~ 190,717k 196,436k p=0.810 n=6
Parse Time 1.51s (± 1.08%) 1.50s (± 0.50%) ~ 1.49s 1.51s p=0.212 n=6
Bind Time 0.77s (± 0.97%) 0.78s (± 1.08%) ~ 0.77s 0.79s p=0.652 n=6
Check Time 9.63s (± 0.60%) 9.69s (± 0.39%) ~ 9.63s 9.74s p=0.148 n=6
Emit Time 2.73s (± 0.89%) 2.74s (± 0.88%) ~ 2.71s 2.78s p=0.625 n=6
Total Time 14.65s (± 0.67%) 14.70s (± 0.30%) ~ 14.62s 14.75s p=0.226 n=6
Monaco - node (v18.10.0, x64)
Memory used 346,414k (± 0.01%) 346,445k (± 0.01%) ~ 346,352k 346,487k p=0.230 n=6
Parse Time 2.58s (± 1.06%) 2.60s (± 0.84%) ~ 2.57s 2.63s p=0.332 n=6
Bind Time 1.01s (± 0.97%) 1.00s (± 0.81%) ~ 1.00s 1.02s p=0.081 n=6
Check Time 7.15s (± 0.39%) 7.13s (± 0.21%) ~ 7.11s 7.15s p=0.373 n=6
Emit Time 4.28s (± 0.63%) 4.28s (± 0.78%) ~ 4.24s 4.33s p=0.809 n=6
Total Time 15.02s (± 0.29%) 15.02s (± 0.36%) ~ 14.94s 15.10s p=0.747 n=6
TFS - node (v18.10.0, x64)
Memory used 300,667k (± 0.01%) 300,664k (± 0.00%) ~ 300,652k 300,683k p=0.873 n=6
Parse Time 2.06s (± 1.23%) 2.06s (± 0.66%) ~ 2.04s 2.08s p=0.746 n=6
Bind Time 1.14s (± 0.66%) 1.14s (± 0.71%) ~ 1.13s 1.15s p=0.729 n=6
Check Time 6.55s (± 0.20%) 6.55s (± 0.43%) ~ 6.52s 6.59s p=0.936 n=6
Emit Time 3.85s (± 1.06%) 3.90s (± 0.85%) ~ 3.85s 3.94s p=0.092 n=6
Total Time 13.60s (± 0.38%) 13.65s (± 0.28%) ~ 13.61s 13.72s p=0.092 n=6
material-ui - node (v18.10.0, x64)
Memory used 477,127k (± 0.00%) 477,146k (± 0.01%) ~ 477,027k 477,199k p=0.078 n=6
Parse Time 3.04s (± 2.30%) 3.03s (± 2.52%) ~ 2.93s 3.09s p=0.934 n=6
Bind Time 0.95s (± 7.95%) 0.96s (± 8.51%) ~ 0.90s 1.07s p=0.935 n=6
Check Time 17.23s (± 0.75%) 17.31s (± 0.95%) ~ 17.10s 17.46s p=0.261 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 21.22s (± 0.70%) 21.31s (± 0.75%) ~ 21.09s 21.46s p=0.336 n=6
xstate - node (v18.10.0, x64)
Memory used 553,083k (± 0.03%) 553,001k (± 0.03%) ~ 552,817k 553,200k p=0.378 n=6
Parse Time 3.80s (± 0.64%) 3.78s (± 0.36%) ~ 3.76s 3.80s p=0.625 n=6
Bind Time 1.67s (± 0.82%) 1.67s (± 0.33%) ~ 1.67s 1.68s p=0.341 n=6
Check Time 2.85s (± 1.07%) 2.84s (± 0.87%) ~ 2.81s 2.87s p=0.469 n=6
Emit Time 0.08s (± 0.00%) 0.08s (± 0.00%) ~ 0.08s 0.08s p=1.000 n=6
Total Time 8.40s (± 0.57%) 8.38s (± 0.39%) ~ 8.34s 8.42s p=0.423 n=6
Angular - node (v16.17.1, x64)
Memory used 361,691k (± 0.01%) 361,709k (± 0.01%) ~ 361,673k 361,741k p=0.230 n=6
Parse Time 3.51s (± 0.74%) 3.53s (± 0.81%) ~ 3.47s 3.55s p=0.295 n=6
Bind Time 1.18s (± 0.64%) 1.18s (± 0.99%) ~ 1.17s 1.20s p=0.734 n=6
Check Time 9.50s (± 0.51%) 9.56s (± 0.33%) +0.05s (+ 0.58%) 9.52s 9.60s p=0.036 n=6
Emit Time 7.97s (± 0.60%) 7.96s (± 1.05%) ~ 7.87s 8.08s p=0.630 n=6
Total Time 22.16s (± 0.26%) 22.23s (± 0.37%) ~ 22.13s 22.37s p=0.149 n=6
Compiler-Unions - node (v16.17.1, x64)
Memory used 193,134k (± 0.74%) 194,195k (± 0.94%) ~ 192,505k 195,986k p=0.748 n=6
Parse Time 1.59s (± 0.47%) 1.59s (± 0.97%) ~ 1.56s 1.60s p=0.796 n=6
Bind Time 0.83s (± 0.66%) 0.83s (± 0.62%) ~ 0.82s 0.83s p=0.640 n=6
Check Time 10.35s (± 0.68%) 10.37s (± 0.50%) ~ 10.28s 10.43s p=0.629 n=6
Emit Time 2.99s (± 0.46%) 3.00s (± 0.69%) ~ 2.96s 3.02s p=0.622 n=6
Total Time 15.77s (± 0.42%) 15.79s (± 0.37%) ~ 15.72s 15.87s p=0.630 n=6
Monaco - node (v16.17.1, x64)
Memory used 345,726k (± 0.00%) 345,719k (± 0.01%) ~ 345,692k 345,743k p=0.810 n=6
Parse Time 2.74s (± 0.71%) 2.72s (± 0.66%) ~ 2.70s 2.75s p=0.143 n=6
Bind Time 1.08s (± 0.48%) 1.09s (± 0.77%) ~ 1.08s 1.10s p=0.923 n=6
Check Time 7.82s (± 0.53%) 7.81s (± 0.21%) ~ 7.79s 7.83s p=0.935 n=6
Emit Time 4.48s (± 1.06%) 4.46s (± 1.03%) ~ 4.42s 4.54s p=0.629 n=6
Total Time 16.12s (± 0.40%) 16.08s (± 0.17%) ~ 16.05s 16.11s p=0.375 n=6
TFS - node (v16.17.1, x64)
Memory used 300,032k (± 0.01%) 300,019k (± 0.01%) ~ 299,996k 300,039k p=0.173 n=6
Parse Time 2.17s (± 1.03%) 2.18s (± 0.73%) ~ 2.16s 2.20s p=0.517 n=6
Bind Time 1.24s (± 0.51%) 1.25s (± 1.31%) ~ 1.23s 1.27s p=0.615 n=6
Check Time 7.22s (± 0.46%) 7.22s (± 0.43%) ~ 7.18s 7.27s p=0.871 n=6
Emit Time 4.35s (± 0.48%) 4.36s (± 0.71%) ~ 4.32s 4.41s p=0.514 n=6
Total Time 14.98s (± 0.45%) 15.01s (± 0.26%) ~ 14.95s 15.07s p=0.627 n=6
material-ui - node (v16.17.1, x64)
Memory used 476,467k (± 0.01%) 476,441k (± 0.00%) ~ 476,425k 476,464k p=0.173 n=6
Parse Time 3.23s (± 0.58%) 3.22s (± 0.41%) ~ 3.21s 3.24s p=0.113 n=6
Bind Time 0.95s (± 0.43%) 0.95s (± 0.43%) ~ 0.95s 0.96s p=1.000 n=6
Check Time 18.29s (± 0.58%) 18.32s (± 0.53%) ~ 18.21s 18.44s p=0.810 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 22.48s (± 0.49%) 22.49s (± 0.47%) ~ 22.39s 22.63s p=1.000 n=6
xstate - node (v16.17.1, x64)
Memory used 550,569k (± 0.02%) 550,617k (± 0.03%) ~ 550,414k 550,868k p=0.575 n=6
Parse Time 3.94s (± 0.50%) 3.94s (± 0.55%) ~ 3.92s 3.97s p=0.935 n=6
Bind Time 1.76s (± 0.46%) 1.76s (± 0.69%) ~ 1.74s 1.77s p=0.787 n=6
Check Time 3.08s (± 0.57%) 3.08s (± 0.46%) ~ 3.06s 3.10s p=0.807 n=6
Emit Time 0.09s (± 0.00%) 0.09s (± 0.00%) ~ 0.09s 0.09s p=1.000 n=6
Total Time 8.88s (± 0.37%) 8.88s (± 0.32%) ~ 8.82s 8.90s p=0.871 n=6
Angular - node (v14.15.1, x64)
Memory used 355,554k (± 0.01%) 355,550k (± 0.00%) ~ 355,538k 355,564k p=0.630 n=6
Parse Time 3.63s (± 0.67%) 3.65s (± 0.59%) ~ 3.61s 3.66s p=0.245 n=6
Bind Time 1.22s (± 0.62%) 1.22s (± 1.20%) ~ 1.21s 1.24s p=0.803 n=6
Check Time 9.90s (± 0.24%) 9.91s (± 0.56%) ~ 9.84s 9.99s p=0.872 n=6
Emit Time 8.37s (± 0.83%) 8.41s (± 0.56%) ~ 8.35s 8.49s p=0.327 n=6
Total Time 23.13s (± 0.45%) 23.19s (± 0.34%) ~ 23.11s 23.32s p=0.148 n=6
Compiler-Unions - node (v14.15.1, x64)
Memory used 187,793k (± 0.02%) 187,779k (± 0.01%) ~ 187,763k 187,801k p=0.574 n=6
Parse Time 1.61s (± 0.32%) 1.60s (± 0.86%) ~ 1.59s 1.62s p=0.933 n=6
Bind Time 0.86s (± 0.64%) 0.85s (± 0.60%) ~ 0.85s 0.86s p=0.640 n=6
Check Time 10.48s (± 0.36%) 10.46s (± 0.39%) ~ 10.41s 10.53s p=0.280 n=6
Emit Time 3.16s (± 1.77%) 3.13s (± 0.44%) ~ 3.10s 3.14s p=0.183 n=6
Total Time 16.10s (± 0.49%) 16.05s (± 0.35%) ~ 15.98s 16.14s p=0.171 n=6
Monaco - node (v14.15.1, x64)
Memory used 340,629k (± 0.01%) 340,614k (± 0.01%) ~ 340,569k 340,655k p=0.298 n=6
Parse Time 2.85s (± 0.72%) 2.84s (± 0.43%) ~ 2.82s 2.85s p=0.462 n=6
Bind Time 1.10s (± 0.00%) 1.09s (± 0.50%) ~ 1.09s 1.10s p=0.071 n=6
Check Time 8.16s (± 0.30%) 8.18s (± 0.61%) ~ 8.12s 8.24s p=0.292 n=6
Emit Time 4.71s (± 0.73%) 4.72s (± 0.31%) ~ 4.70s 4.74s p=0.566 n=6
Total Time 16.82s (± 0.33%) 16.84s (± 0.30%) ~ 16.78s 16.90s p=0.520 n=6
TFS - node (v14.15.1, x64)
Memory used 295,078k (± 0.00%) 295,088k (± 0.00%) ~ 295,076k 295,099k p=0.064 n=6
Parse Time 2.40s (± 0.34%) 2.39s (± 0.78%) ~ 2.37s 2.42s p=0.617 n=6
Bind Time 1.07s (± 0.70%) 1.07s (± 0.48%) ~ 1.06s 1.07s p=0.784 n=6
Check Time 7.53s (± 0.50%) 7.52s (± 0.23%) ~ 7.50s 7.55s p=0.808 n=6
Emit Time 4.30s (± 0.77%) 4.31s (± 0.91%) ~ 4.27s 4.38s p=0.514 n=6
Total Time 15.29s (± 0.45%) 15.30s (± 0.27%) ~ 15.25s 15.35s p=0.872 n=6
material-ui - node (v14.15.1, x64)
Memory used 471,970k (± 0.01%) 471,994k (± 0.00%) ~ 471,965k 472,016k p=0.471 n=6
Parse Time 3.37s (± 0.58%) 3.37s (± 0.49%) ~ 3.34s 3.39s p=0.935 n=6
Bind Time 0.99s (± 0.82%) 1.00s (± 0.82%) ~ 0.99s 1.01s p=0.666 n=6
Check Time 19.14s (± 0.93%) 19.31s (± 0.70%) ~ 19.09s 19.45s p=0.127 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 23.50s (± 0.83%) 23.68s (± 0.54%) ~ 23.45s 23.79s p=0.148 n=6
xstate - node (v14.15.1, x64)
Memory used 539,167k (± 0.00%) 539,185k (± 0.00%) ~ 539,164k 539,204k p=0.128 n=6
Parse Time 4.23s (± 0.71%) 4.22s (± 0.95%) ~ 4.17s 4.29s p=0.747 n=6
Bind Time 1.66s (± 0.62%) 1.67s (± 0.62%) ~ 1.65s 1.68s p=0.560 n=6
Check Time 3.19s (± 0.86%) 3.19s (± 0.71%) ~ 3.17s 3.22s p=0.806 n=6
Emit Time 0.09s (± 0.00%) 0.09s (± 0.00%) ~ 0.09s 0.09s p=1.000 n=6
Total Time 9.17s (± 0.47%) 9.16s (± 0.44%) ~ 9.11s 9.22s p=0.936 n=6
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 53481 6
Baseline main 6

TSServer

Comparison Report - main..53481
Metric main 53481 Delta Best Worst p-value
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 2,396ms (± 0.46%) 2,398ms (± 0.90%) ~ 2,376ms 2,436ms p=0.748 n=6
Req 2 - geterr 5,528ms (± 0.35%) 5,580ms (± 0.45%) +52ms (+ 0.94%) 5,547ms 5,622ms p=0.005 n=6
Req 3 - references 337ms (± 1.85%) 336ms (± 0.55%) ~ 333ms 338ms p=0.685 n=6
Req 4 - navto 280ms (± 0.42%) 281ms (± 0.58%) ~ 278ms 283ms p=0.511 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 83ms (± 2.41%) 84ms (± 0.90%) ~ 83ms 85ms p=0.652 n=6
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 2,511ms (± 1.54%) 2,522ms (± 1.54%) ~ 2,466ms 2,581ms p=0.689 n=6
Req 2 - geterr 4,056ms (± 0.60%) 4,086ms (± 1.06%) ~ 4,028ms 4,132ms p=0.230 n=6
Req 3 - references 349ms (± 1.19%) 351ms (± 0.81%) ~ 346ms 354ms p=0.373 n=6
Req 4 - navto 290ms (± 0.60%) 290ms (± 0.68%) ~ 287ms 293ms p=0.328 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 81ms (± 2.90%) 82ms (± 3.40%) ~ 79ms 85ms p=0.374 n=6
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 2,995ms (± 0.57%) 3,008ms (± 0.52%) ~ 2,983ms 3,025ms p=0.229 n=6
Req 2 - geterr 1,693ms (± 1.21%) 1,709ms (± 1.48%) ~ 1,669ms 1,746ms p=0.467 n=6
Req 3 - references 107ms (± 2.00%) 106ms (± 0.60%) ~ 105ms 107ms p=0.654 n=6
Req 4 - navto 356ms (± 0.46%) 358ms (± 0.33%) +2ms (+ 0.66%) 356ms 359ms p=0.035 n=6
Req 5 - completionInfo count 2,861 (± 0.00%) 2,861 (± 0.00%) ~ 2,861 2,861 p=1.000 n=6
Req 5 - completionInfo 384ms (± 1.05%) 387ms (± 4.34%) ~ 372ms 418ms p=1.000 n=6
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,500ms (± 1.11%) 2,502ms (± 0.77%) ~ 2,479ms 2,525ms p=0.810 n=6
Req 2 - geterr 5,926ms (± 0.63%) 5,923ms (± 0.44%) ~ 5,896ms 5,960ms p=0.810 n=6
Req 3 - references 344ms (± 0.40%) 345ms (± 0.70%) ~ 340ms 347ms p=0.252 n=6
Req 4 - navto 279ms (± 0.39%) 278ms (± 0.53%) ~ 277ms 280ms p=0.287 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 74ms (± 0.55%) 74ms (± 1.33%) ~ 73ms 75ms p=0.930 n=6
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,685ms (± 0.80%) 2,693ms (± 0.56%) ~ 2,665ms 2,706ms p=0.296 n=6
Req 2 - geterr 4,419ms (± 0.34%) 4,424ms (± 0.60%) ~ 4,383ms 4,454ms p=0.575 n=6
Req 3 - references 365ms (± 0.36%) 364ms (± 0.70%) ~ 360ms 367ms p=0.515 n=6
Req 4 - navto 288ms (± 0.41%) 287ms (± 0.41%) ~ 286ms 289ms p=0.185 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 78ms (± 1.78%) 79ms (± 3.09%) ~ 76ms 81ms p=0.680 n=6
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 3,148ms (± 0.32%) 3,140ms (± 0.28%) ~ 3,131ms 3,155ms p=0.199 n=6
Req 2 - geterr 1,855ms (± 0.83%) 1,859ms (± 0.75%) ~ 1,840ms 1,878ms p=0.748 n=6
Req 3 - references 113ms (± 1.04%) 115ms (± 1.90%) ~ 112ms 118ms p=0.072 n=6
Req 4 - navto 342ms (± 0.57%) 341ms (± 0.79%) ~ 337ms 344ms p=0.681 n=6
Req 5 - completionInfo count 2,861 (± 0.00%) 2,861 (± 0.00%) ~ 2,861 2,861 p=1.000 n=6
Req 5 - completionInfo 395ms (± 0.59%) 397ms (± 0.79%) ~ 393ms 401ms p=0.145 n=6
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,610ms (± 0.46%) 2,607ms (± 0.37%) ~ 2,595ms 2,617ms p=0.630 n=6
Req 2 - geterr 6,354ms (± 0.52%) 6,383ms (± 0.45%) ~ 6,337ms 6,419ms p=0.199 n=6
Req 3 - references 364ms (± 1.04%) 364ms (± 0.77%) ~ 361ms 368ms p=0.871 n=6
Req 4 - navto 286ms (± 2.23%) 282ms (± 1.17%) ~ 278ms 288ms p=0.332 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 96ms (± 3.97%) 96ms (± 8.63%) ~ 81ms 102ms p=0.374 n=6
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,819ms (± 0.65%) 2,815ms (± 0.36%) ~ 2,798ms 2,823ms p=0.470 n=6
Req 2 - geterr 4,781ms (± 0.34%) 4,760ms (± 1.69%) ~ 4,597ms 4,812ms p=0.575 n=6
Req 3 - references 371ms (± 0.23%) 379ms (± 4.99%) ~ 369ms 417ms p=0.358 n=6
Req 4 - navto 289ms (± 0.42%) 290ms (± 1.76%) ~ 285ms 297ms p=1.000 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 75ms (± 0.73%) 76ms (± 6.96%) ~ 74ms 87ms p=0.441 n=6
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 3,455ms (± 0.43%) 3,463ms (± 0.43%) ~ 3,439ms 3,481ms p=0.298 n=6
Req 2 - geterr 1,881ms (± 0.98%) 1,889ms (± 0.86%) ~ 1,857ms 1,900ms p=0.686 n=6
Req 3 - references 125ms (± 0.41%) 126ms (± 1.10%) ~ 124ms 127ms p=0.351 n=6
Req 4 - navto 371ms (± 0.63%) 373ms (± 0.63%) ~ 368ms 374ms p=0.405 n=6
Req 5 - completionInfo count 2,861 (± 0.00%) 2,861 (± 0.00%) ~ 2,861 2,861 p=1.000 n=6
Req 5 - completionInfo 408ms (± 0.78%) 410ms (± 0.56%) ~ 408ms 414ms p=0.168 n=6
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 53481 6
Baseline main 6

Startup

Comparison Report - main..53481
Metric main 53481 Delta Best Worst p-value
tsc-startup - node (v16.17.1, x64)
Execution time 141.69ms (± 0.25%) 141.88ms (± 0.37%) ~ 140.87ms 147.76ms p=0.403 n=600
tsserver-startup - node (v16.17.1, x64)
Execution time 228.60ms (± 0.48%) 231.59ms (± 0.19%) +3.00ms (+ 1.31%) 228.77ms 235.88ms p=0.000 n=600
tsserverlibrary-startup - node (v16.17.1, x64)
Execution time 229.18ms (± 0.29%) 232.39ms (± 0.24%) +3.21ms (+ 1.40%) 227.87ms 240.17ms p=0.000 n=600
typescript-startup - node (v16.17.1, x64)
Execution time 209.20ms (± 0.19%) 212.95ms (± 0.20%) +3.75ms (+ 1.79%) 211.64ms 219.34ms p=0.000 n=600
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v16.17.1, x64)
Scenarios
  • tsc-startup - node (v16.17.1, x64)
  • tsserver-startup - node (v16.17.1, x64)
  • tsserverlibrary-startup - node (v16.17.1, x64)
  • typescript-startup - node (v16.17.1, x64)
Benchmark Name Iterations
Current 53481 6
Baseline main 6

Developer Information:

Download Benchmark

@typescript-bot
Copy link
Collaborator

@DanielRosenwasser Here are the results of running the top-repos suite comparing main and refs/pull/53481/merge:

Everything looks good!

@DanielRosenwasser
Copy link
Member

@typescript-bot cherry-pick this to release-5.0

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 28, 2023

Heya @DanielRosenwasser, I've started to run the task to cherry-pick this into release-5.0 on this PR at ea75390. You can monitor the build here.

@DanielRosenwasser DanielRosenwasser merged commit 089876a into microsoft:main Mar 28, 2023
@DanielRosenwasser
Copy link
Member

I'll tentatively cherry-pick.

@typescript-bot
Copy link
Collaborator

Hey @DanielRosenwasser, I've opened #53551 for you.

typescript-bot pushed a commit to typescript-bot/TypeScript that referenced this pull request Mar 28, 2023
Component commits:
ea75390 Retry string completions from the inferred type by default
@Andarist
Copy link
Contributor Author

Thanks guys!

@Andarist Andarist deleted the fix/53475 branch March 28, 2023 05:31
DanielRosenwasser pushed a commit that referenced this pull request Mar 28, 2023
…e-5.0 (#53551)

Co-authored-by: Mateusz Burzyński <mateuszburzynski@gmail.com>
drivron pushed a commit to scenari/typescript that referenced this pull request Sep 14, 2023
…to release-5.0 (microsoft#53551)

Co-authored-by: Mateusz Burzyński <mateuszburzynski@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
For Uncommitted Bug PR for untriaged, rejected, closed or missing bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Autocompletion is working in TS 4.7 to 4.9 but broken/gone in TS 5
5 participants