Code

Multithreaded evaluator#10938

Code

Draft

edolstra wants to merge 71 commits intoNixOS:masterNixOS/nix:masterfrom DeterminateSystems:multithreaded-evalDeterminateSystems/nix-src:multithreaded-evalCopy head branch name to clipboard

+1,131-465

Commits

Commits on May 20, 2024

• EvalState: Make the parse/eval caches thread-safe

  edolstra

  committed
  6760b39

  Copy full SHA for 6760b39

• LRUCache: Mark size() as const

  edolstra

  committed
  d3854d1

  Copy full SHA for d3854d1

• Sync: Add support for shared locks

  edolstra

  committed
  945cd69

  Copy full SHA for 945cd69

• WIP

  edolstra

  committed
  5f3b1a3

  Copy full SHA for 5f3b1a3

Commits on May 22, 2024

• WIP3

  edolstra

  committed
  9ddca98

  Copy full SHA for 9ddca98

Commits on May 23, 2024

• WIP4

  edolstra

  committed
  d133aca

  Copy full SHA for d133aca

Commits on May 24, 2024

• Disable some blackhole tests for now

  edolstra

  committed
  1a55754

  Copy full SHA for 1a55754

Commits on May 28, 2024

• WIP working

  edolstra

  committed
  d623dfb

  Copy full SHA for d623dfb

Commits on May 29, 2024

• Better hash

  edolstra

  committed
  a9e3594

  Copy full SHA for a9e3594

• Symbol table concurrency hack

  edolstra

  committed
  b63a132

  Copy full SHA for b63a132

• Hacks

  edolstra

  committed
  76f822f

  Copy full SHA for 76f822f

Commits on May 31, 2024

• Fix failures due to value reuse

  edolstra

  committed
  6a85af7

  Copy full SHA for 6a85af7

• Revive the Boehm GC alloc cache

  edolstra

  committed
  6eafc52

  Copy full SHA for 6eafc52

• Make RegexCache thread-safe

  edolstra

  committed
  f018a55

  Copy full SHA for f018a55

Commits on Jun 3, 2024

• Add some stats

  edolstra

  committed
  ec8593d

  Copy full SHA for ec8593d

• Cleanup

  edolstra

  committed
  105dea5

  Copy full SHA for 105dea5

Commits on Jun 4, 2024

• Make EvalState::srcToStore thread-safe

  edolstra

  committed
  27fb652

  Copy full SHA for 27fb652

Commits on Jun 5, 2024

• PosixSourceAccessor: Use SharedSync

  edolstra

  committed
  d990974

  Copy full SHA for d990974

• FileParseCache, FileEvalCache: Use read lock

  edolstra

  committed
  eba54f5

  Copy full SHA for eba54f5

Commits on Jun 6, 2024

• Add getOptional()

  edolstra

  committed
  a25a5b7

  Copy full SHA for a25a5b7

• EvalState: Add importResolutionCache

  Show description for ca11328
  edolstra

  committed
  ca11328

  Copy full SHA for ca11328

• Make fileEvalCache insertion more efficient

  edolstra

  committed
  c2c01d8

  Copy full SHA for c2c01d8

• Ensure that files are parsed/evaluated only once

  Show description for 9b88021
  edolstra

  committed
  9b88021

  Copy full SHA for 9b88021

• Small optimization

  edolstra

  committed
  708e0e8

  Copy full SHA for 708e0e8

• SymbolStr: Remove std::string conversion

  Show description for cc38822
  edolstra

  committed
  cc38822

  Copy full SHA for cc38822

• Use a contiguous arena for storing symbols

  Show description for 424e01e
  edolstra

  committed
  424e01e

  Copy full SHA for 424e01e

• Executor: Randomize the work queue

  Show description for c663076
  edolstra

  committed
  c663076

  Copy full SHA for c663076

• Provide std::hash<SourcePath>

  edolstra

  committed
  adcc351

  Copy full SHA for adcc351

• Provide std::hash<Symbol>

  edolstra

  committed
  3988faf

  Copy full SHA for 3988faf

• Remove unused #include

  edolstra

  committed
  a70ec9e

  Copy full SHA for a70ec9e

• Split the symbol table into domains

  edolstra

  committed
  0cd29fe

  Copy full SHA for 0cd29fe

Commits on Jun 7, 2024

• Fix --disable-gc build

  edolstra

  committed
  0c87ead

  Copy full SHA for 0c87ead

• Don't use finishValue() for thunks

  edolstra

  committed
  33f50ae

  Copy full SHA for 33f50ae

• Remove debug statement

  edolstra

  committed
  5e87cf4

  Copy full SHA for 5e87cf4

• Specify memory order

  Show description for 400a670
  edolstra

  committed
  400a670

  Copy full SHA for 400a670

• Split the PosixSourceAccessor lstat cache

  edolstra

  committed
  5c6eb1a

  Copy full SHA for 5c6eb1a

Commits on Jun 13, 2024

• nix search: Restore output

  edolstra

  committed
  3353f9a

  Copy full SHA for 3353f9a

• Make the max-call-depth check thread-local

  edolstra

  committed
  9b814c4

  Copy full SHA for 9b814c4

• Move code

  edolstra

  committed
  fd5c32b

  Copy full SHA for fd5c32b

Commits on Jun 14, 2024

• nix flake show: Make multi-threaded

  edolstra

  committed
  1bdf907

  Copy full SHA for 1bdf907

• Disable some failing tests for now

  edolstra

  committed
  3cc1319

  Copy full SHA for 3cc1319

Commits on Jun 18, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  f6cbd6a

  Copy full SHA for f6cbd6a

Commits on Jun 19, 2024

• Cleanups

  edolstra

  committed
  6103246

  Copy full SHA for 6103246

• Re-enable assertNoSymlinks()

  edolstra

  committed
  576a03e

  Copy full SHA for 576a03e

• Formatting

  edolstra

  committed
  52bd994

  Copy full SHA for 52bd994

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  b713591

  Copy full SHA for b713591

Commits on Jul 3, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  fcbdc9f

  Copy full SHA for fcbdc9f

Commits on Jul 5, 2024

• Make the default GC_INITIAL_HEAP_SIZE a lot bigger

  Show description for 997af66
  edolstra

  committed
  997af66

  Copy full SHA for 997af66

Commits on Jul 11, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  d3397d7

  Copy full SHA for d3397d7

• Remove obsolete comment

  edolstra

  committed
  2b4c36f

  Copy full SHA for 2b4c36f

Commits on Jul 12, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  d131a02

  Copy full SHA for d131a02

Commits on Jul 26, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  4482fe4

  Copy full SHA for 4482fe4

• nix repl: Remove unnecessary call to evalString

  Show description for 8cf80c9
  edolstra

  committed
  8cf80c9

  Copy full SHA for 8cf80c9

• Remove FIXME

  edolstra

  committed
  67ff326

  Copy full SHA for 67ff326

Commits on Aug 5, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  c8c9500

  Copy full SHA for c8c9500

Commits on Aug 12, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  dd44b26

  Copy full SHA for dd44b26

• Make AllowListSourceAccessor thread-safe

  edolstra

  committed
  9102baf

  Copy full SHA for 9102baf

• Make positionToDocComment thread-safe

  edolstra

  committed
  998a289

  Copy full SHA for 998a289

Commits on Aug 13, 2024

• callFunction(): Use correct environment in error messages

  edolstra

  committed
  5310b0f

  Copy full SHA for 5310b0f

• callFunction(): Create the primop app chain safely

  Show description for 839aec2
  edolstra

  committed
  839aec2

  Copy full SHA for 839aec2

• Debug

  edolstra

  committed
  4f90786

  Copy full SHA for 4f90786

• Move perf counters into EvalState

  edolstra

  committed
  6357885

  Copy full SHA for 6357885

• Debug

  edolstra

  committed
  4086c1c

  Copy full SHA for 4086c1c

• Remove "SPURIOUS" message

  edolstra

  committed
  a6d8217

  Copy full SHA for a6d8217

• Fix formatting

  edolstra

  committed
  ea4e981

  Copy full SHA for ea4e981

• Fix meson build

  edolstra

  committed
  d36ea2e

  Copy full SHA for d36ea2e

Commits on Aug 14, 2024

• finishAll(): Propagate an arbitrary exception

  edolstra

  committed
  114d1a0

  Copy full SHA for 114d1a0

• nix flake show: Make sure the visit() closure is still alive in case of an exception

  edolstra

  committed
  f947b63

  Copy full SHA for f947b63

• Introduce ValueType::nFailed

  Show description for ceeb648
  edolstra

  committed
  ceeb648

  Copy full SHA for ceeb648

Commits on Aug 15, 2024

• Make 'nix search --json' thread-safe

  edolstra

  committed
  8b7d5b4

  Copy full SHA for 8b7d5b4

Commits on Aug 22, 2024

• Merge remote-tracking branch 'origin/master' into multithreaded-eval

  edolstra

  committed
  8020c0c

  Copy full SHA for 8020c0c