Code

Scalable jobserver for rustc#7731

Code

Merged

bors merged 26 commits intorust-lang:masterrust-lang/cargo:masterfrom Mark-Simulacrum:chatty-jobserverMark-Simulacrum/cargo:chatty-jobserverCopy head branch name to clipboardJan 22, 2020

+507-170

Commits

Commits on Jan 22, 2020

• Wire up methods for informing job queue of rustc jobserver state

  Mark-Simulacrum

  committed
  ec80cf9

  Copy full SHA for ec80cf9

• Communicate jobserver information with each rustc

  Mark-Simulacrum

  committed
  4a8237f

  Copy full SHA for 4a8237f

• Record the amount of rustc internal parallelism

  Mark-Simulacrum

  committed
  877fe69

  Copy full SHA for 877fe69

• Add documentation about the job queue and rustc

  Mark-Simulacrum

  committed
  cdcd9ad

  Copy full SHA for cdcd9ad

• Gate Cargo changes behind -Zjobserver-per-rustc

  Mark-Simulacrum

  committed
  494b3c0

  Copy full SHA for 494b3c0

• Introduce newtype wrapping JobId

  Mark-Simulacrum

  committed
  f7c6d04

  Copy full SHA for f7c6d04

• Drop crossbeam scopes from job queue

  Show description for e2f4ce1
  Mark-Simulacrum

  committed
  e2f4ce1

  Copy full SHA for e2f4ce1

• Move local variables to struct fields

  Show description for 90ef289
  Mark-Simulacrum

  committed
  90ef289

  Copy full SHA for 90ef289

• Split out work spawning

  Mark-Simulacrum

  committed
  f07fbb2

  Copy full SHA for f07fbb2

• Split out granting rustc token requests

  Mark-Simulacrum

  committed
  f6deb98

  Copy full SHA for f6deb98

• Split out event handler into separate function

  Mark-Simulacrum

  committed
  445de0e

  Copy full SHA for 445de0e

• Split waiting for an event out of the primary drainer

  Show description for 0d722a4
  Mark-Simulacrum

  committed
  0d722a4

  Copy full SHA for 0d722a4

• Do not send acquired tokens to waiting rustc threads

  Show description for b448d92
  Mark-Simulacrum

  committed
  b448d92

  Copy full SHA for b448d92

• Refactor rustc_tokens to a HashMap

  Mark-Simulacrum

  committed
  ae7aba2

  Copy full SHA for ae7aba2

• Document ordering constraint on providing thread tokens

  Mark-Simulacrum

  committed
  c5f4690

  Copy full SHA for c5f4690

• Take JobQueue by-value in drain_the_queue

  Mark-Simulacrum

  committed
  78afa06

  Copy full SHA for 78afa06

• Move transient state to separate struct

  Mark-Simulacrum

  committed
  1d9fdee

  Copy full SHA for 1d9fdee

• Add some commentary

  Mark-Simulacrum

  committed
  5a9af54

  Copy full SHA for 5a9af54

• Pop thread token requests from the front

  Show description for 1988dd9
  Mark-Simulacrum

  committed
  1988dd9

  Copy full SHA for 1988dd9

• Reintroduce crossbeam threads

  Show description for 50a6083
  Mark-Simulacrum

  committed
  50a6083

  Copy full SHA for 50a6083

• Refactor rustc thread granting loop

  Mark-Simulacrum

  committed
  ec4cce9

  Copy full SHA for ec4cce9

• Use an expect instead of directly panicking

  Mark-Simulacrum

  committed
  4bd074e

  Copy full SHA for 4bd074e

• Refactor to_send_clients to use a BTreeMap

  Show description for 25bf99b
  Mark-Simulacrum

  committed
  25bf99b

  Copy full SHA for 25bf99b

• Elaborate on some documentation

  Mark-Simulacrum

  committed
  1204a52

  Copy full SHA for 1204a52

• Stop threading Client through into the NeedsToken message

  Mark-Simulacrum

  committed
  6117f52

  Copy full SHA for 6117f52

• Move token truncation to just before waiting

  Show description for 7e3e1b1
  Mark-Simulacrum

  committed
  7e3e1b1

  Copy full SHA for 7e3e1b1