Skip to content

Conversation

@bgw
Copy link
Member

@bgw bgw commented Jan 31, 2025

Replace hash with faster and better finalized hash. This replaces the previous "fxhash" algorithm originating in Firefox with a custom hasher designed and implemented by Orson Peters (orlp). It was measured to have slightly better performance for rustc, has better theoretical properties and also includes a significantly better string hasher.

https://github.com/rust-lang/rustc-hash/blob/master/CHANGELOG.md

Benchmarks

Any perf difference either way is too small to be easily measured. Benchmarks here technically show a tiny regression, but that's well within the run-to-run variance I've observed.

rustc-hash 1.1.0

$ hyperfine --warmup 1 --runs 5 --prepare 'rm -rf .next' 'TURBOPACK=1 TURBOPACK_BUILD=1 TURBO_ENGINE_READ_ONLY=1 pnpm next build --experimental-build-mode=compile'

Benchmark 1: TURBOPACK=1 TURBOPACK_BUILD=1 TURBO_ENGINE_READ_ONLY=1 pnpm next build --experimental-build-mode=compile
  Time (mean ± σ):     26.736 s ±  0.294 s    [User: 122.811 s, System: 15.908 s]
  Range (min … max):   26.340 s … 27.165 s    5 runs

rustc-hash 2.1.0

$ hyperfine --warmup 1 --runs 5 --prepare 'rm -rf .next' 'TURBOPACK=1 TURBOPACK_BUILD=1 TURBO_ENGINE_READ_ONLY=1 pnpm next build --experimental-build-mode=compile'

Benchmark 1: TURBOPACK=1 TURBOPACK_BUILD=1 TURBO_ENGINE_READ_ONLY=1 pnpm next build --experimental-build-mode=compile
  Time (mean ± σ):     27.206 s ±  0.540 s    [User: 126.145 s, System: 15.958 s]
  Range (min … max):   26.543 s … 27.894 s    5 runs

Closes PACK-3870

@ijjk ijjk added created-by: Turbopack team PRs by the Turbopack team. Turbopack Related to Turbopack with Next.js. labels Jan 31, 2025
@bgw bgw requested review from kdy1 and sokra January 31, 2025 19:29
@bgw bgw marked this pull request as ready for review January 31, 2025 19:29
@ijjk
Copy link
Member

ijjk commented Feb 3, 2025

Stats from current PR

Default Build (Increase detected ⚠️)
General
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
buildDuration 21.8s 20.6s N/A
buildDurationCached 19.1s 16.5s N/A
nodeModulesSize 391 MB 391 MB
nextStartRea..uration (ms) 526ms 524ms N/A
Client Bundles (main, webpack)
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
5306-HASH.js gzip 54 kB 54 kB N/A
8276.HASH.js gzip 169 B 168 B N/A
8377-HASH.js gzip 5.46 kB 5.46 kB N/A
bccd1874-HASH.js gzip 52.9 kB 52.9 kB N/A
framework-HASH.js gzip 57.5 kB 57.5 kB N/A
main-app-HASH.js gzip 240 B 242 B N/A
main-HASH.js gzip 34.5 kB 34.4 kB N/A
webpack-HASH.js gzip 1.71 kB 1.71 kB N/A
Overall change 0 B 0 B
Legacy Client Bundles (polyfills)
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
polyfills-HASH.js gzip 39.4 kB 39.4 kB
Overall change 39.4 kB 39.4 kB
Client Pages
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
_app-HASH.js gzip 193 B 193 B
_error-HASH.js gzip 193 B 193 B
amp-HASH.js gzip 512 B 510 B N/A
css-HASH.js gzip 343 B 342 B N/A
dynamic-HASH.js gzip 1.84 kB 1.84 kB
edge-ssr-HASH.js gzip 265 B 265 B
head-HASH.js gzip 363 B 362 B N/A
hooks-HASH.js gzip 393 B 392 B N/A
image-HASH.js gzip 4.59 kB 4.58 kB N/A
index-HASH.js gzip 268 B 268 B
link-HASH.js gzip 2.35 kB 2.35 kB N/A
routerDirect..HASH.js gzip 328 B 328 B
script-HASH.js gzip 397 B 397 B
withRouter-HASH.js gzip 323 B 326 B N/A
1afbb74e6ecf..834.css gzip 106 B 106 B
Overall change 3.59 kB 3.59 kB
Client Build Manifests
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
_buildManifest.js gzip 748 B 747 B N/A
Overall change 0 B 0 B
Rendered Page Sizes
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
index.html gzip 524 B 524 B
link.html gzip 539 B 538 B N/A
withRouter.html gzip 520 B 520 B
Overall change 1.04 kB 1.04 kB
Edge SSR bundle Size
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
edge-ssr.js gzip 129 kB 129 kB N/A
page.js gzip 210 kB 210 kB N/A
Overall change 0 B 0 B
Middleware size
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
middleware-b..fest.js gzip 670 B 663 B N/A
middleware-r..fest.js gzip 155 B 156 B N/A
middleware.js gzip 31.3 kB 31.3 kB N/A
edge-runtime..pack.js gzip 844 B 844 B
Overall change 844 B 844 B
Next Runtimes
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
app-page-exp...dev.js gzip 385 kB 385 kB
app-page-exp..prod.js gzip 132 kB 132 kB
app-page-tur..prod.js gzip 145 kB 145 kB
app-page-tur..prod.js gzip 141 kB 141 kB
app-page.run...dev.js gzip 372 kB 372 kB
app-page.run..prod.js gzip 128 kB 128 kB
app-route-ex...dev.js gzip 39.3 kB 39.3 kB
app-route-ex..prod.js gzip 25.6 kB 25.6 kB
app-route-tu..prod.js gzip 25.6 kB 25.6 kB
app-route-tu..prod.js gzip 25.4 kB 25.4 kB
app-route.ru...dev.js gzip 40.8 kB 40.8 kB
app-route.ru..prod.js gzip 25.4 kB 25.4 kB
dist_client_...dev.js gzip 356 B 356 B
dist_client_...dev.js gzip 349 B 349 B
pages-api-tu..prod.js gzip 9.69 kB 9.69 kB
pages-api.ru...dev.js gzip 11.8 kB 11.8 kB
pages-api.ru..prod.js gzip 9.68 kB 9.68 kB
pages-turbo...prod.js gzip 21.9 kB 21.9 kB
pages.runtim...dev.js gzip 31.5 kB 31.5 kB
pages.runtim..prod.js gzip 21.9 kB 21.9 kB
server.runti..prod.js gzip 60.2 kB 60.2 kB
Overall change 1.65 MB 1.65 MB
build cache Overall increase ⚠️
vercel/next.js canary vercel/next.js bgw/update-rustc-hash Change
0.pack gzip 2.1 MB 2.1 MB ⚠️ +408 B
index.pack gzip 74.6 kB 75.7 kB ⚠️ +1.12 kB
Overall change 2.18 MB 2.18 MB ⚠️ +1.53 kB
Diff details
Diff for main-HASH.js

Diff too large to display

Commit: c4a1fce

@bgw bgw force-pushed the bgw/rm-fxhash-crate branch from 0f59ef0 to 6a2eaf8 Compare February 3, 2025 21:55
@bgw bgw force-pushed the bgw/update-rustc-hash branch from 83ff8d9 to 2e57d75 Compare February 3, 2025 21:55
@bgw bgw changed the base branch from bgw/rm-fxhash-crate to graphite-base/75531 February 3, 2025 22:59
@bgw bgw force-pushed the bgw/update-rustc-hash branch from 2e57d75 to 0edd4df Compare February 3, 2025 23:00
@bgw bgw force-pushed the graphite-base/75531 branch from 6a2eaf8 to 0138605 Compare February 3, 2025 23:00
@bgw bgw changed the base branch from graphite-base/75531 to canary February 3, 2025 23:00
@bgw bgw force-pushed the bgw/update-rustc-hash branch from 0edd4df to 4711122 Compare February 3, 2025 23:00
@bgw bgw force-pushed the bgw/update-rustc-hash branch from 4711122 to c4a1fce Compare February 4, 2025 01:41
@ijjk
Copy link
Member

ijjk commented Feb 4, 2025

Tests Passed

@bgw bgw merged commit fd27e58 into canary Feb 4, 2025
131 checks passed
Copy link
Member Author

bgw commented Feb 4, 2025

Merge activity

  • Feb 3, 10:00 PM EST: A user merged this pull request with Graphite.

@bgw bgw deleted the bgw/update-rustc-hash branch February 4, 2025 03:00
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Feb 18, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

created-by: Turbopack team PRs by the Turbopack team. locked Turbopack Related to Turbopack with Next.js.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants