Code

havelessbemore - New Submission#2

Code

Open

havelessbemore wants to merge 68 commits into1brc:main1brc/nodejs:mainfrom havelessbemore:mainhavelessbemore/1brc-nodejs:mainCopy head branch name to clipboard

+4,318

Commits

Commits on May 21, 2024

• Commit solution

  havelessbemore

  committed
  5ede677

  Copy full SHA for 5ede677

• Remove unused CHANGELOG.md

  havelessbemore

  committed
  92f19b5

  Copy full SHA for 92f19b5

Commits on May 22, 2024

• Add benchmark and README.md

  havelessbemore

  committed
  7535b1a

  Copy full SHA for 7535b1a

• Flatten value arrays from 1 per worker to 1 global. Allows removal of a trie node property, reducing trie memory

  havelessbemore

  committed
  d23d1c2

  Copy full SHA for d23d1c2

• Rename trie to utf8Trie

  havelessbemore

  committed
  e511efe

  Copy full SHA for e511efe

• Refactor utf8 constants

  havelessbemore

  committed
  128a8a2

  Copy full SHA for 128a8a2

• Rename utf8Trie constants

  havelessbemore

  committed
  111786e

  Copy full SHA for 111786e

• Rename utf8Trie constants again

  havelessbemore

  committed
  eb5ba80

  Copy full SHA for eb5ba80

• Refactor print() function for utf8trie. Stop update for variable number of children depending on UTF8 byte value due to negligible impact

  havelessbemore

  committed
  5a880aa

  Copy full SHA for 5a880aa

• Update best time in README.md

  havelessbemore

  committed
  9ee4bf6

  Copy full SHA for 9ee4bf6

• Merge mins and maxes arrays

  havelessbemore

  committed
  360f17e

  Copy full SHA for 360f17e

Commits on May 23, 2024

• Merge values in memory

  havelessbemore

  committed
  a483f80

  Copy full SHA for a483f80

• Rename utf8Trie constants again, Refactor main()

  havelessbemore

  committed
  981cfe5

  Copy full SHA for 981cfe5

• Parallelize trie merging

  havelessbemore

  committed
  ea5d0c8

  Copy full SHA for ea5d0c8

• Minify output

  havelessbemore

  committed
  e7d8f0f

  Copy full SHA for e7d8f0f

• Update best time in README.md

  havelessbemore

  committed
  3e83ee7

  Copy full SHA for 3e83ee7

• Add utility functions for working with Workers

  havelessbemore

  committed
  54c0d04

  Copy full SHA for 54c0d04

• Format files

  havelessbemore

  committed
  6402106

  Copy full SHA for 6402106

• Refactor worker message listener

  havelessbemore

  committed
  9819a4f

  Copy full SHA for 9819a4f

• Refactor main

  havelessbemore

  committed
  6026a8f

  Copy full SHA for 6026a8f

• Add MIT license

  havelessbemore

  committed
  4918ed6

  Copy full SHA for 4918ed6

• Update linter config

  havelessbemore

  committed
  8110879

  Copy full SHA for 8110879

• Add get() utf8trie function, Fix bug in mergeLeft() function where redirect was being allocated and initialized but not attached to the parent node

  havelessbemore

  committed
  473bbd7

  Copy full SHA for 473bbd7

• Update comments, Rename utf8 constants, Remove unused constants

  havelessbemore

  committed
  5d8d084

  Copy full SHA for 5d8d084

• Format files

  havelessbemore

  committed
  20f3d17

  Copy full SHA for 20f3d17

• Refactor index

  havelessbemore

  committed
  4fb575b

  Copy full SHA for 4fb575b

• Update specs in README.md

  havelessbemore

  committed
  e800428

  Copy full SHA for e800428

Commits on May 24, 2024

• Comment out possible constants from utf8Trie

  havelessbemore

  committed
  1b06173

  Copy full SHA for 1b06173

• Simplify the chunk processing loop in the worker

  havelessbemore

  committed
  955536e

  Copy full SHA for 955536e

• Update README.md

  havelessbemore

  committed
  cbfb74d

  Copy full SHA for cbfb74d

• Try different methods for parsing temperature

  havelessbemore

  committed
  df29090

  Copy full SHA for df29090

• Update README.md to reflect new avg

  havelessbemore

  committed
  dc1a881

  Copy full SHA for dc1a881

• Format files

  havelessbemore

  committed
  fc8ed7d

  Copy full SHA for fc8ed7d

Commits on May 25, 2024

• Remove 'type' property from message responses as they are unused, Shorten values for a request's 'type' property, Remove type Message and replace with types Request and Response

  havelessbemore

  committed
  44da3a3

  Copy full SHA for 44da3a3

• Refactor parseDouble

  havelessbemore

  committed
  526a936

  Copy full SHA for 526a936

• Refactor trie merging; Previously tries were merged as if they were part of a binary trie array, meaning each 'child' trie merged with its 'parent'. Now, tries are merged as they come in. Along wit…

  Show description for c8b5027
  havelessbemore

  committed
  c8b5027

  Copy full SHA for c8b5027

• Format files

  havelessbemore

  committed
  e41c6cc

  Copy full SHA for e41c6cc

• Disable eslint rule for Response type

  havelessbemore

  committed
  7e6ccb1

  Copy full SHA for 7e6ccb1

• Change builder from rollup to esbuild

  havelessbemore

  committed
  a5cd0c8

  Copy full SHA for a5cd0c8

• Change CHAR_CODE_ constants into CharCode const enum

  havelessbemore

  committed
  da0ef67

  Copy full SHA for da0ef67

• Change UTF8_ constants into UTF8 const enum

  havelessbemore

  committed
  79dd58f

  Copy full SHA for 79dd58f

• Update worker, stream and constraint constants

  havelessbemore

  committed
  c327ef0

  Copy full SHA for c327ef0

• Update utf8trie constants into const enums

  havelessbemore

  committed
  4c90e7d

  Copy full SHA for 4c90e7d

• Update README.md

  havelessbemore

  committed
  2518251

  Copy full SHA for 2518251

• Update benchmark results

  havelessbemore

  committed
  998734b

  Copy full SHA for 998734b

• Add eslint ignore rules

  havelessbemore

  committed
  7060be3

  Copy full SHA for 7060be3

Commits on May 26, 2024

• Referencing const enum value A from a separate file prevented some values from const enums B and C to not be inlined, which also caused the creation of enums B and C in the built output file. Combi…

  Show description for 1caffc3
  havelessbemore

  committed
  1caffc3

  Copy full SHA for 1caffc3

• Simplify finding an entry's semicolon

  havelessbemore

  committed
  05dbbd8

  Copy full SHA for 05dbbd8

• Refactor worker's processing loop

  havelessbemore

  committed
  c2a68a3

  Copy full SHA for c2a68a3

• Remove unused NOTICE file, Add '' to package.json

  havelessbemore

  committed
  38fd452

  Copy full SHA for 38fd452

• Open file once and share fd with workers

  havelessbemore

  committed
  1952208

  Copy full SHA for 1952208

• Change message type from strings to numbers, Refactor mergeLeft() function

  havelessbemore

  committed
  ea182b0

  Copy full SHA for ea182b0

• Update highWaterMark constants

  havelessbemore

  committed
  4ed9b06

  Copy full SHA for 4ed9b06

• Replace createReadStream with manual streaming. This allows for better buffer usage / reuse

  havelessbemore

  committed
  847f2b0

  Copy full SHA for 847f2b0

• Format files

  havelessbemore

  committed
  7a4ed23

  Copy full SHA for 7a4ed23

• Update benchmark results

  havelessbemore

  committed
  8d24cde

  Copy full SHA for 8d24cde

Commits on May 27, 2024

• Remove config constant CHUNK_SIZE_MIN

  havelessbemore

  committed
  b7c7f19

  Copy full SHA for b7c7f19

• Replace fs/promises with sync fs functions

  havelessbemore

  committed
  1a3de36

  Copy full SHA for 1a3de36

• Make worker process() function synchronous to avoid async overhead

  havelessbemore

  committed
  de75285

  Copy full SHA for de75285

• Replace Math.max and Math.min with ternaries

  havelessbemore

  committed
  da6ba82

  Copy full SHA for da6ba82

• Update benchmark results

  havelessbemore

  committed
  8160806

  Copy full SHA for 8160806

• Refactor worker

  havelessbemore

  committed
  9043357

  Copy full SHA for 9043357

Commits on May 28, 2024

• Refactor worker again

  havelessbemore

  committed
  a716e87

  Copy full SHA for a716e87

• Refactor worker hot loop

  havelessbemore

  committed
  b92c185

  Copy full SHA for b92c185

Commits on May 31, 2024

• Align reads with system page size

  havelessbemore

  committed
  da092eb

  Copy full SHA for da092eb

• Refactor worker hot loop

  havelessbemore

  committed
  a9e603c

  Copy full SHA for a9e603c

• Refactor constants

  havelessbemore

  committed
  9acc20a

  Copy full SHA for 9acc20a

• Update benchmark results

  havelessbemore

  committed
  9e8604a

  Copy full SHA for 9e8604a