Code

Async flash#781

Code

Open

JohnSully wants to merge 72 commits intomainSnapchat/KeyDB:mainfrom async_flashSnapchat/KeyDB:async_flashCopy head branch name to clipboard

+1,024-190

Commits

Commits on Sep 18, 2023

• async flash start

  JohnSully

  committed
  1e67982

  Copy full SHA for 1e67982

Commits on Sep 25, 2023

• Initial async impl

  JohnSully

  committed
  e95c8b4

  Copy full SHA for e95c8b4

• Use MultiGet

  JohnSully

  committed
  f0e8c6f

  Copy full SHA for f0e8c6f

• Remove a global lock

  JohnSully

  committed
  cdc5e8f

  Copy full SHA for cdc5e8f

• Avoid 0 size batches

  JohnSully

  committed
  71b92e7

  Copy full SHA for 71b92e7

Commits on Sep 26, 2023

• More fixes

  JohnSully

  committed
  b0935de

  Copy full SHA for b0935de

Commits on Nov 7, 2023

• Inform the kernel when we won't need the disk reserve

  JohnSully

  committed
  7e745ef

  Copy full SHA for 7e745ef

• Free up the disk repl buffer when its not being used

  JohnSully

  committed
  a4ca527

  Copy full SHA for a4ca527

Commits on Nov 15, 2023

• want to correctly cache the system total memory always, as force-eviction-percent is a mutable config (#236)

  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  0b5b0c0

  Copy full SHA for 0b5b0c0

Commits on Nov 17, 2023

• commitChanges async api

  

  a00817524

  authored and

  JohnSully

  committed
  f53dbd3

  Copy full SHA for f53dbd3

• missed changes

  

  a00817524

  authored and

  JohnSully

  committed
  eea48c5

  Copy full SHA for eea48c5

• some fixes

  

  a00817524

  authored and

  JohnSully

  committed
  e874752

  Copy full SHA for e874752

• build fixes

  

  a00817524

  authored and

  JohnSully

  committed
  4c014ee

  Copy full SHA for 4c014ee

• correcting classname

  

  a00817524

  authored and

  JohnSully

  committed
  1129f67

  Copy full SHA for 1129f67

• missed changes

  

  a00817524

  authored and

  JohnSully

  committed
  de73b2c

  Copy full SHA for de73b2c

• fixed some errors

  

  a00817524

  authored and

  JohnSully

  committed
  4818ddf

  Copy full SHA for 4818ddf

• reverting changes of async io rocksdb option as this is version dependent

  

  a00817524

  authored and

  JohnSully

  committed
  0cf263c

  Copy full SHA for 0cf263c

• removing unwanted loc

  

  a00817524

  authored and

  JohnSully

  committed
  567ef8d

  Copy full SHA for 567ef8d

• whitespace removed

  

  a00817524

  authored and

  JohnSully

  committed
  b6b7b1b

  Copy full SHA for b6b7b1b

• review rework, added serverassert default switch case,removed debug prints, removed unwanted reset of pointers

  

  a00817524

  authored and

  JohnSully

  committed
  1d59efb

  Copy full SHA for 1d59efb

• add support for overload-ignorelist (#237)

  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  c889505

  Copy full SHA for c889505

Commits on Nov 27, 2023

• update insufficient replicas metrics to separate severity

  zliang-sc

  committed
  20ae39d

  Copy full SHA for 20ae39d

• Overload CPU reading metric (#240)

  Show description for 8a5857d
  

  jbohac-sc

  authored and

  GitHub Enterprise

  committed
  8a5857d

  Copy full SHA for 8a5857d

Commits on Nov 28, 2023

• emit number of active replicas metrics instead

  zliang-sc

  committed
  8fec9ba

  Copy full SHA for 8fec9ba

• add cool

  zliang-sc

  committed
  443e1af

  Copy full SHA for 443e1af

• Merge branch 'main' into improve-insufficient-replica-alarm

  zliang-sc

  committed
  18d6241

  Copy full SHA for 18d6241

• Merge pull request #241 from Snapchat/improve-insufficient-replica-alarm

  Show description for deb139e
  

  zliang-sc

  authored and

  GitHub Enterprise

  committed
  deb139e

  Copy full SHA for deb139e

Commits on Dec 4, 2023

• update overload-ignore-list to accept subnets as well (#239)

  Show description for 49afd8f
  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  49afd8f

  Copy full SHA for 49afd8f

Commits on Dec 8, 2023

• add overload-protect-tenacity to configure how many clients to evict (#243)

  Show description for bb115ca
  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  bb115ca

  Copy full SHA for bb115ca

• TLS cname loadshedding ignore list (#242)

  Show description for bb7c5a4
  

  jbohac-sc

  authored and

  GitHub Enterprise

  committed
  bb7c5a4

  Copy full SHA for bb7c5a4

Commits on Jan 10, 2024

• refactor asyncwrite and asyncread work queue

  

  Yu Zhao (Yuri)

  authored and

  JohnSully

  committed
  e1935a7

  Copy full SHA for e1935a7

Commits on Jan 11, 2024

• Fix compile warning

  JohnSully

  committed
  3d4c5a0

  Copy full SHA for 3d4c5a0

Commits on Jan 23, 2024

• change overload protection to sending -OVERLOAD errors instead of disconnecting clients (#245)

  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  b74652a

  Copy full SHA for b74652a

Commits on Jan 25, 2024

• handle nodes in handshake state in statsd module cluster nodes metrics (#246)

  Show description for 2b01c6c
  

  2 peopleauthored and

  GitHub Enterprise

  committed
  2b01c6c

  Copy full SHA for 2b01c6c

Commits on Jan 26, 2024

• reset replica offsets after resetting replication buffer (#247)

  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  7a32cf9

  Copy full SHA for 7a32cf9

Commits on Jan 30, 2024

• Add redis bloom module (#252)

  Show description for d1484aa
  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  d1484aa

  Copy full SHA for d1484aa

• Fix replication rdb load timeout (#251)

  Show description for 5681d06
  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  5681d06

  Copy full SHA for 5681d06

• skip memefficiency tests in CI as they are inconsistent (#250)

  

  msotheeswaran-sc

  authored and

  GitHub Enterprise

  committed
  77eaaa2

  Copy full SHA for 77eaaa2

Commits on Jan 31, 2024

• Fix crash in replica replaying storage op

  JohnSully

  committed
  65b9165

  Copy full SHA for 65b9165

• Prevent crash on client disconnecting while I/O in flight

  JohnSully

  committed
  989421e

  Copy full SHA for 989421e

• Merge branch 'main' into async_flash

  JohnSully

  committed
  7b50232

  Copy full SHA for 7b50232

Commits on Feb 15, 2024

• Log hitrate metric in modstatsd (#255)

  Show description for 195828e
  

  acope-sc

  authored and

  GitHub Enterprise

  committed
  195828e

  Copy full SHA for 195828e

Commits on Feb 21, 2024

• Limit repl buffer writes per event loop (#256)

  Show description for cba3998
  

  acope-sc

  authored and

  GitHub Enterprise

  committed
  cba3998

  Copy full SHA for cba3998

Commits on Feb 22, 2024

• Fix for hit rate metric (#257)

  Show description for 752f204
  

  acope-sc

  authored and

  GitHub Enterprise

  committed
  752f204

  Copy full SHA for 752f204

Commits on Feb 29, 2024

• Merge branch 'main' into async_flash

  JohnSully

  committed
  490ee84

  Copy full SHA for 490ee84

Commits on Mar 1, 2024

• Return set to vector for clients to be processed ensuring we run them in order

  JohnSully

  committed
  c08683e

  Copy full SHA for c08683e

• Do not create threadpools if we won't need them

  JohnSully

  committed
  260f47b

  Copy full SHA for 260f47b

• Fix test failure due to slowness with many DBs

  JohnSully

  committed
  e5f8e77

  Copy full SHA for e5f8e77

Commits on Mar 4, 2024

• Fix linker issues with newer linkers

  JohnSully

  committed
  e7ab275

  Copy full SHA for e7ab275

Commits on Mar 5, 2024

• Fix crash

  JohnSully

  committed
  8f2dbc3

  Copy full SHA for 8f2dbc3

• Fix hung clients

  JohnSully

  committed
  c5c4779

  Copy full SHA for c5c4779

• Fix typo in test path

  JohnSully

  committed
  8c4fa5d

  Copy full SHA for 8c4fa5d

• Serialize writes due to races causing test failures

  JohnSully

  committed
  7a488a8

  Copy full SHA for 7a488a8

• Enable key cache for async reads

  JohnSully

  committed
  8a2016a

  Copy full SHA for 8a2016a

• Fix ARM CI

  JohnSully

  committed
  bff8b73

  Copy full SHA for bff8b73

• Build with flash

  JohnSully

  committed
  6c15c43

  Copy full SHA for 6c15c43

Commits on Mar 7, 2024

• Emit maxstorage metric

  JohnSully

  committed
  fe5503a

  Copy full SHA for fe5503a

Commits on Mar 8, 2024

• Fix expire tracking assert failure

  JohnSully

  committed
  c83c55f

  Copy full SHA for c83c55f

• Disable swapdb with flash since it doesn't work

  JohnSully

  committed
  ad2a282

  Copy full SHA for ad2a282

• Ensure cluster tests run in flash mode in CI

  JohnSully

  committed
  088a1db

  Copy full SHA for 088a1db

• Fix crash in FLASH eviction

  JohnSully

  committed
  d84fa52

  Copy full SHA for d84fa52

• Disable swapdb tests with flash

  JohnSully

  committed
  559588b

  Copy full SHA for 559588b

Commits on Mar 18, 2024

• Fixup ifdef for easier switching

  JohnSully

  committed
  5fbe991

  Copy full SHA for 5fbe991

Commits on Mar 19, 2024

• Fix asserts after RDB load with FLASH

  JohnSully

  committed
  a430473

  Copy full SHA for a430473

• Add FLASH tests to CI

  JohnSully

  committed
  0267bc5

  Copy full SHA for 0267bc5

• Fix hash count mismatch asserts for getKeysInSlot

  JohnSully

  committed
  f5e367d

  Copy full SHA for f5e367d

Commits on Mar 20, 2024

• Add data on actual disk used that is compared to maxstorage

  JohnSully

  committed
  41733d7

  Copy full SHA for 41733d7

• Fix warning

  JohnSully

  committed
  bb1780a

  Copy full SHA for bb1780a

Commits on Apr 4, 2024

• Handle pending IO fastsync

  JohnSully

  committed
  e580a8e

  Copy full SHA for e580a8e

Commits on Apr 5, 2024

• Fix fastsync test failures caused by closing due to repl buffer size too soon

  JohnSully

  committed
  c50e2d4

  Copy full SHA for c50e2d4

• Naming fix

  JohnSully

  committed
  66be482

  Copy full SHA for 66be482

• Prevent erroneous socket closure

  JohnSully

  committed
  f886fce

  Copy full SHA for f886fce