include/rocksdb: Configuration validation while opening a DB#517

Draft

AmnonHanuhov wants to merge 281 commits intomainfrom 385-configuration-validation-while-opening-a-db

+27,809-13,460

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 25, 2023

git: add clangd cache to .gitignore

isaac-io
authored and
Yuval-Ariel
committed
column_family: make the comparison of the SuperVersion pointer explicit
Yuval-Ariel
committed
Rename rocksdb threads to speedb

speedbmike
authored and
Yuval-Ariel
committed
log: change log header to SpeeDB
Yuval-Ariel
committed
SPDB-467: Report the metadata_cache_options table options to the trace

udi-speedb
authored and
Yuval-Ariel
committed
SPDB-538: Support configuration of metadata-cache-options in db_bench

udi-speedb
authored and
Yuval-Ariel
committed
SPDB-632: Print write_buffer_manager size to LOG
Yuval-Ariel
committed
SPDB-347: Add a version number to our builds

isaac-io
authored and
Yuval-Ariel
committed
SPDB-382: Exclude third party code from the checks
Yuval-Ariel
committed
SPDB-270: db_bench: add SeekRandomWriteRandom test
Yuval-Ariel
committed
README: Update to contain a quick start guide for speedb

Amnon Hanuhov
authored and
Yuval-Ariel
committed
customizable_test: revert the offsetof() build-related fixes (#55 )

isaac-io
authored and
Yuval-Ariel
committed
SPDB-180: general: avoid comparing Status using == as it only compares status code

isaac-io
authored and
Yuval-Ariel
committed
SPDB-180: tests: avoid comparing Status using == as it only compares status code

isaac-io
authored and
Yuval-Ariel
committed
SPDB-156: db_test: add test for - forward the incomplete status on no_io
Yuval-Ariel
committed
SPDB-341: optimistic_transaction_example: fix snapshots leak

isaac-io
authored and
Yuval-Ariel
committed
SPDB-96: ldb: fix get to print the entire value

isaac-io
authored and
Yuval-Ariel
committed
SPDB-534: db_bench: fix rocksdb bug of last_ref assertion
Yuval-Ariel
committed
SPDB 521: db_bench: fix SeekRandom and ReadRandomWriteRandom
Yuval-Ariel
committed
mutable_db_options: fix a Clang 14 build error (#57 )

isaac-io
authored and
Yuval-Ariel
committed
db_bench: reset the last operation time where rate limiting is applied

hilikspdb
authored and
Yuval-Ariel
committed
Add ability to create MemTableFactory from URI/string to tools

mrambacher
authored and
Yuval-Ariel
committed
cmake: use the old plugin infra and add support for *_FUNC registration (#80 )

isaac-io
authored and
Yuval-Ariel
committed
spdb memtable: add a new hash-based memtable

ayulas
authored and
Yuval-Ariel
committed
build: always add the Speedb plugin to the build (#87 )

isaac-io
authored and
Yuval-Ariel
committed
crash_test: add the new memtable as a random choice (#89 )

isaac-io
authored and
Yuval-Ariel
committed
spdb_memtable: fix an unused parameter issue (#91 )

isaac-io
authored and
Yuval-Ariel
committed
crash_test: fix incorrect passing of the memtablerep argument (#93 )

isaac-io
authored and
Yuval-Ariel
committed
crash_test: remove the hash-based memtable from crash test (#98 )

isaac-io
authored and
Yuval-Ariel
committed
CI: initial setup

nathan-bo
authored and
Yuval-Ariel
committed
Update issue templates

rtpro
authored and
Yuval-Ariel
committed
ci: add a /var/tmp volume to the QA tests to fix tests failing (#107 )

isaac-io
authored and
Yuval-Ariel
committed
release: publish version 2.0.0

isaac-io
authored and
Yuval-Ariel
committed
docs: update README and CODE_OF_CONDUCT

rtpro
authored and
Yuval-Ariel
committed
* Update CONTRIBUTING.md

authored and
Yuval-Ariel
committed
build: fix the java test target dependencies (#128 )

isaac-io
authored and
Yuval-Ariel
committed
flush_job: do not roll back memtable flush on CF drop and DB shutdown (#126 )

isaac-io
authored and
Yuval-Ariel
committed
Update test_fuzz.yml

nathan-bo
authored and
Yuval-Ariel
committed
bloom_test: fix compilation error with GCC 12 (#136 )

isaac-io
authored and
Yuval-Ariel
committed
build: clean up the Makefile a bit (#118 )

isaac-io
authored and
Yuval-Ariel
committed
build: allow setting the path to GNU Parallel in the Makefile (#118 )

isaac-io
authored and
Yuval-Ariel
committed
licence: remove the GPL as an alternative licence (#118 )

isaac-io
authored and
Yuval-Ariel
committed
docs: update license files to comply with Apache 2.0 (#111 )

rtpro
authored and
Yuval-Ariel
committed
Adding logo to readme (#135 )

rtpro
authored and
Yuval-Ariel
committed
ci: move fuzz testing to reusable workflow (#133 )

nathan-bo
authored and
Yuval-Ariel
committed
plugins: add Plugin Tests to builds (#123 )

mrambacher
authored and
Yuval-Ariel
committed
makefile: avoid setting TEST_TMPDIR unnecessarily (#140 )

isaac-io
authored and
Yuval-Ariel
committed
crash_test: clean up DB copies in whitebox and narrow test (#159 )

isaac-io
authored and
Yuval-Ariel
committed
#34 : set purges as Pri::Low
Yuval-Ariel
committed
db: Fixes for db_test2 and deletefile_test

AmnonHanuhov
authored and
Yuval-Ariel
committed

Commits on May 4, 2023

Accurate memory tracking of immutable memory (#132 ) - adapted

udi-speedb
authored and
Yuval-Ariel
committed
Update logo dark mode

rtpro
authored and
Yuval-Ariel
committed
db_bench: allow setting avoid_unnecessary_blocking_io (#183 )

isaac-io
authored and
Yuval-Ariel
committed
makefile: fix shell tab-completions (#147 )

isaac-io
authored and
Yuval-Ariel
committed
makefile: fix parallel make check failing on the first run (#177 )

isaac-io
authored and
Yuval-Ariel
committed
fix a typo

jsteemann
authored and
Yuval-Ariel
committed
docs: fix a broken link in the contributing guide (#153 )

dinga-dinga
authored and
Yuval-Ariel
committed
docs: update HISTORY.md (#189 )

bosmatt
authored and
Yuval-Ariel
committed
CI: run stress tests for 1hr instead of 500secs
Yuval-Ariel
committed
cmake: allow running the tests in parallel like in the Makefile (#102 )

isaac-io
authored and
Yuval-Ariel
committed
makefile: rework the dependency graph for faster test runs startup (#174 )

isaac-io
authored and
Yuval-Ariel
committed
tools: Make FilterPolicy settable via URI/CreateFromString (#71 )

mrambacher
authored and
Yuval-Ariel
committed
options: fix documentation from #34 purges set to LOW
Yuval-Ariel
committed
options: change the default value for compaction threads to 8 (#169 )

isaac-io
authored and
Yuval-Ariel
committed
Speedb's Paired Block Bloom (#29 )

udi-speedb
authored and
Yuval-Ariel
committed
tests: fix breakage caused by the compaction threads value change (#197 )

isaac-io
authored and
Yuval-Ariel
committed
paired_filter: fix copyright and licence headers (#199 ) (#204 )

isaac-io
authored and
Yuval-Ariel
committed
build: clean up the build configuration to allow rebranding (#64 )

isaac-io
authored and
Yuval-Ariel
committed
build: rename artefacts from RocksDB to Speedb (#64 )

isaac-io
authored and
Yuval-Ariel
committed
scripts: rename RocksDB references to Speedb (#64 )

isaac-io
authored and
Yuval-Ariel
committed
general: replace RocksDB references in strings with Speedb (#64 )

isaac-io
authored and
Yuval-Ariel
committed
tools: replace RocksDB version information with the Speedb version (#64 )

isaac-io
authored and
Yuval-Ariel
committed
Added questions section to the README file

bosmatt
authored and
Yuval-Ariel
committed
ci: fix the release pipeline

isaac-io
authored and
Yuval-Ariel
committed
release: publish version 2.1.0

GitHub Runner Bot
authored and
Yuval-Ariel
committed
cmake: clean up on successful runs and randomise test scheduling (#202 )

isaac-io
authored and
Yuval-Ariel
committed
build: add a version build-tag for non-release builds (#156 )

isaac-io
authored and
Yuval-Ariel
committed
build: support ccache and sccache in the Makefile build (#170 )

isaac-io
authored and
Yuval-Ariel
committed
memtable_list: avoid rolling back memtable flush on CF drop (#144 )

isaac-io
authored and
Yuval-Ariel
committed
deletefile_test: fix breakage caused by the compaction threads change (#217 )

isaac-io
authored and
Yuval-Ariel
committed
docs: Update README.md (#212 )
Yuval-Ariel
committed
docs: readme typo fix (#223 )

azmisaquib
authored and
Yuval-Ariel
committed
docs: fix instructions for building Speedb in README.md and INSTALL.md

isaac-io
authored and
Yuval-Ariel
committed
ci: build a release without a debug tag (#228 )

isaac-io
authored and
Yuval-Ariel
committed
build: correctly handle merge commits when calculating a build tag (#225 )

isaac-io
authored and
Yuval-Ariel
committed
db_test2: fix BackgroundPurgeTest (#236 )
Yuval-Ariel
committed
docs: Update HISTORY.md README.md (#239 )

bosmatt
authored and
Yuval-Ariel
committed
db_bench: Fix a bug when destructing a Benchmark with multiple db-s (#234 )

udi-speedb
authored and
Yuval-Ariel
committed
hash spd memtable (#98 )

ayulas
authored and
Yuval-Ariel
committed
Rebase 8.1.1: fix for hash spd memtable (#98 )
Yuval-Ariel
committed
db_bench: add benchmark - seektodeletedranges (#200 )
Yuval-Ariel
committed
db_bench: Make -statistics_string behave as -statistics (#248 )

udi-speedb
authored and
Yuval-Ariel
committed
docs: Add db_bench README

bosmatt
authored and
Yuval-Ariel
committed
QA tool to check artifacts (#120 )

RoyBenMoshe
authored and
Yuval-Ariel
committed
ci: added db_bench_README.txt to db_bench-speedb-V.tar.gz (#253 )

maxb-io
authored and
Yuval-Ariel
committed
cmake: Fix build for rebase 7.7.3 (#264 )
Yuval-Ariel
committed
java makefile: fix dependencies
Yuval-Ariel
committed
Fix check sources to ignore GIF files

mrambacher
authored and
Yuval-Ariel
committed
rebase 7.7: fix merge issues
Yuval-Ariel
committed
db_bench: Enhancement - Support multiple benchmarks groups, each with its own config (#220 )

udi-speedb
authored and
Yuval-Ariel
committed
Rebase 8.1.1: fix for db_bench: Enhancement - Support multiple benchmarks groups, each with its own config (#220 )
Yuval-Ariel
committed
db_bench: ErrorExit from static func compiler error (#277 )
Yuval-Ariel
committed
db_bench: Support control over WBM's allow_stall ctor parameter (#187 )

udi-speedb
authored and
Yuval-Ariel
committed
db_bench: Enhancement - Allow specifying the db-s to use in each group

udi-speedb
authored and
Yuval-Ariel
committed
db_bench: fix compiler warnings (#263 )
Yuval-Ariel
committed
build: Add gtest-parallel to project

AmnonHanuhov
authored and
Yuval-Ariel
committed
Update README.md (#280 )

bosmatt
authored and
Yuval-Ariel
committed
Update README.md (#291 )

bosmatt
authored and
Yuval-Ariel
committed
db_stress: Support control over WBM's allow_stall (#287 )

udi-speedb
authored and
Yuval-Ariel
committed
db_bench: Support '--groups' in addition to '-groups' (#283 )

udi-speedb
authored and
Yuval-Ariel
committed
unit tests: disable CompactionServiceTest.RemoteEventListener (#300 )
Yuval-Ariel
committed
generic switch memtable allows the ability to pre create memtable that allocated memory as part of the constructor

ayulas
authored and
Yuval-Ariel
committed
Smaller batch size in the paired bloom filter (#161 )

udi-speedb
authored and
Yuval-Ariel
committed
misc: add build properties info to LOG file (#262 )

RoyBenMoshe
authored and
Yuval-Ariel
committed
Dynamic Delay: new feature - Dynamic Delay (#276 )
Yuval-Ariel
committed
Rebase 8.1.1: WriteStallCause moved to types.h
Yuval-Ariel
committed
Proactive Flushes (#155 )

udi-speedb
authored and
Yuval-Ariel
committed
Rebase 8.1.1: fix for Proactive flushes
Yuval-Ariel
committed
Proactive Flushes: compilation warnings fix (#304 )
Yuval-Ariel
committed
unit tests: disable LoadCustomizableTest.LoadMemTableRepFactoryTest (#303 )

ayulas
authored and
Yuval-Ariel
committed
Update artifact-release.yml

maxb-io
authored and
Yuval-Ariel
committed
release: publish version 2.2.0

GitHub Runner Bot
authored and
Yuval-Ariel
committed
Delayed Writes: fix L0 calc bug (#310 )
Yuval-Ariel
committed
Print WBM's cache info to log (#312 )

udi-speedb
authored and
Yuval-Ariel
committed
artifacts check tool: update readme file (#293 )

RoyBenMoshe
authored and
Yuval-Ariel
committed
unit tests: fix CompactionServiceTest.RemoteEventListener (#314 )
Yuval-Ariel
committed
Update README.md

bosmatt
authored and
Yuval-Ariel
committed
build: remove the dependency on GNU Parallel for running unit tests (#122 )

AmnonHanuhov
authored and
Yuval-Ariel
committed
db_bench: set db_bench defaults to speedbs (#61 )
Yuval-Ariel
committed
Spdb memtable: improve performance (#298 )

ayulas
authored and
Yuval-Ariel
committed
add speedb is awesome example to support new getting started instructions(#378 )

RoyBenMoshe
authored and
Yuval-Ariel
committed
db_bench: align used tests (#325 )
Yuval-Ariel
committed
windows build failed in speedb_paired_bloom_internal files due to bad used of double / uint32 casting #383

ayulas
authored and
Yuval-Ariel
committed
unit_tests: Generate new db dir per test (#353 )

mrambacher
authored and
Yuval-Ariel
committed
MAC_build: Add F_BARRIERFSYNC (#319 )

mrambacher
authored and
Yuval-Ariel
committed
db_bench: Fix compilation issues on Mac (#393 )

mrambacher
authored and
Yuval-Ariel
committed
Add Injection and NoSyncFS (#380 )

mrambacher
authored and
Yuval-Ariel
committed
live config changes: add RefreshOptions method (#294 )

mrambacher
authored and
Yuval-Ariel
committed
db_bench: fix for issue (#290 ) (#370 )

authored and
Yuval-Ariel
committed
Paired-Bloom-Filter: Balancing rounding to batches between the bottommost level and rest of the levels (#369 )

noamhaham
authored and
Yuval-Ariel
committed
AXV512: don't use XXH3_accumulate_512 with ASAN (#398 )
Yuval-Ariel
committed
Adapt paired bloom filter & test to cache-related changes in RocksDB

udi-speedb
authored and
Yuval-Ariel
committed
release: publish version 2.3.0

GitHub Runner Bot
authored and
Yuval-Ariel
committed
fault_injection_fs: Add back accidental revert in DropRandomUnsyncedData (#402 )

mrambacher
authored and
Yuval-Ariel
committed
Add speedb licenses to code (#409 )

ofriedma
authored and
Yuval-Ariel
committed
CI: Enforce writing licenses inside source files (#410 )

ofriedma
authored and
Yuval-Ariel
committed
Makefile: Use speedb libs in build_size target (#399 )

AmnonHanuhov
authored and
Yuval-Ariel
committed
ci job test_fuzz - removed saving logs to s3, it is not needed as there is no point to save the logs for long periods

maxb-io
authored and
Yuval-Ariel
committed
removed AWS credentials as they are not required, were used for uploading fuzz test logs

maxb-io
authored and
Yuval-Ariel
committed
Global Write Controller: share write controller across dbs (#346 )
Yuval-Ariel
committed
added ci_macos.yml file for automation of tests and builds on MacOS (#432 )

maxb-io
authored and
Yuval-Ariel
committed
added ci_windows.yml for automation of tests and build on Windows (#435 )

maxb-io
authored and
Yuval-Ariel
committed
added a step that copies thirdparty.inc from external dir to the speedb project. It is required for the build in order to reflect the environment on the runner machine (#442 )

maxb-io
authored and
Yuval-Ariel
committed
Global delay bug fix: use credits only under mutex (#438 )
Yuval-Ariel
committed
crashtest: dont reroll skip_list or HashSpdRepFactory (#452 )
Yuval-Ariel
committed
options: Forward declare WriteBufferManager (#279 )

AmnonHanuhov
authored and
Yuval-Ariel
committed
CI windows: switched VC 2019 to VC 2022 in the ci_windows.yml in order to solve compilation error (#456 )

maxb-io
authored and
Yuval-Ariel
committed
dynamic delay: fix pending bytes rate calculation (#451 )
Yuval-Ariel
committed
Write Flow: Spdb WF (#445 )

ayulas
authored and
Yuval-Ariel
committed
Rebase 8.1.1: fix for WF
Yuval-Ariel
committed
TTL: Skip expired object when using DBWithTtl (#403 )

ofriedma
authored and
Yuval-Ariel
committed
added readline-dev package to the alpine container in the CI test (#463 )

maxb-io
authored and
Yuval-Ariel
committed
adding beezcli and ttl support (#427 )

ofriedma
authored and
Yuval-Ariel
committed
466 artifact build fails due to beezcli is missing (#469 )

maxb-io
authored and
Yuval-Ariel
committed
release: publish version 2.4.0

GitHub Runner Bot
authored and
Yuval-Ariel
committed
Write Flow: Reduce debug logs (#472 )

ayulas
authored and
Yuval-Ariel
committed
Java FilterPolicy: Add Filter::CreateFromString to Java (#387 )

mrambacher
authored and
Yuval-Ariel
committed
Rebase 8.1.1: reintroduce preserve_unverified_changes
Yuval-Ariel
committed
Rebase 8.1.1: fix for speedb_db_bloom_filter_test
Yuval-Ariel
committed
Rebase 8.1.1: Remove leftover ROCKSDB_LITE
Yuval-Ariel
committed
Rebase 8.1.1: make format
Yuval-Ariel
committed
Rebase 8.1.1: disable failing unit tests and paired
Yuval-Ariel
committed
Rebase 8.1.1: fix db_bench
Yuval-Ariel
committed

Commits on May 15, 2023

ci: add a workflow for building and publishing jar to maven central (#507 )
maxb-io
authored

Commits on May 16, 2023

Update HISTORY.md (#508 )
bosmatt
authored

Commits on May 18, 2023

db_bench and stress: fix WBM initiation (#510 )
udi-speedb
authored

Commits on May 21, 2023

LOG: Compaction job traces - report cf name and job id (#511 )
udi-speedb
authored

Commits on May 22, 2023

db_stress: Add cost_write_buffer_to_cache flag (#513 )
udi-speedb
authored

Commits on May 26, 2023

Dirty Memory: Connect WBM to the global delay (#423 )
Yuval-Ariel
authored

Commits on May 30, 2023

db_bench: set Write Flow as false by default (#532 )
Yuval-Ariel
authored

Commits on Jun 6, 2023

unit tests: Enable SpdbDBBloomFilterTest::OptimizeFiltersForHits (#538 )
udi-speedb
authored

Commits on Jun 7, 2023

Commits on Jun 11, 2023

Commits on Jun 13, 2023

CI: sanity_check replace wei/wget action with real wget (#559 )
maxb-io
authored

Commits on Jun 14, 2023

Skip Flush Entry: Tombstone test fix for mac (#561 )
ayulas
authored
release: publish version 2.5.0
GitHub Runner Bot
committed

Commits on Jun 15, 2023

Commits on Jun 18, 2023

Windows compilation fix (#568 )
Yuval-Ariel
authored

Commits on Jun 26, 2023

Commits on Jul 4, 2023

593 build of libspeedbjni linux64so is dynamic needs to be static (#595 )
maxb-io
authored

Commits on Jul 5, 2023

build: Remove unused variables in unit tests (#582 )
RoyBenMoshe
authored

Commits on Jul 13, 2023

604 missing dependencies in jar (#605 )
maxb-io
authored

Commits on Jul 18, 2023

spdb memtable: fix use_seek_parallel_threshold handleding (#603 )
ayulas
authored

Commits on Jul 24, 2023

switch memtable: fix for stuck switch with plug (#610 )
ayulas
authored

Commits on Jul 25, 2023

WriteController: move it to public interface (#579 )
Yuval-Ariel
authored

Commits on Jul 31, 2023

Commits on Aug 3, 2023

Unit tests: Enable DBIOFailureTest.DropWrites (#544 )
mrambacher
authored

Commits on Aug 6, 2023

Commits on Aug 14, 2023

Enable Speedb features (#543 )
RoyBenMoshe
authored

Commits on Aug 16, 2023

CI: fix check license by comparing the right sha (#638 )
Yuval-Ariel
authored

Commits on Aug 17, 2023

Redo of Index/Filter/Data blocks sizes in Block (LRU) Block Cache per CF after rebase on RocksDB (#620 )
udi-speedb
authored

Commits on Aug 18, 2023

hashSpdb memtable: move it from plugin to main code (#640 )
ayulas
authored

Commits on Aug 19, 2023

Commits on Aug 20, 2023

Commits on Aug 21, 2023

Makefile: upgrade Zlib to 1.3 (#646 )
ayulas
authored

Commits on Aug 22, 2023

release: publish version 2.6.0
GitHub Runner Bot
committed

Commits on Aug 29, 2023

Commits on Sep 7, 2023

Fix repeatable threads not working with on thread start feature (#667 )
ofriedma
authored