Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Temp: use circleCI build java static #67

Draft
wants to merge 79 commits into
base: FRocksDB-8.5.3
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
c41122b
Even more HyperClockCache refactoring (#11630)
pdillinger Jul 24, 2023
9cc0986
Fix comment in WriteBatchWithIndex::NewIteratorWithBase (#11636)
Jul 24, 2023
5c2a063
Clarify usage for options `ttl` and `periodic_compaction_seconds` for…
cbi42 Jul 26, 2023
4ea7b79
Respect cutoff timestamp during flush (#11599)
jowlyzhang Jul 26, 2023
c24ef26
Support switching on / off UDT together with in-Memtable-only feature…
jowlyzhang Jul 27, 2023
63a5125
Fix use_after_free bug when underlying FS enables kFSBuffer (#11645)
akankshamahajan15 Jul 27, 2023
5dd8c11
Add a UDT comparator for ReverseBytewiseComparator to object library …
jowlyzhang Jul 27, 2023
6a0f637
Compare the number of input keys and processed keys for compactions (…
cbi42 Jul 28, 2023
c205a21
Strip leading and trailing whitespace for unreleased_history entries …
pdillinger Jul 28, 2023
b3c5418
Allow TryAgain in db_stress with optimistic txn, and refactoring (#11…
pdillinger Jul 28, 2023
7a1b020
format_version=6 and context-aware block checksums (#9058)
pdillinger Jul 30, 2023
bb8fcc0
db_stress: Reinstate Transaction::Rollback() calls before destruction…
pdillinger Jul 31, 2023
9a2a6db
Use C++17 [[fallthrough]] in transaction_test.cc (#11663)
jaykorean Aug 1, 2023
946d100
Expand Statistics support in the C API (#11263)
amatveev-cf Aug 2, 2023
f4e4039
Add some more bit operations to internal APIs (#11660)
pdillinger Aug 2, 2023
cf95821
Update for 8.5.fb branch cut (#11642)
ajkr Aug 2, 2023
f9de217
Some cache_bench enhancements (#11661)
pdillinger Aug 2, 2023
87a21d0
Add an option to trigger flush when the number of range deletions rea…
vrdhn Aug 3, 2023
09882a5
Prepare for deprecation of Options::access_hint_on_compaction_start (…
hx235 Aug 4, 2023
eca48bc
Avoid shifting component too large error in FileTtlBooster (#11673)
cbi42 Aug 4, 2023
4500a0d
Avoid an std::map copy in persistent stats (#11681)
ajkr Aug 7, 2023
cdb11f5
More minor HCC refactoring + typed mmap (#11670)
pdillinger Aug 7, 2023
d2b0652
compute compaction score once for a batch of range file deletes (#10744)
tabokie Aug 7, 2023
6d1effa
exclude uninitialized files when estimating compression ratio (#11664)
tabokie Aug 7, 2023
99daea3
Prepare tests for new HCC naming (#11676)
pdillinger Aug 8, 2023
e214964
Fix a potential memory leak on row_cache insertion failure (#11682)
pdillinger Aug 8, 2023
9c2ebcc
Log user_defined_timestamps_persisted flag in event logger (#11683)
jowlyzhang Aug 8, 2023
9a03480
Group rocksdb.sst.read.micros stat by different user read IOActivity …
hx235 Aug 9, 2023
c751583
Set default cf ts sz for a reused transaction (#11685)
jowlyzhang Aug 9, 2023
76ed9a3
Add missing status check when compiling with `ASSERT_STATUS_CHECKED=1…
cbi42 Aug 9, 2023
a85eccc
Adjust db_stress handling of TryAgain from optimistic txn (#11691)
pdillinger Aug 10, 2023
36f48d1
Add consistent ways to access the builtin UDT comparators (#11690)
jowlyzhang Aug 10, 2023
66643b8
PutEntity Support in SST File Writer (#11688)
jaykorean Aug 11, 2023
17b33c8
fix CXX not initialized early enough in Makefile on openbsd + platfor…
nikoPLP Aug 11, 2023
7cdbce4
Add UDT support in API DB::GetApproximateMemTableStats (#11689)
jowlyzhang Aug 11, 2023
52816ff
Close DB option in WaitForCompact() (#11497)
jaykorean Aug 11, 2023
38ecfab
Remove comment about locking about TestIterateAgainstExpected (#11695)
hx235 Aug 11, 2023
ef6f025
Placeholder for AutoHyperClockCache, more (#11692)
pdillinger Aug 11, 2023
793a786
Fix for unchecked status in CancelAllBackgroundWork (#11699)
jaykorean Aug 12, 2023
a09c141
In TestIterateAgainstExpected(), verify iterator moves in expected di…
ajkr Aug 14, 2023
6a3da56
Add documentation to some formatting util functions (#11674)
jowlyzhang Aug 15, 2023
407efb0
Expose the root comparator for built-in With64Ts comparators (#11704)
jowlyzhang Aug 15, 2023
b63018f
Wide Column Ingestion in CrashTest (#11697)
jaykorean Aug 15, 2023
0b6ee88
clarify TODO for whitebox disable_wal=1 in db_crashtest.py (#11665)
ajkr Aug 16, 2023
d1ff401
Delay bottommost level single file compactions (#11701)
cbi42 Aug 17, 2023
966be1c
Clean up some FastRange calls (#11707)
pdillinger Aug 17, 2023
1e77e35
Add a per column family default temperature option for accounting (#1…
jowlyzhang Aug 18, 2023
a67ef99
Explicitly instantiate MaybeReadBlockAndLoadToCache as well (#11714)
zhuhan0 Aug 18, 2023
a1743e8
Implement a allow cache hits admission policy for the compressed seco…
anand1976 Aug 18, 2023
0fa0c97
Timeout in microsecond option in WaitForCompactOptions (#11711)
jaykorean Aug 18, 2023
c2aad55
Add `CompressionOptions::checksum` for enabling ZSTD checksum (#11666)
cbi42 Aug 18, 2023
f65a037
Implement trimming of readhead size when upper bound is specified (#1…
akankshamahajan15 Aug 18, 2023
6e9cabf
Update HISTORY.md for 8.6
anand1976 Aug 21, 2023
e116864
Clarify comment about compaction_readahead_size's sanitization change…
hx235 Aug 24, 2023
973d7b7
Revert "Clarify comment about compaction_readahead_size's sanitizatio…
hx235 Aug 30, 2023
bb57fdc
Change compaction_readahead_size default value to 2MB (#11762)
hx235 Aug 30, 2023
768b9df
Update HISTORY.md and version to 8.6.1
anand1976 Aug 30, 2023
4bac0c5
Fix seg fault in auto_readahead_size during IOError (#11761)
akankshamahajan15 Aug 25, 2023
eec39aa
Fix seg fault in auto_readahead_size with async_io (#11769)
akankshamahajan15 Aug 29, 2023
e31f8a1
Avoid alignment in FilePrefetchBuffer during seek with async_io (#11793)
akankshamahajan15 Sep 11, 2023
ccf5149
Update HISTORY.md and version to 8.6.2
akankshamahajan15 Sep 12, 2023
bd36dce
Include iterator status and delete range fix. (#11821)
cbi42 Sep 12, 2023
1b4fe9b
Add unit test for default temperature (#11722)
jowlyzhang Aug 21, 2023
2f04b1a
Update HISTORY.md and version.h for 8.6.4
jowlyzhang Sep 13, 2023
935b6ad
remove db.open from 8.6 hist
hx235 Sep 14, 2023
e17c2ae
Fix a bug of rocksdb.file.read.verify.file.checksums.micros not being…
hx235 Sep 15, 2023
a1bd631
Update HISTORY.md and version.h for 8.6.5
hx235 Sep 15, 2023
d01f4b3
Delete PR 11836 unreleased history entry
hx235 Sep 18, 2023
2c78b1b
Disable compressed secondary cache if capacity is 0 (#11863)
anand1976 Sep 21, 2023
8c2e91a
Patch 8.6.6 (#11886)
cbi42 Sep 25, 2023
347d8dd
No file system prefetching when Options::compaction_readahead_size is…
hx235 Sep 26, 2023
27297d1
Only fallback to RocksDB internal prefetching on unsupported FS prefe…
hx235 Sep 27, 2023
cb7a5e0
Update HISTORY and version.h for 8.6.7
hx235 Sep 26, 2023
b0655aa
Fix the problem that some keys of ClipColumnFamily may not be deleted…
mayuehappy Sep 14, 2023
e2cddca
add RocksDB#clipColumnFamily to Java API (#11868)
mayuehappy Nov 2, 2023
97804df
Add jni Support for API CreateColumnFamilyWithImport (#11646)
mayuehappy Nov 6, 2023
4c501c8
[FLINK-10471] Add Apache Flink specific compaction filter to evict ex…
azagrebin Feb 6, 2019
33da775
[FLINK-23756] Update FrocksDB release document with more info
autophagy Aug 16, 2021
e83f601
Update zlib version
Nov 16, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
145 changes: 75 additions & 70 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ commands:
command: |
mkdir build
cd build
& $Env:CMAKE_BIN -G "$Env:CMAKE_GENERATOR" -DCMAKE_BUILD_TYPE=Debug -DOPTDBG=1 -DPORTABLE=1 -DSNAPPY=1 -DJNI=1 ..
& $Env:CMAKE_BIN -G "$Env:CMAKE_GENERATOR" -DCMAKE_BUILD_TYPE=RELEASE -DOPTDBG=1 -DPORTABLE=1 -DSNAPPY=1 -DJNI=1 ..
cd ..
echo "Building with VS version: $Env:CMAKE_GENERATOR"
msbuild.exe build/rocksdb.sln -maxCpuCount -property:Configuration=Debug -property:Platform=x64
Expand All @@ -77,6 +77,8 @@ commands:
shell: powershell.exe
command: |
build_tools\run_ci_db_test.ps1 -SuiteRun arena_test,db_basic_test,db_test,db_test2,db_merge_operand_test,bloom_test,c_test,coding_test,crc32c_test,dynamic_bloom_test,env_basic_test,env_test,hash_test,random_test -Concurrency 16
- store_artifacts:
path: build\java
pre-steps-macos:
steps:
- pre-steps
Expand Down Expand Up @@ -544,7 +546,7 @@ jobs:
build-windows-vs2022:
executor:
name: win/server-2022
size: 2xlarge
size: xlarge
environment:
THIRDPARTY_HOME: C:/Users/circleci/thirdparty
CMAKE_HOME: C:/Program Files/CMake
Expand Down Expand Up @@ -589,8 +591,9 @@ jobs:
- post-steps

build-linux-java-static:
executor: linux-docker
resource_class: large
machine:
image: ubuntu-2004:202111-02
resource_class: arm.xlarge
steps:
- pre-steps
- run:
Expand All @@ -602,7 +605,9 @@ jobs:
which javac && javac -version
- run:
name: "Build RocksDBJava Static Library"
command: make V=1 J=8 -j8 rocksdbjavastatic
command: DEBUG_LEVEL=0 ROCKSDB_DISABLE_JEMALLOC=true PORTABLE=1 CXXFLAGS="-Wno-error=shadow -Wno-error-defaulted-function-deleted -Wno-unknown-warning-option " make V=1 J=8 -j8 rocksdbjavastaticdockerarm64v8musl
- store_artifacts:
path: java/target
- post-steps

build-macos-java:
Expand Down Expand Up @@ -807,74 +812,74 @@ jobs:

workflows:
version: 2
jobs-linux-run-tests:
jobs:
- build-linux
- build-linux-cmake-with-folly
- build-linux-cmake-with-folly-lite-no-test
- build-linux-gcc-7-with-folly
- build-linux-gcc-7-with-folly-lite-no-test
- build-linux-cmake-with-folly-coroutines
- build-linux-cmake-with-benchmark
- build-linux-encrypted_env-no_compression
jobs-linux-run-tests-san:
jobs:
- build-linux-clang10-asan
- build-linux-clang10-ubsan
- build-linux-clang10-mini-tsan
- build-linux-static_lib-alt_namespace-status_checked
jobs-linux-no-test-run:
jobs:
- build-linux-release
- build-linux-release-rtti
- build-examples
- build-fuzzers
- build-linux-clang-no_test_run
- build-linux-clang-13-no_test_run
- build-linux-gcc-8-no_test_run
- build-linux-gcc-10-cxx20-no_test_run
- build-linux-gcc-11-no_test_run
- build-linux-arm-cmake-no_test_run
jobs-linux-other-checks:
jobs:
- build-linux-clang10-clang-analyze
- build-linux-unity-and-headers
- build-linux-mini-crashtest
# jobs-linux-run-tests:
# jobs:
# - build-linux
# - build-linux-cmake-with-folly
# - build-linux-cmake-with-folly-lite-no-test
# - build-linux-gcc-7-with-folly
# - build-linux-gcc-7-with-folly-lite-no-test
# - build-linux-cmake-with-folly-coroutines
# - build-linux-cmake-with-benchmark
# - build-linux-encrypted_env-no_compression
# jobs-linux-run-tests-san:
# jobs:
# - build-linux-clang10-asan
# - build-linux-clang10-ubsan
# - build-linux-clang10-mini-tsan
# - build-linux-static_lib-alt_namespace-status_checked
# jobs-linux-no-test-run:
# jobs:
# - build-linux-release
# - build-linux-release-rtti
# - build-examples
# - build-fuzzers
# - build-linux-clang-no_test_run
# - build-linux-clang-13-no_test_run
# - build-linux-gcc-8-no_test_run
# - build-linux-gcc-10-cxx20-no_test_run
# - build-linux-gcc-11-no_test_run
# - build-linux-arm-cmake-no_test_run
# jobs-linux-other-checks:
# jobs:
# - build-linux-clang10-clang-analyze
# - build-linux-unity-and-headers
# - build-linux-mini-crashtest
jobs-windows:
jobs:
- build-windows-vs2022
- build-windows-vs2019
- build-cmake-mingw
jobs-java:
jobs:
- build-linux-java
- build-linux-java-static
- build-macos-java
- build-macos-java-static
- build-macos-java-static-universal
jobs-macos:
jobs:
- build-macos
- build-macos-cmake:
run_even_tests: true
- build-macos-cmake:
run_even_tests: false
jobs-linux-arm:
jobs:
- build-linux-arm
build-fuzzers:
jobs:
- build-fuzzers
benchmark-linux:
triggers:
- schedule:
cron: "0 * * * *"
filters:
branches:
only:
- main
jobs:
- benchmark-linux
# - build-windows-vs2019
# - build-cmake-mingw
# jobs-java:
# jobs:
# - build-linux-java
# - build-linux-java-static
# - build-macos-java
# - build-macos-java-static
# - build-macos-java-static-universal
# jobs-macos:
# jobs:
# - build-macos
# - build-macos-cmake:
# run_even_tests: true
# - build-macos-cmake:
# run_even_tests: false
# jobs-linux-arm:
# jobs:
# - build-linux-arm
# build-fuzzers:
# jobs:
# - build-fuzzers
# benchmark-linux:
# triggers:
# - schedule:
# cron: "0 * * * *"
# filters:
# branches:
# only:
# - main
# jobs:
# - benchmark-linux
nightly:
triggers:
- schedule:
Expand Down
2 changes: 2 additions & 0 deletions CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -891,6 +891,7 @@ set(SOURCES
utilities/fault_injection_env.cc
utilities/fault_injection_fs.cc
utilities/fault_injection_secondary_cache.cc
utilities/flink/flink_compaction_filter.cc
utilities/leveldb_options/leveldb_options.cc
utilities/memory/memory_util.cc
utilities/merge_operators.cc
Expand Down Expand Up @@ -1434,6 +1435,7 @@ if(WITH_TESTS)
utilities/cassandra/cassandra_serialize_test.cc
utilities/checkpoint/checkpoint_test.cc
utilities/env_timed_test.cc
utilities/flink/flink_compaction_filter_test.cc
utilities/memory/memory_test.cc
utilities/merge_operators/string_append/stringappend_test.cc
utilities/object_registry_test.cc
Expand Down
Loading