Skip to content

feat: optimize read throughput #63

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
luke-lombardi merged 24 commits into from
Nov 5, 2025
Merged

feat: optimize read throughput #63

luke-lombardi merged 24 commits into from
Nov 5, 2025

Conversation

@luke-lombardi
Copy link
Contributor

@luke-lombardi luke-lombardi commented Nov 5, 2025

No description provided.

cursoragent and others added 24 commits October 30, 2025 00:41
@cursoragent @luke-lombardi
feat: Implement blobcache optimizations
3b855f6 
This commit introduces several optimizations to improve blobcache performance, including FUSE tuning, gRPC network tuning, buffer pooling, prefetching, and enhanced metrics.

Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
feat: Implement CI/CD performance testing and optimize config
18b6a6f 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
feat: Implement CI/CD performance testing and optimizations
73ff90b 
Co-authored-by: luke <luke@smartshare.io>
@luke-beamcloud
run perf tests
6b8c781
@cursoragent @luke-lombardi
Fix: Remove Redis dependency and improve test stability
d47eb0b 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Checkpoint before follow-up message
5e1465b 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor: Use sync.Once for global metrics and logger initialization
6a6822b 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Fix: Improve disk cache metric error handling and benchmark setup
9865139 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
feat: Adjust performance tests for CI and larger messages
50b5928 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor performance tests and simplify gRPC throughput test
af64112 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Grant permissions for performance tests workflow
93f4159 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor: Remove validation script and adjust test timeouts
d4ac89c 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor: Optimize CI benchmarks and add local testing notes
d22e047 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Checkpoint before follow-up message
7cb4d24 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor: Improve read throughput benchmarks and buffer pool usage
46560c0 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor: Remove throughput benchmarks, focus on buffer pool
8666cf2 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Checkpoint before follow-up message
1af2c4d 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor: Adjust memory cache configuration and benchmark
9bef460 
Update benchmark to use disk-only mode and adjust storage logic to reflect this.

Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
feat: Add gRPC throughput benchmarking and config tuning
f126942 
This commit introduces a new gRPC throughput benchmark and adds configuration options for gRPC window sizes and buffer sizes. It also updates the performance test to include a check for GetContent throughput.

Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Remove redundant FUSE operation latency logging
ec8dc9c 
Co-authored-by: luke <luke@smartshare.io>
@cursoragent @luke-lombardi
Refactor: Make gRPC server config tunable
f3ad57f 
Co-authored-by: luke <luke@smartshare.io>
@luke-beamcloud
clean up default config
62e154f
@luke-beamcloud
cleanup
7a6e38c
@luke-beamcloud
update path
1441b99
@github-actions
Copy link

github-actions bot commented Nov 5, 2025

Benchmark Results

goos: linux
goarch: amd64
pkg: github.com/beam-cloud/blobcache-v2/pkg
cpu: AMD EPYC 7763 64-Core Processor                
BenchmarkBufferPool/size_1MB/WithPool-4         	44775910	        59.35 ns/op	      26 B/op	       1 allocs/op
BenchmarkBufferPool/size_1MB/WithoutPool-4      	   15912	    150329 ns/op	 1048576 B/op	       1 allocs/op
BenchmarkBufferPool/size_4MB/WithPool-4         	43477904	        55.53 ns/op	      29 B/op	       1 allocs/op
BenchmarkBufferPool/size_4MB/WithoutPool-4      	    4440	    510833 ns/op	 4194304 B/op	       1 allocs/op
BenchmarkBufferPool/size_16MB/WithPool-4        	42406226	        53.42 ns/op	      31 B/op	       1 allocs/op
BenchmarkBufferPool/size_16MB/WithoutPool-4     	    2752	    917040 ns/op	16777216 B/op	       1 allocs/op
PASS
ok  	github.com/beam-cloud/blobcache-v2/pkg	16.409s
{"level":"info","time":"2025-11-05T00:20:22Z","message":"Disk cache directory located at: '/tmp/BenchmarkGetContentDiskCache2957712169/001'"}
{"level":"info","time":"2025-11-05T00:20:22Z","message":"Memory cache DISABLED (disk-only mode)"}
{"level":"info","time":"2025-11-05T00:20:22Z","message":"Evicted object: test"}
goos: linux
goarch: amd64
pkg: github.com/beam-cloud/blobcache-v2/pkg
cpu: AMD EPYC 7763 64-Core Processor                
BenchmarkGetContentDiskCache-4   	{"level":"info","time":"2025-11-05T00:20:22Z","message":"Disk cache directory located at: '/tmp/BenchmarkGetContentDiskCache1976309276/002'"}
{"level":"info","time":"2025-11-05T00:20:22Z","message":"Memory cache DISABLED (disk-only mode)"}
{"level":"info","time":"2025-11-05T00:20:22Z","message":"Evicted object: test"}
{"level":"info","time":"2025-11-05T00:20:22Z","message":"Disk cache directory located at: '/tmp/BenchmarkGetContentDiskCache864427630/003'"}
{"level":"info","time":"2025-11-05T00:20:22Z","message":"Memory cache DISABLED (disk-only mode)"}
{"level":"info","time":"2025-11-05T00:20:23Z","message":"Evicted object: test"}
     139	   4265538 ns/op	3933.20 MB/s	17543482 B/op	     918 allocs/op
PASS
ok  	github.com/beam-cloud/blobcache-v2/pkg	1.230s

@github-actions
Copy link

github-actions bot commented Nov 5, 2025

Benchmark Results

goos: linux
goarch: amd64
pkg: github.com/beam-cloud/blobcache-v2/pkg
cpu: AMD EPYC 7763 64-Core Processor                
BenchmarkBufferPool/size_1MB/WithPool-4         	43483362	        57.58 ns/op	      26 B/op	       1 allocs/op
BenchmarkBufferPool/size_1MB/WithoutPool-4      	   14658	    173332 ns/op	 1048576 B/op	       1 allocs/op
BenchmarkBufferPool/size_4MB/WithPool-4         	44208186	        54.98 ns/op	      29 B/op	       1 allocs/op
BenchmarkBufferPool/size_4MB/WithoutPool-4      	    4203	    523716 ns/op	 4194304 B/op	       1 allocs/op
BenchmarkBufferPool/size_16MB/WithPool-4        	42774196	        53.41 ns/op	      31 B/op	       1 allocs/op
BenchmarkBufferPool/size_16MB/WithoutPool-4     	    2642	    864000 ns/op	16777216 B/op	       1 allocs/op
PASS
ok  	github.com/beam-cloud/blobcache-v2/pkg	16.263s
{"level":"info","time":"2025-11-05T00:20:57Z","message":"Disk cache directory located at: '/tmp/BenchmarkGetContentDiskCache2792127160/001'"}
{"level":"info","time":"2025-11-05T00:20:57Z","message":"Memory cache DISABLED (disk-only mode)"}
{"level":"info","time":"2025-11-05T00:20:57Z","message":"Evicted object: test"}
goos: linux
goarch: amd64
pkg: github.com/beam-cloud/blobcache-v2/pkg
cpu: AMD EPYC 7763 64-Core Processor                
BenchmarkGetContentDiskCache-4   	{"level":"info","time":"2025-11-05T00:20:57Z","message":"Disk cache directory located at: '/tmp/BenchmarkGetContentDiskCache3561164912/002'"}
{"level":"info","time":"2025-11-05T00:20:57Z","message":"Memory cache DISABLED (disk-only mode)"}
{"level":"info","time":"2025-11-05T00:20:57Z","message":"Evicted object: test"}
{"level":"info","time":"2025-11-05T00:20:57Z","message":"Disk cache directory located at: '/tmp/BenchmarkGetContentDiskCache3519816551/003'"}
{"level":"info","time":"2025-11-05T00:20:57Z","message":"Memory cache DISABLED (disk-only mode)"}
{"level":"info","time":"2025-11-05T00:20:58Z","message":"Evicted object: test"}
     148	   4027696 ns/op	4165.46 MB/s	17389003 B/op	     949 allocs/op
PASS
ok  	github.com/beam-cloud/blobcache-v2/pkg	1.210s

@luke-lombardi luke-lombardi merged commit 659c0fd into master Nov 5, 2025
4 checks passed
@luke-lombardi luke-lombardi deleted the ll/optimize-read-throughput branch November 10, 2025 19:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@luke-lombardi @cursoragent @luke-beamcloud