Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] *: Fully concurrent large reads #10472

Closed
wants to merge 8 commits into from

Conversation

jpbetz
Copy link
Contributor

@jpbetz jpbetz commented Feb 14, 2019

This is a WIP continuation of #9384.

@jpbetz jpbetz added the WIP label Feb 14, 2019
@codecov-io
Copy link

codecov-io commented Feb 14, 2019

Codecov Report

Merging #10472 into master will decrease coverage by 8.16%.
The diff coverage is 92.68%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #10472      +/-   ##
==========================================
- Coverage   71.67%   63.51%   -8.17%     
==========================================
  Files         392      392              
  Lines       36495    36546      +51     
==========================================
- Hits        26158    23212    -2946     
- Misses       8517    11387    +2870     
- Partials     1820     1947     +127
Impacted Files Coverage Δ
etcdserver/v3_server.go 60.45% <ø> (-18.86%) ⬇️
etcdserver/config.go 79.51% <ø> (ø) ⬆️
mvcc/kv.go 40% <ø> (ø) ⬆️
embed/config.go 54.72% <ø> (-1.72%) ⬇️
mvcc/metrics_txn.go 100% <100%> (ø) ⬆️
mvcc/backend/read_tx.go 79.36% <100%> (-4.31%) ⬇️
etcdmain/config.go 82.48% <100%> (+0.08%) ⬆️
mvcc/backend/metrics.go 100% <100%> (ø) ⬆️
embed/etcd.go 67.78% <100%> (-3.11%) ⬇️
mvcc/index.go 67.85% <100%> (-23.51%) ⬇️
... and 122 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 24fc2a9...c616f7c. Read the comment docs.

rtx, err := r.b.db.Begin(false)
if err != nil {
plog.Fatalf("cannot begin read tx (%s)", err)
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to also add zap here capnslog will be dropped in 3.4

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch, I'll add it.

func (rt *concurrentReadTx) UnsafeRange(bucketName, key, endKey []byte, limit int64) ([][]byte, [][]byte) {
bucket := rt.tx.Bucket(bucketName)
if bucket == nil {
plog.Fatalf("bucket %s does not exist", bucketName)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same

@jpbetz
Copy link
Contributor Author

jpbetz commented Apr 3, 2019

See #10523 for current efforts

@jpbetz jpbetz closed this Apr 3, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

6 participants