Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move WAL out of BoltDB #3514

Closed
pauldix opened this issue Jul 30, 2015 · 8 comments
Closed

Move WAL out of BoltDB #3514

pauldix opened this issue Jul 30, 2015 · 8 comments
Assignees
@pauldix
Milestone
0.9.3

Comments

@pauldix
Copy link
Member

pauldix commented Jul 30, 2015

Having the WAL in BoltDB is causing the entire database to lock during WAL flushes, which is causing write timeouts. Move the WAL outside of Bolt and ensure that flushes of the WAL do not cause the database to lock for writes.

WAL should be able to flush incrementally. It should gradually put on back pressure if the index is unable to keep up with the pace of WAL flushing. Ideally this should occur over time rather than as a large timeout.
@pauldix pauldix self-assigned this Jul 30, 2015
@pauldix pauldix added this to the 0.9.3 milestone Jul 30, 2015
@pauldix pauldix mentioned this issue Jul 30, 2015
Closed
@jmcook
Copy link

jmcook commented Jul 30, 2015

This would be wonderful.

@maxboiko
Copy link

maxboiko commented Aug 7, 2015

Seems that the same issue is very important in my case, hope fix will be provided soon.

@syepes
Copy link

syepes commented Aug 7, 2015

Waiting for this one also ;-)

@kenzodeluxe
Copy link

While you guys are waiting for this, I am urgently waiting for it :)

@otoolep otoolep mentioned this issue Aug 10, 2015
Closed
@srikara
Copy link

srikara commented Aug 11, 2015

+1

2 similar comments
@redHL
Copy link

redHL commented Aug 17, 2015

+1

@indrekj
Copy link

indrekj commented Aug 17, 2015

+1

@jwilder jwilder mentioned this issue Aug 18, 2015
Closed
@pauldix
Copy link
Member Author

pauldix commented Aug 19, 2015

Done in #3569 and on 0.9.3-rc1, which I'm cutting right now. Testing and performance results are greatly appreciated!

@pauldix pauldix closed this as completed Aug 19, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pauldix pauldix

Labels
None yet
Projects
None yet
Milestone
0.9.3
Development

No branches or pull requests
8 participants
@indrekj @pauldix @syepes @srikara @jmcook @maxboiko @kenzodeluxe @redHL