Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix/log storage minor fix #191

Merged
merged 6 commits into from
Jun 27, 2019

Conversation

fengjiachun
Copy link
Contributor

Motivation:

minor fix

Modification:

Result:

@killme2008
Copy link
Contributor

这个单测问题我跟下,感觉还是有隐藏的问题。

@fengjiachun
Copy link
Contributor Author

fengjiachun commented Jun 21, 2019

2019-06-20 14:20:11 [JRaft-FSMCaller-disruptor-0] ERROR StateMachineAdapter:72 - Encountered an error=Status[EBUSY<1009>: LogManager is busy, disk queue overload.] on StateMachine com.alipay.sofa.jraft.core.MockStateMachine, it's highly recommended to implement this method as raft stops working since some error ocurrs, you should figure out the cause and repair or remove this node.
com.alipay.sofa.jraft.error.RaftException: ERROR_TYPE_LOG
	at com.alipay.sofa.jraft.storage.impl.LogManagerImpl.reportError(LogManagerImpl.java:569) ~[classes/:?]
	at com.alipay.sofa.jraft.storage.impl.LogManagerImpl.appendEntries(LogManagerImpl.java:343) ~[classes/:?]
	at com.alipay.sofa.jraft.core.NodeImpl.executeApplyingTasks(NodeImpl.java:1096) ~[classes/:?]
	at com.alipay.sofa.jraft.core.NodeImpl.access$200(NodeImpl.java:124) ~[classes/:?]
	at com.alipay.sofa.jraft.core.NodeImpl$LogEntryAndClosureHandler.onEvent(NodeImpl.java:239) ~[classes/:?]
	at com.alipay.sofa.jraft.core.NodeImpl$LogEntryAndClosureHandler.onEvent(NodeImpl.java:220) ~[classes/:?]
	at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:137) [disruptor-3.3.7.jar:?]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]

Log 的 disruptorBufferSize 太小了(1024)?或者 tryOfferEvent 失败重试是不是应该指数避让而非 spin 后直接重试? 看起来 spin 一般还是失败

@killme2008
Copy link
Contributor

@fengjiachun 不是这个问题,这个错误是单元测试里故意设计的一个场景。目前看应该是 snapshot 安装失败引起的,另一个测试用例。

@killme2008 killme2008 merged commit 9f4d8af into feature/log-storage-v2 Jun 27, 2019
@killme2008 killme2008 deleted the fix/log-storage-minor-fix branch June 27, 2019 03:44
fengjiachun pushed a commit that referenced this pull request Sep 12, 2019
* (feat) Impl a segment log storage, #39

* (feat) revert test log level

* (feat) adds more log

* (feat) Use partitioned index filters for rocksdb block based table config, bump rocksdb to 5.18.3

* (fix) comments

* (feat) format segment file name

* (feat) reserve 2 bytes for location metadata

* (fix) hang on shutdown

* (feat) refactor and add unit test for segment storage

* (fix) race condition in doCheckpoint

* (feat) touch abort file

* (feat) refactor

* (feat) minor changes in RocksDBSegmentLogStorage#onShutdown

* fix/log storage minor fix (#191)

* (fix) minor fix

* (fix) minor fix

* (fix) minor fix

* (feat) minor changes in RocksDBSegmentLogStorage#onShutdown

* (fix) remove special characters

* (fix) forgot to reset buffer position when truncating segment file

* (feat) minor changes

* (feat) remove writeLock in checkpoint thread

* (feat) Compare reference instead of array's length

* feat/follow by storagev2 (#196)

* (feat) follow logStorage's tableConfig

* (fix) fix javadoc

* (fix) format

* (fix) log storage text path

* (fix) compare ref is better

* (fix) format

* (fix) ut fix

* (fix) lambda

* fix/read after shutdown (#215)

* (fix) read after db shutdown

* (fix) check state before access db

* (fix) by review comments

* (fix) RocksDBSegmentLogStorage#onTruncateSuffix when last log not found
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants