-
Notifications
You must be signed in to change notification settings - Fork 805
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
reduce number of calls to update shard #725
Conversation
@@ -107,30 +110,31 @@ func NewConfig(dc *dynamicconfig.Collection, numberOfShards int) *Config { | |||
TimerTaskMaxRetryCount: 5, | |||
TimerProcessorGetFailureRetryCount: 5, | |||
TimerProcessorCompleteTimerFailureRetryCount: 10, | |||
TimerProcessorUpdateAckInterval: 10 * time.Second, | |||
TimerProcessorForceUpdateInterval: 10 * time.Minute, | |||
TimerProcessorUpdateShardTaskCount: 100, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's file a task to make these dynamic config knobs.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
see #592
TransferProcessorUpdateShardTaskCount: 100, | ||
TransferProcessorMaxPollInterval: 60 * time.Second, | ||
TransferProcessorUpdateAckInterval: 1 * time.Minute, | ||
TransferProcessorCompleteTransferInterval: 1 * time.Second, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
1 second for complete sounds pretty low, considering we have 16K shards. I think it should also be notification based when there is something to cleanup.
Let's file a task to review all service configs.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
solve #634