Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reduce number of calls to update shard #725

Merged
merged 3 commits into from
May 15, 2018
Merged

reduce number of calls to update shard #725

merged 3 commits into from
May 15, 2018

Conversation

wxing1292
Copy link
Contributor

@wxing1292 wxing1292 commented May 9, 2018

solve #634

@coveralls
Copy link

coveralls commented May 9, 2018

Coverage Status

Coverage increased (+0.004%) to 65.69% when pulling 897d9f2 on shard-update into b764298 on master.

@@ -107,30 +110,31 @@ func NewConfig(dc *dynamicconfig.Collection, numberOfShards int) *Config {
TimerTaskMaxRetryCount: 5,
TimerProcessorGetFailureRetryCount: 5,
TimerProcessorCompleteTimerFailureRetryCount: 10,
TimerProcessorUpdateAckInterval: 10 * time.Second,
TimerProcessorForceUpdateInterval: 10 * time.Minute,
TimerProcessorUpdateShardTaskCount: 100,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's file a task to make these dynamic config knobs.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see #592

TransferProcessorUpdateShardTaskCount: 100,
TransferProcessorMaxPollInterval: 60 * time.Second,
TransferProcessorUpdateAckInterval: 1 * time.Minute,
TransferProcessorCompleteTransferInterval: 1 * time.Second,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 second for complete sounds pretty low, considering we have 16K shards. I think it should also be notification based when there is something to cleanup.
Let's file a task to review all service configs.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@wxing1292 wxing1292 merged commit 2f9dbdb into master May 15, 2018
@wxing1292 wxing1292 deleted the shard-update branch May 15, 2018 19:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants