Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update workflow execution metrics #4159

Merged
merged 1 commit into from
Apr 28, 2021

Conversation

Shaddoll
Copy link
Member

@Shaddoll Shaddoll commented Apr 24, 2021

What changed?

  • Update workflow execution metrics to include transfer/timer/replication tasks count
  • Emit workflow execution metrics on workflow creation and conflict resolution

Why?
Creating transfer/timer/replication tasks can issue large amount of write to databases.
We need to understand the load and set minimum requirements for databases.

How did you test it?

Potential risks

Release notes

Documentation Changes

@Shaddoll Shaddoll changed the title Update workflow execution metrics [Not Ready, DO NOT REVIEW]Update workflow execution metrics Apr 24, 2021
@Shaddoll Shaddoll force-pushed the transaction-metrics branch 6 times, most recently from abf1fb0 to c108752 Compare April 26, 2021 20:26
@Shaddoll Shaddoll changed the title [Not Ready, DO NOT REVIEW]Update workflow execution metrics Update workflow execution metrics Apr 26, 2021
@Shaddoll Shaddoll requested review from yycptt, andrewjdawson2016 and a team April 26, 2021 20:30
@coveralls
Copy link

coveralls commented Apr 26, 2021

Pull Request Test Coverage Report for Build 88ff4a8a-60b0-4719-9305-30f9c42f2b4e

  • 177 of 212 (83.49%) changed or added relevant lines in 10 files are covered.
  • 34 unchanged lines in 8 files lost coverage.
  • Overall coverage increased (+0.07%) to 59.771%

Changes Missing Coverage Covered Lines Changed/Added Lines %
common/persistence/persistenceRateLimitedClients.go 3 4 75.0%
common/persistence/persistence-tests/persistenceTestBase.go 0 2 0.0%
common/persistence/statsComputer.go 119 121 98.35%
common/persistence/persistenceErrorInjectionClients.go 0 5 0.0%
service/history/shard/context.go 3 9 33.33%
common/persistence/executionStore.go 14 21 66.67%
common/persistence/persistence-tests/executionManagerTest.go 0 12 0.0%
Files with Coverage Reduction New Missed Lines %
common/persistence/persistence-tests/persistenceTestBase.go 1 8.36%
common/types/shared.go 1 28.7%
host/archivalTest.go 1 98.18%
common/task/weightedRoundRobinTaskScheduler.go 2 89.64%
service/history/task/transfer_active_task_executor.go 2 69.05%
common/cache/lru.go 3 90.73%
common/types/mapper/thrift/shared.go 4 71.16%
common/persistence/cassandra/cassandraPersistence.go 20 51.44%
Totals Coverage Status
Change from base Build 9383f37c-587f-4fbd-a497-11aa1266c02d: 0.07%
Covered Lines: 87916
Relevant Lines: 147089

💛 - Coveralls

@meiliang86 meiliang86 removed the request for review from a team April 27, 2021 16:55
@Shaddoll Shaddoll requested a review from a team April 27, 2021 16:59
Copy link
Contributor

@yycptt yycptt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Just some nit comments around style and testing.

@@ -4122,10 +4122,10 @@ func (s *ExecutionManagerSuite) TestConflictResolveWorkflowExecutionWithTransact
},
Encoding: pickRandomEncoding(),
}
err = s.ExecutionManager.ConflictResolveWorkflowExecution(ctx, resetReq)
_, err = s.ExecutionManager.ConflictResolveWorkflowExecution(ctx, resetReq)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shall we have some checks on the returned stats to make sure it's working?

@Shaddoll Shaddoll force-pushed the transaction-metrics branch from c108752 to 00547e8 Compare April 28, 2021 21:26
@Shaddoll Shaddoll force-pushed the transaction-metrics branch from 00547e8 to bc59852 Compare April 28, 2021 23:13
@Shaddoll Shaddoll merged commit 465bda0 into cadence-workflow:master Apr 28, 2021
Shaddoll added a commit that referenced this pull request Apr 28, 2021
yux0 pushed a commit to yux0/cadence that referenced this pull request May 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants