Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Concurrency issue in the metrics #4222

Merged
merged 1 commit into from
Sep 13, 2021

Conversation

khrm
Copy link
Contributor

@khrm khrm commented Sep 8, 2021

A double locking was happening in recorder mutex which was creating
unexpected behavior. Lock needs to be done only in the function that
calls opencensus stats recorder. ReportRunningPipelineRuns and
ReportRunningTaskRuns calls RunningPipelineRuns and RunningTaskRuns
respectively which in turns lock the recorder.

Changes

Submitter Checklist

As the author of this PR, please check off the items in this checklist:

  • Docs included if any changes are user facing
  • Tests included if any functionality added or changed
  • Follows the commit message standard
  • Meets the Tekton contributor standards (including
    functionality, content, code)
  • Release notes block below has been filled in or deleted (only if no user facing changes)

Release Notes

NONE

A double locking was happening in recorder mutex which was creating
unexpected behaviour. Lock needs to be done only in the function that
calls opencensus stats recorder.
@tekton-robot tekton-robot added the release-note Denotes a PR that will be considered when it comes time to generate release notes. label Sep 8, 2021
@tekton-robot tekton-robot added size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. release-note-none Denotes a PR that doesnt merit a release note. kind/bug Categorizes issue or PR as related to a bug. and removed release-note Denotes a PR that will be considered when it comes time to generate release notes. labels Sep 8, 2021
@tekton-robot
Copy link
Collaborator

The following is the coverage report on the affected files.
Say /test pull-tekton-pipeline-go-coverage to re-run this coverage report

File Old Coverage New Coverage Delta
pkg/pipelinerunmetrics/metrics.go 79.8% 81.6% 1.8
pkg/taskrunmetrics/metrics.go 82.5% 83.6% 1.1

Copy link
Member

@vdemeester vdemeester left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@khrm is it in relation to #4223 ?

@tekton-robot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: vdemeester

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@tekton-robot tekton-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 9, 2021
@khrm
Copy link
Contributor Author

khrm commented Sep 9, 2021

Yes, @vdemeester We probably need a e2e test or integration test to catch these type of bugs.

@vdemeester
Copy link
Member

Yes, @vdemeester We probably need a e2e test or integration test to catch these type of bugs.

e2e tests or unit tests yes 👼🏼

@dlorenc
Copy link
Contributor

dlorenc commented Sep 13, 2021

/lgtm

@tekton-robot tekton-robot added the lgtm Indicates that a PR is ready to be merged. label Sep 13, 2021
@tekton-robot tekton-robot merged commit 6a57888 into tektoncd:main Sep 13, 2021
@khrm khrm deleted the metricsConcurrencyBug branch February 28, 2023 04:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. kind/bug Categorizes issue or PR as related to a bug. lgtm Indicates that a PR is ready to be merged. release-note-none Denotes a PR that doesnt merit a release note. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants