Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CosmosClientSideRequestStatistics merged into DiagnosticContext #1189

Merged
merged 37 commits into from
Mar 10, 2020

Conversation

j82w
Copy link
Contributor

@j82w j82w commented Jan 31, 2020

Pull Request Template

Description

AddressResolutionStatistics and StoreResponseStatistics are now merged into the diagnostic context list. This allows the results to be shown in order with the other context information rather than a single aggregated result. This allows to see which retry has which AddressResolutionStatistics and StoreResponseStatistics.

CosmosClientSideRequestStatistics is added to the context a single time to avoid duplicating the same data for multiple retries.

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Example:

// Success scenario

{
    "Summary": {
        "StartUtc": "2020-02-21T15:49:11.4406660Z",
        "ElapsedTime": "00:00:00.1437418",
        "UserAgent": "cosmos-netstandard-sdk/3.7.0|3.7.0|02852|X64|Microsoft Windows 10.0.18363 |.NET Core 4.6.28008.01|",
        "TotalRequestCount": 0,
        "FailedRequestCount": 0
    },
    "Context": [
        {
            "Id": "ItemStream",
            "ElapsedTime": "00:00:00.1437418"
        },
        {
            "Id": "ItemSerialize",
            "ElapsedTime": "00:00:00.0000771"
        },
        {
            "Id": "ExtractPkValue",
            "ElapsedTime": "00:00:00.0331291"
        },
        {
            "Id": "ProcessItemStream",
            "ElapsedTime": "00:00:00.1105283"
        },
        {
            "Id": "RequestInvokerHandler",
            "ElapsedTime": "00:00:00.1105209"
        },
        {
            "Id": "AggregatedClientSideRequestStatistics",
            "ContactedReplicas": [
                {
                    "Count": 12,
                    "Uri": "rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer9/partitions/a4cb4955-38c8-11e6-8106-8cdcd42c33be/replicas/1p/"
                }
            ],
            "RegionsContacted": [
                "https://127.0.0.1:8081/"
            ],
            "FailedReplicas": []
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RetryHandler",
            "ElapsedTime": "00:00:00.1104252"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.1104069"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.1104029"
        },
        {
            "Id": "AddressResolutionStatistics",
            "StartTimeUtc": "2020-02-21T15:49:11.5386270Z",
            "EndTimeUtc": "2020-02-21T15:49:11.5592235Z",
            "TargetEndpoint": "https://127.0.0.1:8081//addresses/?$resolveFor=dbs%2fzY8aAA%3d%3d%2fcolls%2fzY8aAIs6Sh0%3d%2fdocs&$filter=protocol eq rntbd&$partitionKeyRangeIds=0"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T15:49:11.5816214Z",
            "ResourceType": 2,
            "OperationType": 0,
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer9/partitions/a4cb4955-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 1350, GlobalCommittedLsn: -1, PartitionKeyRangeId: 0, IsValid: True, StatusCode: 201, SubStatusCode: 0, RequestCharge: 11.05, ItemLSN: -1, SessionToken: -1#1350, UsingLocalLSN: False, TransportException: null"
        }
    ]
}

Request To large:

{
    "Summary": {
        "StartUtc": "2020-02-21T15:57:48.1673313Z",
        "ElapsedTime": "00:00:00.7950596",
        "UserAgent": "cosmos-netstandard-sdk/3.7.0|3.7.0|08204|X64|Microsoft Windows 10.0.18363 |.NET Core 4.6.28008.01|",
        "TotalRequestCount": 1,
        "FailedRequestCount": 1
    },
    "Context": [
        {
            "Id": "ProcessItemStream",
            "ElapsedTime": "00:00:00.7950596"
        },
        {
            "Id": "RequestInvokerHandler",
            "ElapsedTime": "00:00:00.7950496"
        },
        {
            "Id": "AggregatedClientSideRequestStatistics",
            "ContactedReplicas": [
                {
                    "Count": 12,
                    "Uri": "rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer4/partitions/a4cb4950-38c8-11e6-8106-8cdcd42c33be/replicas/1p/"
                }
            ],
            "RegionsContacted": [],
            "FailedReplicas": []
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RetryHandler",
            "ElapsedTime": "00:00:00.7949887"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.7909275"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.7909111"
        },
        {
            "Id": "PointOperationStatistics",
            "ActivityId": "bc86cef0-722a-4245-ae34-94989a90031e",
            "ResponseTimeUtc": "2020-02-21T15:57:48.9581465Z",
            "StatusCode": 413,
            "SubStatusCode": 0,
            "RequestCharge": 0.0,
            "RequestUri": "dbs/555d597a-6895-4bb3-9607-56ec4e3c3cc0/colls/a1242f0f-4b1b-4751-9615-ac3b3c050f35",
            "ErrorMessage": "Message: {\"Errors\":[\"Request size is too large\"]}\r\nActivityId: bc86cef0-722a-4245-ae34-94989a90031e",
            "RequestSessionToken": null,
            "ResponseSessionToken": null
        }
    ]
}

Failed with 429s:

{
    "Summary": {
        "StartUtc": "2020-02-21T16:15:22.5800160Z",
        "ElapsedTime": "00:00:05.3662161",
        "UserAgent": "cosmos-netstandard-sdk/3.7.0|3.7.0|99290|X64|Microsoft Windows 10.0.18363 |.NET Core 4.6.28008.01|",
        "TotalRequestCount": 10,
        "FailedRequestCount": 10
    },
    "Context": [
        {
            "Id": "RequestInvokerHandler",
            "ElapsedTime": "00:00:05.3662161"
        },
        {
            "Id": "AggregatedClientSideRequestStatistics",
            "ContactedReplicas": [
                {
                    "Count": 10,
                    "Uri": "rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/"
                }
            ],
            "RegionsContacted": [
                "https://127.0.0.1:8081/"
            ],
            "FailedReplicas": []
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RetryHandler",
            "ElapsedTime": "00:00:05.3661548"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0175562"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0136554"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0056213"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0049396"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0049286"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:22.5843229Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0066013"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0061567"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0058375"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0044057"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0043484"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:22.8032320Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0238693"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0203965"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0179438"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0166196"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0166154"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:23.3309716Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0415970"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0415612"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0415444"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0413541"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0413493"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:23.9024024Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0562729"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0562533"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0562374"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0559870"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0559813"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:24.4634983Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0929813"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0929240"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0929059"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0926857"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0923922"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:25.1784405Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0899527"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0898841"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0898696"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0893097"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0893053"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:25.8928412Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.2555311"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.2554676"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.2554134"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.2553524"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.2553460"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:26.3125424Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.1624049"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.1622933"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.1620922"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.1619038"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.1613700"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:27.1158560Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.RouterHandler",
            "ElapsedTime": "00:00:00.0984888"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeGoneRetryHandler",
            "ElapsedTime": "00:00:00.0984235"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.PartitionKeyRangeHandler",
            "ElapsedTime": "00:00:00.0251216"
        },
        {
            "Id": "Microsoft.Azure.Cosmos.Handlers.TransportHandler",
            "ElapsedTime": "00:00:00.0248447"
        },
        {
            "Id": "TransportHandler",
            "ElapsedTime": "00:00:00.0248356"
        },
        {
            "Id": "StoreResponseStatistics",
            "ResponseTimeUtc": "2020-02-21T16:15:27.8642904Z",
            "ResourceType": "Document",
            "OperationType": "ReadFeed",
            "LocationEndpoint": "https://127.0.0.1:8081/",
            "StoreResult": "StorePhysicalAddress: rntbd://127.0.0.1:10253/apps/DocDbApp/services/DocDbServer18/partitions/a4cb495e-38c8-11e6-8106-8cdcd42c33be/replicas/1p/, LSN: 593, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: True, StatusCode: 429, SubStatusCode: 3200, RequestCharge: 0.38, ItemLSN: -1, SessionToken: -1#593, UsingLocalLSN: True, TransportException: null"
        }
    ]
}

@j82w j82w self-assigned this Jan 31, 2020
@j82w j82w added the Diagnostics Issues around diagnostics and troubleshooting label Jan 31, 2020
@@ -93,6 +93,21 @@ internal override void AddDiagnosticsInternal(PointOperationStatistics pointOper
this.ContextList.Add(pointOperationStatistics);
}

internal override void AddDiagnosticsInternal(StoreResponseStatistics storeResponseStatistics)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You could probably write a visitor for this, so you will know to update this when a new type gets added.

Copy link
Contributor Author

@j82w j82w Feb 3, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The problem is abstract classes. It can't be both a CosmosDiagnosticsInternal and a CosmosDiagnosticsInternalVisitor. Also it does not need to support all vistors.

bchong95
bchong95 previously approved these changes Feb 1, 2020
@kirankumarkolli
Copy link
Member

    private IClientSideRequestStatistics sharedStatistics;

What's the value of this now?


Refers to: Microsoft.Azure.Cosmos/src/ClientRetryPolicy.cs:36 in 4c694dc. [](commit_id = 4c694dc, deletion_comment = False)

Copy link
Member

@kirankumarkolli kirankumarkolli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

kirankumarkolli
kirankumarkolli previously approved these changes Mar 5, 2020
…iagnosticContext to get the full information.
@j82w j82w merged commit 16f054a into master Mar 10, 2020
@j82w j82w deleted the users/jawilley/diagnostics/fix_client_stats branch March 10, 2020 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Diagnostics Issues around diagnostics and troubleshooting
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants