Exception to start clustering K8s in v0.27.0 #1416
Labels
Comments
|
I'm seeing the same issue in our cluster. Will try to pinpoint this |
|
The error returned from Kubernetes: {
"kind": "Status",
"apiVersion": "v1",
"metadata": {},
"status": "Failure",
"message": "json: cannot unmarshal object into Go value of type jsonpatch.Patch",
"reason": "BadRequest",
"code": 400
}The payload sent. {
"operations": [
{
"value": {
"label xyz":"value xyz"
},
"operationType": "Replace", <---- This entry is not part of the Patch spec
"path": "/Metadata/Labels",
"op": "replace"
}
],
"contractResolver": {}
} |
|
Verified now. |
|
Pushed a new Proto.Actor release (preview) with the downgraded KubernetesClient |
|
Marking this up for grabs for anyone to replace the asp.net jsonpatch object we use today. |
|
Done. will release a new proper release with the fix |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Expected Behavior
Actual Behavior
Steps to Reproduce the Problem
Specifications
StackTrace
Logs
{ "@t": "2022-02-03T06:22:41.2010171Z", "@mt": "Starting Proto.Actor server on {Host}:{Port} ({Address})", "Host": "0.0.0.0", "Port": 0, "Address": "172.16.104.93:32815", "SourceContext": "Proto.Remote.GrpcNet.GrpcNetRemote" } { "@t": "2022-02-03T06:22:41.2145567Z", "@mt": "Starting", "SourceContext": "Proto.Cluster.Cluster" } { "@t": "2022-02-03T06:22:41.2479010Z", "@mt": "Started Cluster Gossip", "SourceContext": "Proto.Cluster.Gossip.Gossiper" } { "@t": "2022-02-03T06:22:41.2792984Z", "@mt": "[Cluster][KubernetesProvider] Registering service {PodName} on {PodIp}", "PodName": "aums-sendmail-6bc544c759-xj6ph", "PodIp": "172.16.104.93:32815", "SourceContext": "Proto.Cluster.Kubernetes.KubernetesProvider" } { "@t": "2022-02-03T06:22:41.8206948Z", "@mt": "Starting gossip loop", "SourceContext": "Proto.Cluster.Gossip.Gossiper" } { "@t": "2022-02-03T06:22:42.0595202Z", "@mt": "[Cluster][KubernetesProvider] Using Kubernetes namespace: aums", "SourceContext": "Proto.Cluster.Kubernetes.KubernetesProvider" } { "@t": "2022-02-03T06:22:42.0598211Z", "@mt": "[Cluster][KubernetesProvider] Using Kubernetes port: 32815", "SourceContext": "Proto.Cluster.Kubernetes.KubernetesProvider" } { "@t": "2022-02-03T06:22:42.2594518Z", "@mt": "[Cluster][KubernetesProvider] Unable to update pod labels, registration failed. Labels : {Labels}", "@l": "Error", "@x": "Microsoft.Rest.HttpOperationException: Operation returned an invalid status code 'BadRequest'\n at k8s.Kubernetes.SendRequestRaw(String requestContent, HttpRequestMessage httpRequest, CancellationToken cancellationToken)\n at k8s.Kubernetes.PatchNamespacedPodWithHttpMessagesAsync(V1Patch body, String name, String namespaceParameter, String dryRun, String fieldManager, String fieldValidation, Nullable`1 force, Nullable`1 pretty, IDictionary`2 customHeaders, CancellationToken cancellationToken)\n at k8s.KubernetesExtensions.PatchNamespacedPodAsync(IKubernetes operations, V1Patch body, String name, String namespaceParameter, String dryRun, String fieldManager, String fieldValidation, Nullable`1 force, Nullable`1 pretty, CancellationToken cancellationToken)\n at Proto.Cluster.Kubernetes.KubernetesProvider.RegisterMemberInner()", "Labels": { "cluster.proto.actor/cluster": "Aums", "cluster.proto.actor/port": "32815", "cluster.proto.actor/member-id": "44b8842e175d4a4497e3d8762eb5d621", "app.kubernetes.io/instance": "aums", "app.kubernetes.io/name": "aums-sendmail", "pod-template-hash": "6bc544c759" }, "SourceContext": "Proto.Cluster.Kubernetes.KubernetesProvider", "ExceptionDetail": { "HResult": -2146233088, "Message": "Operation returned an invalid status code 'BadRequest'", "Source": "KubernetesClient", "TargetSite": "Void MoveNext()", "Request": { "Method": {"Method": "PATCH"}, "RequestUri": "https://172.20.0.1/api/v1/namespaces/aums/pods/aums-sendmail-6bc544c759-xj6ph", "Properties": {}, "Content": { "operations": [ { "value": { "cluster.proto.actor/cluster": "Aums", "cluster.proto.actor/port": "32815", "cluster.proto.actor/member-id": "44b8842e175d4a4497e3d8762eb5d621", "app.kubernetes.io/instance": "aums", "app.kubernetes.io/name": "aums-sendmail", "pod-template-hash": "6bc544c759" }, "operationType": "Replace", "path": "/Metadata/Labels", "op": "replace" } ], "contractResolver": {} }, "Headers": { "Authorization" : [ "Bearer ***" ], "Content-Type" : [ "application/json-patch+json; charset=utf-8" ], "Content-Length": [ "366" ] } }, "Response": { "StatusCode": "BadRequest", "ReasonPhrase": "Bad Request", "Content": { "kind": "Status", "apiVersion": "v1", "metadata": {}, "status": "Failure", "message": "json: cannot unmarshal object into Go value of type jsonpatch.Patch", "reason": "BadRequest", "code": 400 }, "Headers": { "audit-id" : [ "f7cb6145-ed63-48cf-8b75-fbe12b43e9a2" ], "Cache-Control" : [ "no-cache, private" ], "Date" : [ "Thu, 03 Feb 2022 06:22:42 GMT" ], "Content-Type" : [ "application/json" ], "Content-Length": [ "182" ] } }, "Body": null, "Type": "Microsoft.Rest.HttpOperationException" } } { "@t": "2022-02-03T06:22:42.5815750Z", "@mt": "Failed to register service", "@l": "Warning", "@x": "Microsoft.Rest.HttpOperationException: Operation returned an invalid status code 'BadRequest'\n at k8s.Kubernetes.SendRequestRaw(String requestContent, HttpRequestMessage httpRequest, CancellationToken cancellationToken)\n at k8s.Kubernetes.PatchNamespacedPodWithHttpMessagesAsync(V1Patch body, String name, String namespaceParameter, String dryRun, String fieldManager, String fieldValidation, Nullable`1 force, Nullable`1 pretty, IDictionary`2 customHeaders, CancellationToken cancellationToken)\n at k8s.KubernetesExtensions.PatchNamespacedPodAsync(IKubernetes operations, V1Patch body, String name, String namespaceParameter, String dryRun, String fieldManager, String fieldValidation, Nullable`1 force, Nullable`1 pretty, CancellationToken cancellationToken)\n at Proto.Cluster.Kubernetes.KubernetesProvider.RegisterMemberInner()\n at Proto.Utils.Retry.Try(Func`1 body, Int32 retryCount, Int32 backoffMilliSeconds, Int32 maxBackoffMilliseconds, Action`2 onError, Action`1 onFailed, Boolean ignoreFailure)", "SourceContext": "Proto.Cluster.Kubernetes.KubernetesProvider", "ExceptionDetail": { "HResult": -2146233088, "Message": "Operation returned an invalid status code 'BadRequest'", "Source": "KubernetesClient", "TargetSite": "Void MoveNext()", "Request": { "Method": {"Method": "PATCH"}, "RequestUri": "https://172.20.0.1/api/v1/namespaces/aums/pods/aums-sendmail-6bc544c759-xj6ph", "Properties": {}, "Content": { "operations": [ { "value": { "cluster.proto.actor/cluster": "Aums", "cluster.proto.actor/port": "32815", "cluster.proto.actor/member-id": "44b8842e175d4a4497e3d8762eb5d621", "app.kubernetes.io/instance": "aums", "app.kubernetes.io/name": "aums-sendmail", "pod-template-hash": "6bc544c759" }, "operationType": "Replace", "path": "/Metadata/Labels", "op": "replace" } ], "contractResolver": {} }, "Headers": { "Authorization" : [ "Bearer ***" ], "Content-Type" : [ "application/json-patch+json; charset=utf-8" ], "Content-Length": [ "366" ] } }, "Response": { "StatusCode": "BadRequest", "ReasonPhrase": "Bad Request", "Content": { "kind": "Status", "apiVersion": "v1", "metadata": {}, "status": "Failure", "message": "json: cannot unmarshal object into Go value of type jsonpatch.Patch", "reason": "BadRequest", "code": 400 }, "Headers": { "audit-id" : [ "f7cb6145-ed63-48cf-8b75-fbe12b43e9a2" ], "Cache-Control" : [ "no-cache, private" ], "Date" : [ "Thu, 03 Feb 2022 06:22:42 GMT" ], "Content-Type" : [ "application/json" ], "Content-Length": [ "182" ] } }, "Body": null, "Type": "Microsoft.Rest.HttpOperationException" } } { "@t": "2022-02-03T06:22:42.6090079Z", "@mt": "[Cluster][KubernetesProvider] Registering service {PodName} on {PodIp}", "PodName": "aums-sendmail-6bc544c759-xj6ph", "PodIp": "172.16.104.93:32815", "SourceContext": "Proto.Cluster.Kubernetes.KubernetesProvider" } .....(loop).....The text was updated successfully, but these errors were encountered: