sentry: *errors.errorString *safedetails.withSafeDetails: unexpected panic: %s (1) log.go:35: *withstack.withStack (top exception) (check the extra data payloads)

[cockroach-teamcity]

This issue was autofiled by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry link: https://sentry.io/organizations/cockroach-labs/issues/1734347601/?referrer=webhooks_plugin

Panic message:

*errors.errorString
*safedetails.withSafeDetails: unexpected panic: %s (1)
log.go:35: *withstack.withStack (top exception)
(check the extra data payloads)

Stacktrace (expand for inline code snippets):

cockroach/pkg/util/log/log.go

Lines 34 to 36 in 59b7964

	if r := recover(); r != nil {
	Fatalf(context.Background(), "unexpected panic: %s", r)
	}

in pkg/util/log.FatalOnPanic
/usr/local/go/src/runtime/panic.go#L678-L680 in runtime.gopanic
https://github.com/cockroachdb/cockroach/blob/59b79642310c31227c8c15015a2b9c83ee38707e/vendor/github.com/golang/protobuf/proto/deprecated.go#L90-L92 in vendor/github.com/golang/protobuf/proto.(*InternalMessageInfo).Size
https://github.com/cockroachdb/cockroach/blob/59b79642310c31227c8c15015a2b9c83ee38707e/vendor/github.com/grpc-ecosystem/grpc-gateway/internal/errors.pb.go#L54-L56 in vendor/github.com/grpc-ecosystem/grpc-gateway/internal.(*Error).XXX_Size
https://github.com/cockroachdb/cockroach/blob/59b79642310c31227c8c15015a2b9c83ee38707e/vendor/github.com/gogo/protobuf/proto/table_marshal.go#L2936-L2938 in vendor/github.com/gogo/protobuf/proto.Marshal

cockroach/pkg/util/protoutil/marshaler.go

Lines 39 to 41 in 59b7964

	if p, ok := v.(proto.Message); ok {
	return proto.Marshal(p)
	}

in pkg/util/protoutil.(*ProtoPb).Marshal
https://github.com/cockroachdb/cockroach/blob/59b79642310c31227c8c15015a2b9c83ee38707e/vendor/github.com/grpc-ecosystem/grpc-gateway/runtime/errors.go#L138-L140 in vendor/github.com/grpc-ecosystem/grpc-gateway/runtime.DefaultHTTPError
https://github.com/cockroachdb/cockroach/blob/59b79642310c31227c8c15015a2b9c83ee38707e/vendor/github.com/grpc-ecosystem/grpc-gateway/runtime/errors.go#L101-L103 in vendor/github.com/grpc-ecosystem/grpc-gateway/runtime.MuxOrGlobalHTTPError

cockroach/pkg/server/serverpb/status.pb.gw.go

Lines 2899 to 2901 in 59b7964

	if err != nil {
	runtime.HTTPError(ctx, mux, outboundMarshaler, w, req, err)
	return

in pkg/server/serverpb.RegisterStatusHandlerClient.func22
https://github.com/cockroachdb/cockroach/blob/59b79642310c31227c8c15015a2b9c83ee38707e/vendor/github.com/grpc-ecosystem/grpc-gateway/runtime/mux.go#L239-L241 in vendor/github.com/grpc-ecosystem/grpc-gateway/runtime.(*ServeMux).ServeHTTP
/usr/local/go/src/net/http/server.go#L2386-L2388 in net/http.(*ServeMux).ServeHTTP

cockroach/pkg/server/server.go

Lines 127 to 129 in 59b7964

	mux.mu.RLock()
	mux.mux.ServeHTTP(w, r)
	mux.mu.RUnlock()

in pkg/server.(*safeServeMux).ServeHTTP

cockroach/pkg/server/server.go

Lines 1963 to 1965 in 59b7964

	}
	s.mux.ServeHTTP(w, r)
	}

in pkg/server.(*Server).ServeHTTP
/usr/local/go/src/net/http/server.go#L2801-L2803 in net/http.serverHandler.ServeHTTP
/usr/local/go/src/net/http/server.go#L1889-L1891 in net/http.(*conn).serve
/usr/local/go/src/runtime/asm_amd64.s#L1356-L1358 in runtime.goexit

pkg/util/log/log.go in pkg/util/log.FatalOnPanic at line 35
/usr/local/go/src/runtime/panic.go in runtime.gopanic at line 679
vendor/github.com/golang/protobuf/proto/deprecated.go in vendor/github.com/golang/protobuf/proto.(*InternalMessageInfo).Size at line 91
vendor/github.com/grpc-ecosystem/grpc-gateway/internal/errors.pb.go in vendor/github.com/grpc-ecosystem/grpc-gateway/internal.(*Error).XXX_Size at line 55
vendor/github.com/gogo/protobuf/proto/table_marshal.go in vendor/github.com/gogo/protobuf/proto.Marshal at line 2937
pkg/util/protoutil/marshaler.go in pkg/util/protoutil.(*ProtoPb).Marshal at line 40
vendor/github.com/grpc-ecosystem/grpc-gateway/runtime/errors.go in vendor/github.com/grpc-ecosystem/grpc-gateway/runtime.DefaultHTTPError at line 139
vendor/github.com/grpc-ecosystem/grpc-gateway/runtime/errors.go in vendor/github.com/grpc-ecosystem/grpc-gateway/runtime.MuxOrGlobalHTTPError at line 102
pkg/server/serverpb/status.pb.gw.go in pkg/server/serverpb.RegisterStatusHandlerClient.func22 at line 2900
vendor/github.com/grpc-ecosystem/grpc-gateway/runtime/mux.go in vendor/github.com/grpc-ecosystem/grpc-gateway/runtime.(*ServeMux).ServeHTTP at line 240
/usr/local/go/src/net/http/server.go in net/http.(*ServeMux).ServeHTTP at line 2387
pkg/server/server.go in pkg/server.(*safeServeMux).ServeHTTP at line 128
pkg/server/server.go in pkg/server.(*Server).ServeHTTP at line 1964
/usr/local/go/src/net/http/server.go in net/http.serverHandler.ServeHTTP at line 2802
/usr/local/go/src/net/http/server.go in net/http.(*conn).serve at line 1890
/usr/local/go/src/runtime/asm_amd64.s in runtime.goexit at line 1357

Tag	Value
Cockroach Release	v20.2.0-alpha.1
Cockroach SHA:	59b7964
Platform	linux amd64
Distribution	CCL
Environment	v20.2.0-alpha.1
Command	start-single-node
Go Version	``
# of CPUs
# of Goroutines

[yuzefovich]

Fixed by #49842.