Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... #93539

Closed
cockroach-teamcity opened this issue Dec 13, 2022 · 1 comment
Closed

sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... #93539

cockroach-teamcity opened this issue Dec 13, 2022 · 1 comment
Labels
C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report.

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Dec 13, 2022 •
edited by cockroach-jira-scripts
Loading

This issue was autofiled by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry link: https://sentry.io/organizations/cockroach-labs/issues/3806512468/?referrer=webhooks_plugin

Panic message:

panic.go:1038: runtime: allocation size out of range
(1) attached stack trace
-- stack trace:
| runtime.gopanic
| /opt/ooce/go-1.17/src/runtime/panic.go:1038
| runtime.newarray
| /opt/ooce/go-1.17/src/runtime/malloc.go:1254
| reflect.unsafe_NewArray
| /opt/ooce/go-1.17/src/runtime/malloc.go:1261
| reflect.MakeSlice
| /opt/ooce/go-1.17/src/reflect/value.go:2657
| reflect.grow
| /opt/ooce/go-1.17/src/reflect/value.go:2394
| reflect.Append
| /opt/ooce/go-1.17/src/reflect/value.go:2403
| github.com/gogo/protobuf/proto.(*mergeInfo).computeMergeInfo.func27
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/table_merge.go:542
| github.com/gogo/protobuf/proto.(*mergeInfo).merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/table_merge.go:139
| github.com/gogo/protobuf/proto.(*InternalMessageInfo).Merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/table_merge.go:50
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descpb.(*TableDescriptor).XXX_Merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descpb/structured.pb.go:2080
| github.com/gogo/protobuf/proto.Merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/clone.go:95
| github.com/gogo/protobuf/proto.Clone
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/clone.go:52
| github.com/cockroachdb/cockroach/pkg/util/protoutil.Clone
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/util/protoutil/clone.go:79
| github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc.newBuilder
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go:88
| github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc.NewBuilder
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go:50
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descbuilder.NewBuilderWithMVCCTimestamp
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descbuilder/desc_builder.go:34
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.build
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:195
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuerier.processDescriptorResultRow
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:162
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuerier.query
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:129
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.GetCatalogUnvalidated
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/descriptors.go:39
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*kvDescriptors).getAllDescriptors
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/kv_descriptors.go:267
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).GetAllDescriptors
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/collection.go:284
| github.com/cockroachdb/cockroach/pkg/sql.glob..func75.1
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/crdb_internal.go:426
| github.com/cockroachdb/cockroach/pkg/sql.setupGenerator.func3
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/virtual_table.go:127
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:494
| runtime.goexit
| /opt/ooce/go-1.17/src/runtime/asm_amd64.s:1581
Wraps: (2) runtime: allocation size out of range
Error types: (1) *withstack.withStack (2) runtime.plainError
-- report composition:
runtime.plainError
panic.go:1038: *withstack.withStack (top exception)

Stacktrace (expand for inline code snippets):

/opt/ooce/go-1.17/src/runtime/panic.go#L1037-L1039 in runtime.gopanic
/opt/ooce/go-1.17/src/runtime/malloc.go#L1253-L1255 in runtime.newarray
/opt/ooce/go-1.17/src/runtime/malloc.go#L1260-L1262 in reflect.unsafe_NewArray
/opt/ooce/go-1.17/src/reflect/value.go#L2656-L2658 in reflect.MakeSlice
/opt/ooce/go-1.17/src/reflect/value.go#L2393-L2395 in reflect.grow
/opt/ooce/go-1.17/src/reflect/value.go#L2402-L2404 in reflect.Append
https://github.com/cockroachdb/cockroach/blob/e438c2f89282e607e0e6ca1d38b2e0a622f94493/vendor/github.com/gogo/protobuf/proto/table_merge.go#L541-L543 in github.com/gogo/protobuf/proto.(*mergeInfo).computeMergeInfo.func27
https://github.com/cockroachdb/cockroach/blob/e438c2f89282e607e0e6ca1d38b2e0a622f94493/vendor/github.com/gogo/protobuf/proto/table_merge.go#L138-L140 in github.com/gogo/protobuf/proto.(*mergeInfo).merge
https://github.com/cockroachdb/cockroach/blob/e438c2f89282e607e0e6ca1d38b2e0a622f94493/vendor/github.com/gogo/protobuf/proto/table_merge.go#L49-L51 in github.com/gogo/protobuf/proto.(*InternalMessageInfo).Merge
https://github.com/cockroachdb/cockroach/blob/e438c2f89282e607e0e6ca1d38b2e0a622f94493/pkg/sql/catalog/descpb/structured.pb.go#L2079-L2081 in pkg/sql/catalog/descpb.(*TableDescriptor).XXX_Merge
https://github.com/cockroachdb/cockroach/blob/e438c2f89282e607e0e6ca1d38b2e0a622f94493/vendor/github.com/gogo/protobuf/proto/clone.go#L94-L96 in github.com/gogo/protobuf/proto.Merge
https://github.com/cockroachdb/cockroach/blob/e438c2f89282e607e0e6ca1d38b2e0a622f94493/vendor/github.com/gogo/protobuf/proto/clone.go#L51-L53 in github.com/gogo/protobuf/proto.Clone

cockroach/pkg/util/protoutil/clone.go

Lines 78 to 80 in e438c2f

}
return proto.Clone(pb).(Message)
}
in pkg/util/protoutil.Clone

cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go

Lines 87 to 89 in e438c2f

return &tableDescriptorBuilder{
original: protoutil.Clone(desc).(*descpb.TableDescriptor),
isUncommittedVersion: isUncommittedVersion,
in pkg/sql/catalog/tabledesc.newBuilder

cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go

Lines 49 to 51 in e438c2f

func NewBuilder(desc *descpb.TableDescriptor) TableDescriptorBuilder {
return newBuilder(desc, false, /* isUncommittedVersion */
catalog.PostDeserializationChanges{})
in pkg/sql/catalog/tabledesc.NewBuilder

cockroach/pkg/sql/catalog/descbuilder/desc_builder.go

Lines 33 to 35 in e438c2f

case table != nil:
return tabledesc.NewBuilder(table)
case database != nil:
in pkg/sql/catalog/descbuilder.NewBuilderWithMVCCTimestamp

cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go

Lines 194 to 196 in e438c2f

}
b = descbuilder.NewBuilderWithMVCCTimestamp(&descProto, rowValue.Timestamp)
}
in pkg/sql/catalog/internal/catkv.build

cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go

Lines 161 to 163 in e438c2f

id := descpb.ID(u32ID)
desc, err := build(cq.expectedType, id, row.Value, cq.isRequired)
if err != nil {
in pkg/sql/catalog/internal/catkv.catalogQuerier.processDescriptorResultRow

cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go

Lines 128 to 130 in e438c2f

case keys.DescriptorTableID:
err = cq.processDescriptorResultRow(row, cb)
default:
in pkg/sql/catalog/internal/catkv.catalogQuerier.query

cockroach/pkg/sql/catalog/internal/catkv/descriptors.go

Lines 38 to 40 in e438c2f

log.Eventf(ctx, "fetching all descriptors and namespace entries")
return cq.query(ctx, txn, func(codec keys.SQLCodec, b *kv.Batch) {
b.Header.MaxSpanRequestKeys = 0
in pkg/sql/catalog/internal/catkv.GetCatalogUnvalidated

cockroach/pkg/sql/catalog/descs/kv_descriptors.go

Lines 266 to 268 in e438c2f

if kd.allDescriptors.isUnset() {
c, err := catkv.GetCatalogUnvalidated(ctx, kd.codec, txn)
if err != nil {
in pkg/sql/catalog/descs.(*kvDescriptors).getAllDescriptors

cockroach/pkg/sql/catalog/descs/collection.go

Lines 283 to 285 in e438c2f

func (tc *Collection) GetAllDescriptors(ctx context.Context, txn *kv.Txn) (nstree.Catalog, error) {
return tc.kv.getAllDescriptors(ctx, txn, tc.version)
}
in pkg/sql/catalog/descs.(*Collection).GetAllDescriptors

cockroach/pkg/sql/crdb_internal.go

Lines 425 to 427 in e438c2f

worker := func(ctx context.Context, pusher rowPusher) error {
all, err := p.Descriptors().GetAllDescriptors(ctx, p.txn)
if err != nil {
in pkg/sql.glob..func75.1

cockroach/pkg/sql/virtual_table.go

Lines 126 to 128 in e438c2f

}
err := worker(ctx, funcRowPusher(addRow))
// If the query was canceled, next() will already return a
in pkg/sql.setupGenerator.func3

cockroach/pkg/util/stop/stopper.go

Lines 493 to 495 in e438c2f

f(ctx)
}()
in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
/opt/ooce/go-1.17/src/runtime/asm_amd64.s#L1580-L1582 in runtime.goexit

/opt/ooce/go-1.17/src/runtime/panic.go in runtime.gopanic at line 1038
/opt/ooce/go-1.17/src/runtime/malloc.go in runtime.newarray at line 1254
/opt/ooce/go-1.17/src/runtime/malloc.go in reflect.unsafe_NewArray at line 1261
/opt/ooce/go-1.17/src/reflect/value.go in reflect.MakeSlice at line 2657
/opt/ooce/go-1.17/src/reflect/value.go in reflect.grow at line 2394
/opt/ooce/go-1.17/src/reflect/value.go in reflect.Append at line 2403
vendor/github.com/gogo/protobuf/proto/table_merge.go in github.com/gogo/protobuf/proto.(*mergeInfo).computeMergeInfo.func27 at line 542
vendor/github.com/gogo/protobuf/proto/table_merge.go in github.com/gogo/protobuf/proto.(*mergeInfo).merge at line 139
vendor/github.com/gogo/protobuf/proto/table_merge.go in github.com/gogo/protobuf/proto.(*InternalMessageInfo).Merge at line 50
pkg/sql/catalog/descpb/structured.pb.go in pkg/sql/catalog/descpb.(*TableDescriptor).XXX_Merge at line 2080
vendor/github.com/gogo/protobuf/proto/clone.go in github.com/gogo/protobuf/proto.Merge at line 95
vendor/github.com/gogo/protobuf/proto/clone.go in github.com/gogo/protobuf/proto.Clone at line 52
pkg/util/protoutil/clone.go in pkg/util/protoutil.Clone at line 79
pkg/sql/catalog/tabledesc/table_desc_builder.go in pkg/sql/catalog/tabledesc.newBuilder at line 88
pkg/sql/catalog/tabledesc/table_desc_builder.go in pkg/sql/catalog/tabledesc.NewBuilder at line 50
pkg/sql/catalog/descbuilder/desc_builder.go in pkg/sql/catalog/descbuilder.NewBuilderWithMVCCTimestamp at line 34
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.build at line 195
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.catalogQuerier.processDescriptorResultRow at line 162
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.catalogQuerier.query at line 129
pkg/sql/catalog/internal/catkv/descriptors.go in pkg/sql/catalog/internal/catkv.GetCatalogUnvalidated at line 39
pkg/sql/catalog/descs/kv_descriptors.go in pkg/sql/catalog/descs.(*kvDescriptors).getAllDescriptors at line 267
pkg/sql/catalog/descs/collection.go in pkg/sql/catalog/descs.(*Collection).GetAllDescriptors at line 284
pkg/sql/crdb_internal.go in pkg/sql.glob..func75.1 at line 426
pkg/sql/virtual_table.go in pkg/sql.setupGenerator.func3 at line 127
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 494
/opt/ooce/go-1.17/src/runtime/asm_amd64.s in runtime.goexit at line 1581
Tag Value
Cockroach Release v22.1.9-dirty
Cockroach SHA: e438c2f
Platform illumos amd64
Distribution OSS
Environment development
Command start-single-node
Go Version ``
# of CPUs
# of Goroutines

Jira issue: CRDB-22386
@cockroach-teamcity cockroach-teamcity added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. labels Dec 13, 2022
@yuzefovich
Copy link
Member

pretty sure this was during oxidecomputer/omicron#1146

@exalate-issue-sync exalate-issue-sync bot changed the title sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... Dec 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@yuzefovich @cockroach-teamcity