colexecerror: v24.1.3: "node unavailable" error shouldn't result in a sentry report

[cockroach-sentry]

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: https://cockroach-labs.sentry.io/issues/5693418213/?referrer=webhooks_plugin

Panic Message:

error.go:61: unexpected error from the vectorized engine: node unavailable; try another peer
(1) attached stack trace
  -- stack trace:
  | github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Inbox).Next.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc/inbox.go:324
  | runtime.gopanic
  | 	GOROOT/src/runtime/panic.go:770
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.ExpectedError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:275
  | github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Inbox).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc/inbox.go:385
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:118
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:135
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:126
  | github.com/cockroachdb/cockroach/pkg/sql/colexecop.(*noopOperator).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecop/operator.go:430
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:118
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:135
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:126
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).nextAdapter
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:250
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:135
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:254
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:286
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/vectorized_flow.go:320
  | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
  | 	github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:928
  | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
  | 	github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1990
  | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3
  | 	github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1704
  | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll
  | 	github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1707
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:2454
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:2004
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1150
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:145
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:3457
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:144
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execPortal
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:250
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func2
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2397
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2399
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2214
  | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:965
  | github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommands
  | 	github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:253
Wraps: (2)
Wraps: (3) tags: [n2,client=10.11.0.43:42948,hostssl,user=×,f×,distsql.stmt=×,distsql.gateway=2,distsql.appname=×,distsql.txn=×,streamID=×,received-error]
Wraps: (4) tags: [n×,f×,distsql.stmt=×,distsql.gateway=×,distsql.appname=×,distsql.txn=×,streamID=×,sent-error=]
Wraps: (5) assertion failure
Wraps: (6)
  | (opaque error wrapper)
  | type name: github.com/cockroachdb/errors/withstack/*withstack.withStack
  | reportable 0:
  |
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:61
  | runtime.gopanic
  | 	GOROOT/src/runtime/panic.go:770
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.InternalError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:267
  | github.com/cockroachdb/cockroach/pkg/sql/colfetcher.(*ColIndexJoin).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colfetcher/index_join.go:226
  | github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecutils.(*CancelChecker).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecutils/cancel_checker.go:59
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:118
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:135
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:126
  | github.com/cockroachdb/cockroach/pkg/sql/colexec.(*allSpooler).spool
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/sort.go:136
  | github.com/cockroachdb/cockroach/pkg/sql/colexec.(*sortOp).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/sort.go:280
  | github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecdisk.(*diskSpillerBase).Next.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecdisk/disk_spiller.go:202
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:135
  | github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecdisk.(*diskSpillerBase).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecdisk/disk_spiller.go:200
  | github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecbase.(*simpleProjectOp).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecbase/simple_project.go:124
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:118
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:135
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:126
  | github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecutils.(*deselectorOp).Next
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecutils/deselector.go:53
  | github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Outbox).sendBatches.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc/outbox.go:273
  | github.com/cockroachdb/cockroach/pkg/s...

Stacktrace (expand for inline code snippets):

cockroach/pkg/sql/pgwire/conn.go

Lines 252 to 254 in 9e10212

	reservedOwned = false // We're about to pass ownership away.
	retErr = sqlServer.ServeConn(
	ctx,

cockroach/pkg/sql/conn_executor.go

Lines 964 to 966 in 9e10212

	}(ctx, h)
	return h.ex.run(ctx, s.pool, reserved, cancel)
	}

cockroach/pkg/sql/conn_executor.go

Lines 2213 to 2215 in 9e10212

	var err error
	if err = ex.execCmd(); err != nil {
	// Both of these errors are normal ways for the connExecutor to exit.

cockroach/pkg/sql/conn_executor.go

Lines 2398 to 2400 in 9e10212

	return err
	}()
	// Note: we write to ex.statsCollector.phaseTimes, instead of ex.phaseTimes,

cockroach/pkg/sql/conn_executor.go

Lines 2396 to 2398 in 9e10212

	canAutoCommit := ex.implicitTxn() && tcmd.FollowedBySync
	ev, payload, err = ex.execPortal(ctx, portal, portalName, stmtRes, pinfo, canAutoCommit)
	return err

cockroach/pkg/sql/conn_executor_exec.go

Lines 249 to 251 in 9e10212

	}
	ev, payload, retErr = ex.execStmt(ctx, portal.Stmt.Statement, &portal, pinfo, stmtRes, canAutoCommit)
	// For a non-pausable portal, it is considered exhausted regardless of the

cockroach/pkg/sql/conn_executor_exec.go

Lines 143 to 145 in 9e10212

	}
	err = ex.execWithProfiling(ctx, ast, preparedStmt, func(ctx context.Context) error {
	ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, portal, pinfo, res, canAutoCommit)

cockroach/pkg/sql/conn_executor_exec.go

Lines 3456 to 3458 in 9e10212

	} else {
	err = op(ctx)
	}

cockroach/pkg/sql/conn_executor_exec.go

Lines 144 to 146 in 9e10212

	err = ex.execWithProfiling(ctx, ast, preparedStmt, func(ctx context.Context) error {
	ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, portal, pinfo, res, canAutoCommit)
	return err

cockroach/pkg/sql/conn_executor_exec.go

Lines 1149 to 1151 in 9e10212

	} else {
	if err := ex.dispatchToExecutionEngine(stmtCtx, p, res); err != nil {
	stmtThresholdSpan.Finish()

cockroach/pkg/sql/conn_executor_exec.go

Lines 2003 to 2005 in 9e10212

	ex.sessionTracing.TraceExecStart(ctx, "distributed")
	stats, err = ex.execWithDistSQLEngine(
	ctx, planner, stmt.AST.StatementReturnType(), res, distribute, progAtomic, distSQLProhibitedErr,

cockroach/pkg/sql/conn_executor_exec.go

Lines 2453 to 2455 in 9e10212

	}
	err = ex.server.cfg.DistSQLPlanner.PlanAndRunAll(ctx, evalCtx, planCtx, planner, recv, evalCtxFactory)
	}

cockroach/pkg/sql/distsql_running.go

Lines 1706 to 1708 in 9e10212

	)
	}()

cockroach/pkg/sql/distsql_running.go

Lines 1703 to 1705 in 9e10212

	defer cleanup()
	dsp.PlanAndRun(
	ctx, evalCtx, planCtx, planner.txn, planner.curPlan.main, recv, finishedSetupFn,

cockroach/pkg/sql/distsql_running.go

Lines 1989 to 1991 in 9e10212

	recv.expectedRowsRead = int64(physPlan.TotalEstimatedScannedRows)
	dsp.Run(ctx, planCtx, txn, physPlan, recv, evalCtx, finishedSetupFn)
	}

cockroach/pkg/sql/distsql_running.go

Lines 927 to 929 in 9e10212

	noWait := planCtx.getPortalPauseInfo() != nil
	flow.Run(ctx, noWait)
	}

cockroach/pkg/sql/colflow/vectorized_flow.go

Lines 319 to 321 in 9e10212

	log.VEvent(ctx, 1, "running the batch flow coordinator in the flow's goroutine")
	f.batchFlowCoordinator.Run(ctx)
	}

cockroach/pkg/sql/colflow/flow_coordinator.go

Lines 285 to 287 in 9e10212

	for status == execinfra.NeedMoreRows {
	err := f.next()
	if err != nil {

cockroach/pkg/sql/colflow/flow_coordinator.go

Lines 253 to 255 in 9e10212

	func (f *BatchFlowCoordinator) next() error {
	return colexecerror.CatchVectorizedRuntimeError(f.nextAdapter)
	}

cockroach/pkg/sql/colexecerror/error.go

Lines 134 to 136 in 9e10212

	}()
	operation()
	return retErr

cockroach/pkg/sql/colflow/flow_coordinator.go

Lines 249 to 251 in 9e10212

	func (f *BatchFlowCoordinator) nextAdapter() {
	f.batch = f.input.Root.Next()
	}

cockroach/pkg/sql/colflow/stats.go

Lines 125 to 127 in 9e10212

	// execution time (e.g. in the statement bundle).
	err := colexecerror.CatchVectorizedRuntimeError(bic.next)
	bic.stopwatch.Stop()

cockroach/pkg/sql/colexecerror/error.go

Lines 134 to 136 in 9e10212

	}()
	operation()
	return retErr

cockroach/pkg/sql/colflow/stats.go

Lines 117 to 119 in 9e10212

	func (bic *batchInfoCollector) next() {
	bic.batch = bic.Input.Next()
	}

cockroach/pkg/sql/colexecop/operator.go

Lines 429 to 431 in 9e10212

	func (n *noopOperator) Next() coldata.Batch {
	return n.Input.Next()
	}

cockroach/pkg/sql/colflow/stats.go

Lines 125 to 127 in 9e10212

	// execution time (e.g. in the statement bundle).
	err := colexecerror.CatchVectorizedRuntimeError(bic.next)
	bic.stopwatch.Stop()

cockroach/pkg/sql/colexecerror/error.go

Lines 134 to 136 in 9e10212

	}()
	operation()
	return retErr

cockroach/pkg/sql/colflow/stats.go

Lines 117 to 119 in 9e10212

	func (bic *batchInfoCollector) next() {
	bic.batch = bic.Input.Next()
	}

cockroach/pkg/sql/colflow/colrpc/inbox.go

Lines 384 to 386 in 9e10212

	if receivedErr != nil {
	colexecerror.ExpectedError(receivedErr)
	}

cockroach/pkg/sql/colexecerror/error.go

Lines 274 to 276 in 9e10212

	func ExpectedError(err error) {
	panic(newNotInternalError(err))
	}

GOROOT/src/runtime/panic.go#L769-L771

cockroach/pkg/sql/colflow/colrpc/inbox.go

Lines 323 to 325 in 9e10212

	}
	err := logcrash.PanicAsError(0, panicObj)
	log.VEventf(i.Ctx, 1, "Inbox encountered an error in Next: %v", err)

src/runtime/asm_amd64.s#L1694-L1696

cockroach/pkg/sql/colflow/vectorized_flow.go

Lines 733 to 735 in 9e10212

	defer wg.Done()
	run(ctx, flowCtxCancel)
	}()

cockroach/pkg/sql/colflow/vectorized_flow.go

Lines 771 to 773 in 9e10212

	run := func(ctx context.Context, flowCtxCancel context.CancelFunc) {
	outbox.Run(
	ctx,

cockroach/pkg/sql/colflow/colrpc/outbox.go

Lines 224 to 226 in 9e10212

	log.VEvent(ctx, 2, "Outbox starting normal operation")
	o.runWithStream(ctx, stream, flowCtxCancel, outboxCtxCancel)
	log.VEvent(ctx, 2, "Outbox exiting")

cockroach/pkg/sql/colflow/colrpc/outbox.go

Lines 401 to 403 in 9e10212

	terminatedGracefully, errToSend := o.sendBatches(ctx, stream, flowCtxCancel, outboxCtxCancel)
	if terminatedGracefully || errToSend != nil {

cockroach/pkg/sql/colflow/colrpc/outbox.go

Lines 263 to 265 in 9e10212

	}
	errToSend = colexecerror.CatchVectorizedRuntimeError(func() {
	o.Input.Init(o.runnerCtx)

cockroach/pkg/sql/colexecerror/error.go

Lines 134 to 136 in 9e10212

	}()
	operation()
	return retErr

cockroach/pkg/sql/colflow/colrpc/outbox.go

Lines 272 to 274 in 9e10212

	batch := o.Input.Next()
	n := batch.Length()

cockroach/pkg/sql/colexec/colexecutils/deselector.go

Lines 52 to 54 in 9e10212

	func (p *deselectorOp) Next() coldata.Batch {
	batch := p.Input.Next()
	if batch.Selection() == nil || batch.Length() == 0 {

cockroach/pkg/sql/colflow/stats.go

Lines 125 to 127 in 9e10212

	// execution time (e.g. in the statement bundle).
	err := colexecerror.CatchVectorizedRuntimeError(bic.next)
	bic.stopwatch.Stop()

cockroach/pkg/sql/colexecerror/error.go

Lines 134 to 136 in 9e10212

	}()
	operation()
	return retErr

cockroach/pkg/sql/colflow/stats.go

Lines 117 to 119 in 9e10212

	func (bic *batchInfoCollector) next() {
	bic.batch = bic.Input.Next()
	}

cockroach/pkg/sql/colexec/colexecbase/simple_project.go

Lines 123 to 125 in 9e10212

	func (d *simpleProjectOp) Next() coldata.Batch {
	batch := d.Input.Next()
	if batch.Length() == 0 {

cockroach/pkg/sql/colexec/colexecdisk/disk_spiller.go

Lines 199 to 201 in 9e10212

	var batch coldata.Batch
	if err := colexecerror.CatchVectorizedRuntimeError(
	func() {

cockroach/pkg/sql/colexecerror/error.go

Lines 134 to 136 in 9e10212

	}()
	operation()
	return retErr

cockroach/pkg/sql/colexec/colexecdisk/disk_spiller.go

Lines 201 to 203 in 9e10212

	func() {
	batch = d.inMemoryOp.Next()
	},

cockroach/pkg/sql/colexec/sort.go

Lines 279 to 281 in 9e10212

	case sortSpooling:
	p.input.spool()
	p.state = sortSorting

cockroach/pkg/sql/colexec/sort.go

Lines 135 to 137 in 9e10212

	p.spooled = true
	for batch := p.Input.Next(); batch.Length() != 0; batch = p.Input.Next() {
	p.bufferedTuples.AppendTuples(batch, 0 /* startIdx */, batch.Length())

cockroach/pkg/sql/colflow/stats.go

Lines 125 to 127 in 9e10212

	// execution time (e.g. in the statement bundle).
	err := colexecerror.CatchVectorizedRuntimeError(bic.next)
	bic.stopwatch.Stop()

cockroach/pkg/sql/colexecerror/error.go

Lines 134 to 136 in 9e10212

	}()
	operation()
	return retErr

cockroach/pkg/sql/colflow/stats.go

Lines 117 to 119 in 9e10212

	func (bic *batchInfoCollector) next() {
	bic.batch = bic.Input.Next()
	}

cockroach/pkg/sql/colexec/colexecutils/cancel_checker.go

Lines 58 to 60 in 9e10212

	c.CheckEveryCall()
	return c.Input.Next()
	}

cockroach/pkg/sql/colfetcher/index_join.go

Lines 225 to 227 in 9e10212

	); err != nil {
	colexecerror.InternalError(err)
	}

cockroach/pkg/sql/colexecerror/error.go

Lines 266 to 268 in 9e10212

	func InternalError(err error) {
	panic(newInternalError(err))
	}

GOROOT/src/runtime/panic.go#L769-L771

cockroach/pkg/sql/colexecerror/error.go

Lines 60 to 62 in 9e10212

	if code := pgerror.GetPGCode(retErr); code == pgcode.Uncategorized {
	retErr = errors.NewAssertionErrorWithWrappedErrf(
	retErr, "unexpected error from the vectorized engine",

pkg/sql/pgwire/conn.go in pkg/sql/pgwire.(*conn).processCommands at line 253
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn at line 965
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).run at line 2214
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd at line 2399
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd.func2 at line 2397
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execPortal at line 250
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt at line 144
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 3457
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func1 at line 145
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 1150
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 2004
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithDistSQLEngine at line 2454
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll at line 1707
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3 at line 1704
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRun at line 1990
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).Run at line 928
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlow).Run at line 320
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run at line 286
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).next at line 254
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 135
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).nextAdapter at line 250
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Next at line 126
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 135
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).next at line 118
pkg/sql/colexecop/operator.go in pkg/sql/colexecop.(*noopOperator).Next at line 430
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Next at line 126
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 135
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).next at line 118
pkg/sql/colflow/colrpc/inbox.go in pkg/sql/colflow/colrpc.(*Inbox).Next at line 385
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.ExpectedError at line 275
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/sql/colflow/colrpc/inbox.go in pkg/sql/colflow/colrpc.(*Inbox).Next.func1 at line 324
src/runtime/asm_amd64.s in runtime.goexit at line 1695
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlowCreator).setupRemoteOutputStream.(*vectorizedFlowCreator).accumulateAsyncComponent.func2.1 at line 734
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlowCreator).setupRemoteOutputStream.func1 at line 772
pkg/sql/colflow/colrpc/outbox.go in pkg/sql/colflow/colrpc.(*Outbox).Run at line 225
pkg/sql/colflow/colrpc/outbox.go in pkg/sql/colflow/colrpc.(*Outbox).runWithStream at line 402
pkg/sql/colflow/colrpc/outbox.go in pkg/sql/colflow/colrpc.(*Outbox).sendBatches at line 264
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 135
pkg/sql/colflow/colrpc/outbox.go in pkg/sql/colflow/colrpc.(*Outbox).sendBatches.func1 at line 273
pkg/sql/colexec/colexecutils/deselector.go in pkg/sql/colexec/colexecutils.(*deselectorOp).Next at line 53
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Next at line 126
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 135
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).next at line 118
pkg/sql/colexec/colexecbase/simple_project.go in pkg/sql/colexec/colexecbase.(*simpleProjectOp).Next at line 124
pkg/sql/colexec/colexecdisk/disk_spiller.go in pkg/sql/colexec/colexecdisk.(*diskSpillerBase).Next at line 200
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 135
pkg/sql/colexec/colexecdisk/disk_spiller.go in pkg/sql/colexec/colexecdisk.(*diskSpillerBase).Next.func1 at line 202
pkg/sql/colexec/sort.go in pkg/sql/colexec.(*sortOp).Next at line 280
pkg/sql/colexec/sort.go in pkg/sql/colexec.(*allSpooler).spool at line 136
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Next at line 126
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 135
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).next at line 118
pkg/sql/colexec/colexecutils/cancel_checker.go in pkg/sql/colexec/colexecutils.(*CancelChecker).Next at line 59
pkg/sql/colfetcher/index_join.go in pkg/sql/colfetcher.(*ColIndexJoin).Next at line 226
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.InternalError at line 267
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 61

Tags

Tag	Value
Command	server
Environment	v24.1.3
Go Version	go1.22.5 X:nocoverageredesign
Platform	linux amd64
Distribution	CCL
Cockroach Release	v24.1.3
Cockroach SHA	9e10212
# of CPUs	4
# of Goroutines	474

Jira issue: CRDB-41123

[yuzefovich]

This shouldn't have resulted in a sentry report. Perhaps it's related to colexecerror change we did earlier this year, or upgrade to errors library somewhat recently too.

[blathers-crl]

Based on the specified backports for linked PR #135859, I applied the following new label(s) to this issue: branch-release-23.2, branch-release-24.2, branch-release-24.3. Please adjust the labels as needed to match the branches actually affected by this issue, including adding any known older branches.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}