Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kvserver: v22.2.0-beta.4: raft closed timestamp regression in cmd #90682

Closed
cockroach-teamcity opened this issue Oct 26, 2022 · 7 comments
Closed
Labels
C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. T-kv KV Team

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Oct 26, 2022

This issue was autofiled by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry link: https://sentry.io/organizations/cockroach-labs/issues/3697992203/?referrer=webhooks_plugin

Panic message:

store_raft.go:642: log.Fatal: ???: raft closed timestamp regression in cmd: "5'\xe6o\xddR\x1ba" (term: 24, index: 14613676); batch state: 1666765659.799078319,0, command: 1666765659.795902192,0, lease: repl=(n2,s2):3 seq=16 start=1666751056.620535333,0 epo=10 pro=1666765659.953943479,3719, req: <unknown; not leaseholder>, applying at LAI: 6552724.
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processReady
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:642
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:308
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:489
| runtime.goexit
| GOROOT/src/runtime/asm_amd64.s:1594
Wraps: (2) secondary error attachment
| raft closed timestamp regression in cmd: "5'\xe6o\xddR\x1ba" (term: 24, index: 14613676); batch state: 1666765659.799078319,0, command: 1666765659.795902192,0, lease: repl=(n2,s2):3 seq=16 start=1666751056.620535333,0 epo=10 pro=1666765659.953943479,3719, req: <unknown; not leaseholder>, applying at LAI: 6552724.
| (1) assertion failure
| Wraps: (2) attached stack trace
| -- stack trace:
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaAppBatch).assertNoCmdClosedTimestampRegression
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_application_state_machine.go:1169
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaAppBatch).Stage
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_application_state_machine.go:511
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.mapCmdIter
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply/cmd.go:184
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.(*Task).applyOneBatch
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply/task.go:279
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.(*Task).ApplyCommittedEntries
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply/task.go:246
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:1038
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReady
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:657
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processReady
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:641
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:308
| | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| | github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:489
| | runtime.goexit
| | GOROOT/src/runtime/asm_amd64.s:1594
| Wraps: (3) raft closed timestamp regression in cmd: "5'\xe6o\xddR\x1ba" (term: 24, index: 14613676); batch state: 1666765659.799078319,0, command: 1666765659.795902192,0, lease: repl=(n2,s2):3 seq=16 start=1666751056.620535333,0 epo=10 pro=1666765659.953943479,3719, req: <unknown; not leaseholder>, applying at LAI: 6552724.
| | Closed timestamp was set by req: <unknown; not leaseholder or not lease request> under lease: ; applied at LAI: 0. Batch idx: 0.
| | This assertion will fire again on restart; to ignore run with env var COCKROACH_RAFT_CLOSEDTS_ASSERTIONS_ENABLED=false
| | Raft log tail:
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
| |
| |
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| | ×
| |
| | ×
| | ×
| | ×
| | ×
...

Stacktrace (expand for inline code snippets):

https://github.com/cockroachdb/cockroach/blob/cc25a7893ea924897fcc6d3e80d116c85666e8eb/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L641-L643 in pkg/kv/kvserver.(*Store).processReady
https://github.com/cockroachdb/cockroach/blob/cc25a7893ea924897fcc6d3e80d116c85666e8eb/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L307-L309 in pkg/kv/kvserver.(*raftScheduler).worker

sp.UpdateGoroutineIDToCurrent()
f(ctx)
}()
in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
GOROOT/src/runtime/asm_amd64.s#L1593-L1595 in runtime.goexit

pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processReady at line 642
pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go in pkg/kv/kvserver.(*raftScheduler).worker at line 308
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 489
GOROOT/src/runtime/asm_amd64.s in runtime.goexit at line 1594
Tag Value
Cockroach Release v22.2.0-beta.4
Cockroach SHA: cc25a78
Platform linux amd64
Distribution CCL
Environment v22.2.0-beta.4
Command server
Go Version ``
# of CPUs
# of Goroutines

Jira issue: CRDB-20886

@cockroach-teamcity cockroach-teamcity added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. labels Oct 26, 2022
@jiamo
Copy link

jiamo commented Oct 26, 2022

with 22.2.04.demo The node can't start at the same location. The total log:

root@dev-build:/th/data/roach3/logs# cat cockroach.log
I221026 10:38:01.488326 1 util/log/file_sync_buffer.go:238 ⋮ [config] file created at: 2022/10/26 10:38:01
I221026 10:38:01.488330 1 util/log/file_sync_buffer.go:238 ⋮ [config] running on machine: ‹dev-build›
I221026 10:38:01.488332 1 util/log/file_sync_buffer.go:238 ⋮ [config] binary: CockroachDB CCL v22.2.0-beta.4 (x86_64-pc-linux-gnu, built 2022/10/17 14:34:07, go1.19.1)
I221026 10:38:01.488335 1 util/log/file_sync_buffer.go:238 ⋮ [config] arguments: [‹./cockroach› ‹start› ‹--insecure› ‹--store=/th/data/roach3› ‹--listen-addr=192.168.160.7:26259› ‹--advertise-addr=192.168.160.7:26259› ‹--http-addr=192.168.160.7:8083› ‹--join=192.168.160.7:26257,192.168.160.7:26258,192.168.160.7:26259›]
I221026 10:38:01.488349 1 util/log/file_sync_buffer.go:238 ⋮ [config] log format (utf8=✓): crdb-v2
I221026 10:38:01.488351 1 util/log/file_sync_buffer.go:238 ⋮ [config] line format: [IWEF]yymmdd hh:mm:ss.uuuuuu goid [chan@]file:line redactionmark [tags] [counter] msg
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 ALL SECURITY CONTROLS HAVE BEEN DISABLED!
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +This mode is intended for non-production testing only.
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +In this mode:
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +- Your cluster is open to any client that can access ‹192.168.160.7›.
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +- Intruders with access to your machine or network can observe client-server traffic.
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +- Intruders can log in without password and read or write any data in the cluster.
W221026 10:38:01.488273 1 1@cli/start.go:1210 ⋮ [n?] 1 +- Intruders can consume all your server's resources and cause unavailability.
I221026 10:38:01.488397 1 1@cli/start.go:1220 ⋮ [n?] 2 To start a secure server without mandating TLS for clients,
I221026 10:38:01.488397 1 1@cli/start.go:1220 ⋮ [n?] 2 +consider --accept-sql-without-tls instead. For other options, see:
I221026 10:38:01.488397 1 1@cli/start.go:1220 ⋮ [n?] 2 +
I221026 10:38:01.488397 1 1@cli/start.go:1220 ⋮ [n?] 2 +- https://go.crdb.dev/issue-v/53404/v22.2
I221026 10:38:01.488397 1 1@cli/start.go:1220 ⋮ [n?] 2 +- https://www.cockroachlabs.com/docs/v22.2/secure-a-cluster.html
I221026 10:38:01.488568 1 server/status/recorder.go:593 ⋮ [n?] 3 ‹available memory from cgroups (8.0 EiB) is unsupported, using system memory 31 GiB instead:›
W221026 10:38:01.488583 1 1@cli/start.go:1136 ⋮ [n?] 4 Using the default setting for --cache (128 MiB).
W221026 10:38:01.488583 1 1@cli/start.go:1136 ⋮ [n?] 4 + A significantly larger value is usually needed for good performance.
W221026 10:38:01.488583 1 1@cli/start.go:1136 ⋮ [n?] 4 + If you have a dedicated server a reasonable setting is --cache=.25 (7.8 GiB).
I221026 10:38:01.488672 1 server/status/recorder.go:593 ⋮ [n?] 5 ‹available memory from cgroups (8.0 EiB) is unsupported, using system memory 31 GiB instead:›
I221026 10:38:01.488678 1 1@cli/start.go:1249 ⋮ [n?] 6 ‹CockroachDB CCL v22.2.0-beta.4 (x86_64-pc-linux-gnu, built 2022/10/17 14:34:07, go1.19.1)›
I221026 10:38:01.489119 1 server/status/recorder.go:593 ⋮ [n?] 7 ‹available memory from cgroups (8.0 EiB) is unsupported, using system memory 31 GiB instead:›
I221026 10:38:01.489127 1 server/config.go:538 ⋮ [n?] 8 system total memory: 31 GiB
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 server configuration:
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹max offset 500000000›
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹cache size 128 MiB›
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹SQL memory pool size 7.8 GiB›
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹scan interval 10m0s›
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹scan min idle time 10ms›
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹scan max idle time 1s›
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹event log enabled true›
I221026 10:38:01.489136 1 server/config.go:540 ⋮ [n?] 9 +‹span configs enabled true›
I221026 10:38:01.489172 1 1@cli/start.go:1114 ⋮ [n?] 10 using local environment variables:
I221026 10:38:01.489172 1 1@cli/start.go:1114 ⋮ [n?] 10 +LANG=‹en_US.UTF-8›
I221026 10:38:01.489172 1 1@cli/start.go:1114 ⋮ [n?] 10 +LC_NUMERIC=‹zh_CN.UTF-8›
I221026 10:38:01.489172 1 1@cli/start.go:1114 ⋮ [n?] 10 +LC_TIME=‹zh_CN.UTF-8›
I221026 10:38:01.489172 1 1@cli/start.go:1114 ⋮ [n?] 10 +TERM=‹screen›
I221026 10:38:01.489178 1 1@cli/start.go:1121 ⋮ [n?] 11 process identity: ‹uid 0 euid 0 gid 0 egid 0›
I221026 10:38:01.490820 1 1@cli/start.go:1274 ⋮ [n?] 12 GEOS loaded from directory ‹/usr/local/lib/cockroach›
I221026 10:38:01.490838 1 1@cli/start.go:574 ⋮ [n?] 13 starting cockroach node
I221026 10:38:01.507886 73 server/config.go:734 ⋮ [n?] 14 1 storage engine initialized
I221026 10:38:01.507899 73 server/config.go:737 ⋮ [n?] 15 Pebble cache size: 128 MiB
I221026 10:38:01.507906 73 server/config.go:737 ⋮ [n?] 16 store 0: max size 0 B, max open file limit 1019000
I221026 10:38:01.507909 73 server/config.go:737 ⋮ [n?] 17 store 0: {Encrypted:false ReadOnly:false FileStoreProperties:{path=‹/th/data/roach3›, fs=nsfs, blkdev=‹nsfs›, mnt=‹/run/docker/netns/cfa73aa3332c› opts=‹rw›}}
I221026 10:38:01.509106 73 server/tracedumper/tracedumper.go:120 ⋮ [n?] 18 writing job trace dumps to ‹/th/data/roach3/logs/inflight_trace_dump›
I221026 10:38:01.539705 73 1@server/clock_monotonicity.go:65 ⋮ [n?] 19 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
I221026 10:38:01.543814 73 1@server/clock_monotonicity.go:140 ⋮ [n2] 21 Sleeping till wall time 1666780681543813081 to catches up to 1666780682039694740 to ensure monotonicity. Delta: 495.881659ms
I221026 10:38:01.543802 235 1@server/server.go:1397 ⋮ [n2] 20 connecting to gossip network to verify cluster ID ‹"5706ea84-22c7-4d90-93aa-d11f1dd02c69"›
W221026 10:38:02.040672 73 1@cli/start.go:1080 ⋮ [n2] 22 Running a server without --sql-addr, with a combined RPC/SQL listener, is deprecated.
W221026 10:38:02.040672 73 1@cli/start.go:1080 ⋮ [n2] 22 +This feature will be removed in the next version of CockroachDB.
W221026 10:38:02.045470 73 2@gossip/gossip.go:1513 ⋮ [n2] 23 no incoming or outgoing connections
I221026 10:38:02.045694 73 gossip/gossip.go:409 ⋮ [n2] 24 NodeDescriptor set to ‹node_id:2 address:<network_field:"tcp" address_field:"192.168.160.7:26259" > attrs:<> locality:<> ServerVersion:<major_val:22 minor_val:1 patch:0 internal:76 > build_tag:"v22.2.0-beta.4" started_at:1666780682045691972 cluster_name:"" sql_address:<network_field:"tcp" address_field:"192.168.160.7:26259" > http_address:<network_field:"tcp" address_field:"192.168.160.7:8083" >›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 ‹[core]›‹[Channel #8 SubChannel #9] grpc: addrConn.createTransport failed to connect to {›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 +‹ "Attributes": null,›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 +‹ "BalancerAttributes": null,›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 +‹ "Type": 0,›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 +‹ "Metadata": null›
W221026 10:38:02.046262 277 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 25 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:02.046307 275 1@circuitbreaker/circuitbreaker.go:322 ⋮ [n2] 26 circuitbreaker: ‹gossip 192.168.160.7:26259->192.168.160.7:26257› tripped: ‹initial connection heartbeat failed›: ‹rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:02.046350 275 1@circuitbreaker/circuitbreaker.go:447 ⋮ [n2] 27 circuitbreaker: ‹gossip 192.168.160.7:26259->192.168.160.7:26257› event: ‹BreakerTripped›
W221026 10:38:02.046361 275 gossip/client.go:118 ⋮ [n2] 28 failed to start gossip client to ‹192.168.160.7:26257›: ‹initial connection heartbeat failed›: ‹rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:02.061005 73 server/node.go:469 ⋮ [n2] 29 initialized store s2
I221026 10:38:02.061047 73 kv/kvserver/stores.go:286 ⋮ [n2] 30 read 2 node addresses from persistent storage
I221026 10:38:02.061091 235 1@server/server.go:1400 ⋮ [n2] 31 node connected via gossip
I221026 10:38:02.061267 222 1@circuitbreaker/circuitbreaker.go:322 ⋮ [n2] 32 circuitbreaker: ‹rpc 192.168.160.7:26259 [n3]› tripped: unable to look up descriptor for n3
I221026 10:38:02.061316 222 1@circuitbreaker/circuitbreaker.go:447 ⋮ [n2] 33 circuitbreaker: ‹rpc 192.168.160.7:26259 [n3]› event: ‹BreakerTripped›
I221026 10:38:02.061318 221 1@circuitbreaker/circuitbreaker.go:322 ⋮ [n2] 34 circuitbreaker: ‹rpc 192.168.160.7:26259 [n1]› tripped: unable to look up descriptor for n1
I221026 10:38:02.061340 221 1@circuitbreaker/circuitbreaker.go:447 ⋮ [n2] 35 circuitbreaker: ‹rpc 192.168.160.7:26259 [n1]› event: ‹BreakerTripped›
I221026 10:38:02.063070 73 server/node.go:548 ⋮ [n2] 36 started with engine type ‹2›
I221026 10:38:02.063104 73 server/node.go:550 ⋮ [n2] 37 started with attributes []
I221026 10:38:02.063134 73 server/goroutinedumper/goroutinedumper.go:122 ⋮ [n2] 38 writing goroutine dumps to ‹/th/data/roach3/logs/goroutine_dump›
I221026 10:38:02.063148 73 server/heapprofiler/heapprofiler.go:49 ⋮ [n2] 39 writing go heap profiles to ‹/th/data/roach3/logs/heap_profiler› at least every 1h0m0s
I221026 10:38:02.063677 73 server/heapprofiler/cgoprofiler.go:53 ⋮ [n2] 40 to enable jmalloc profiling: "export MALLOC_CONF=prof:true" or "ln -s prof:true /etc/malloc.conf"
I221026 10:38:02.063687 73 server/heapprofiler/statsprofiler.go:54 ⋮ [n2] 41 writing memory stats to ‹/th/data/roach3/logs/heap_profiler› at last every 1h0m0s
I221026 10:38:02.063823 73 server/heapprofiler/activequeryprofiler.go:85 ⋮ [n2] 42 writing go query profiles to ‹/th/data/roach3/logs/heap_profiler›
I221026 10:38:02.063888 73 1@server/server.go:1541 ⋮ [n2] 43 starting http server at ‹192.168.160.7:8083› (use: ‹192.168.160.7:8083›)
I221026 10:38:02.063913 73 1@server/server.go:1549 ⋮ [n2] 44 starting grpc/postgres server at ‹192.168.160.7:26259›
I221026 10:38:02.063928 73 1@server/server.go:1550 ⋮ [n2] 45 advertising CockroachDB node at ‹192.168.160.7:26259›
I221026 10:38:03.047440 441 gossip/client.go:124 ⋮ [n2] 46 started gossip client to n0 (‹192.168.160.7:26258›)
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 ‹[core]›‹[Channel #15 SubChannel #16] grpc: addrConn.createTransport failed to connect to {›
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 +‹ "Attributes": null,›
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 +‹ "BalancerAttributes": null,›
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 +‹ "Type": 0,›
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 +‹ "Metadata": null›
W221026 10:38:03.062078 474 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 47 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:03.062200 456 1@circuitbreaker/circuitbreaker.go:322 ⋮ [n2] 48 circuitbreaker: ‹rpc 192.168.160.7:26259 [n1]› tripped: failed to connect to n1 at ‹192.168.160.7:26257›: ‹initial connection heartbeat failed›: ‹rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:03.062268 456 1@circuitbreaker/circuitbreaker.go:447 ⋮ [n2] 49 circuitbreaker: ‹rpc 192.168.160.7:26259 [n1]› event: ‹BreakerTripped›
W221026 10:38:03.062331 456 2@rpc/nodedialer/nodedialer.go:192 ⋮ [n2] 50 unable to connect to n1: failed to connect to n1 at ‹192.168.160.7:26257›: ‹initial connection heartbeat failed›: ‹rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:03.812302 246 1@gossip/gossip.go:1527 ⋮ [n2] 51 node has connected to cluster via gossip
I221026 10:38:03.814276 246 kv/kvserver/stores.go:305 ⋮ [n2] 52 wrote 2 node addresses to persistent storage
I221026 10:38:04.262758 532 1@circuitbreaker/circuitbreaker.go:447 ⋮ [n2] 53 circuitbreaker: ‹rpc 192.168.160.7:26259 [n3]› event: ‹BreakerReset›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 ‹[core]›‹[Channel #8 SubChannel #9] grpc: addrConn.createTransport failed to connect to {›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 +‹ "Attributes": null,›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 +‹ "BalancerAttributes": null,›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 +‹ "Type": 0,›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 +‹ "Metadata": null›
W221026 10:38:05.046997 565 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 54 +‹}. Err: connection error: desc = "transport: Error while dialing cannot reuse client connection"›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 ‹[core]›‹[Channel #15 SubChannel #16] grpc: addrConn.createTransport failed to connect to {›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 +‹ "Attributes": null,›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 +‹ "BalancerAttributes": null,›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 +‹ "Type": 0,›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 +‹ "Metadata": null›
W221026 10:38:06.062336 643 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 55 +‹}. Err: connection error: desc = "transport: Error while dialing cannot reuse client connection"›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 ‹[core]›‹[Channel #28 SubChannel #29] grpc: addrConn.createTransport failed to connect to {›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 +‹ "Attributes": null,›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 +‹ "BalancerAttributes": null,›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 +‹ "Type": 0,›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 +‹ "Metadata": null›
W221026 10:38:06.162196 617 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 56 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
W221026 10:38:06.162307 615 2@rpc/nodedialer/nodedialer.go:192 ⋮ [n2] 57 unable to connect to n1: failed to connect to n1 at ‹192.168.160.7:26257›: ‹initial connection heartbeat failed›: ‹rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:06.211144 675 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n2] 58 spanconfig-subscriber: established range feed cache
I221026 10:38:06.235812 73 1@util/log/event_log.go:32 ⋮ [n2] 59 ={"Timestamp":1666780686235810074,"EventType":"node_restart","NodeID":2,"StartedAt":1666780682045691972,"LastUp":1666779883031879504}
I221026 10:38:06.235858 73 sql/sqlliveness/slinstance/slinstance.go:359 ⋮ [n2] 60 starting SQL liveness instance
I221026 10:38:06.236007 681 sql/temporary_schema.go:498 ⋮ [n2] 61 skipping temporary object cleanup run as it is not the leaseholder
I221026 10:38:06.236026 683 sql/sqlstats/persistedsqlstats/provider.go:132 ⋮ [n2] 62 starting sql-stats-worker with initial delay: 8m51.405479149s
I221026 10:38:06.236031 681 sql/temporary_schema.go:499 ⋮ [n2] 63 completed temporary object cleanup job
I221026 10:38:06.236210 681 sql/temporary_schema.go:638 ⋮ [n2] 64 temporary object cleaner next scheduled to run at 2022-10-26 11:08:06.235973225 +0000 UTC m=+1804.971930810
I221026 10:38:06.236634 738 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n2] 65 settings-watcher: established range feed cache
E221026 10:38:06.292864 353 util/log/logcrash/crash_reporting.go:359 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 66 Queued as error ‹bf6d12d9819c458e9afda14d6d73333f›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 ‹[core]›‹[Channel #30 SubChannel #31] grpc: addrConn.createTransport failed to connect to {›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 +‹ "Attributes": null,›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 +‹ "BalancerAttributes": null,›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 +‹ "Type": 0,›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 +‹ "Metadata": null›
W221026 10:38:06.948180 757 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 67 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
I221026 10:38:07.842157 353 1@kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 68 the server is terminating due to a fatal error (see the DEV channel for details)
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ???: raft closed timestamp regression in cmd: "5'\xe6o\xddR\x1ba" (term: 24, index: 14613676); batch state: 1666765659.799078319,0, command: 1666765659.795902192,0, lease: repl=(n2,s2):3 seq=16 start=1666751056.620535333,0 epo=10 pro=1666765659.953943479,3719, req: <unknown; not leaseholder>, applying at LAI: 6552724.
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 +(1) assertion failure
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 +Wraps: (2) attached stack trace
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + -- stack trace:
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(replicaAppBatch).assertNoCmdClosedTimestampRegression
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_application_state_machine.go:1169
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(replicaAppBatch).Stage
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_application_state_machine.go:511
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.mapCmdIter
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply/cmd.go:184
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.(Task).applyOneBatch
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply/task.go:279
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.(Task).ApplyCommittedEntries
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply/task.go:246
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(Replica).handleRaftReadyRaftMuLocked
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:1038
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(Replica).handleRaftReady
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:657
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(Store).processReady
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:641
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(raftScheduler).worker
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:308
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/util/stop.(Stopper).RunAsyncTaskEx.func2
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:489
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | runtime.goexit
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | GOROOT/src/runtime/asm_amd64.s:1594
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 +Wraps: (3) raft closed timestamp regression in cmd: "5'\xe6o\xddR\x1ba" (term: 24, index: 14613676); batch state: 1666765659.799078319,0, command: 1666765659.795902192,0, lease: repl=(n2,s2):3 seq=16 start=1666751056.620535333,0 epo=10 pro=1666765659.953943479,3719, req: <unknown; not leaseholder>, applying at LAI: 6552724.
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | Closed timestamp was set by req: <unknown; not leaseholder or not lease request> under lease: ; applied at LAI: 0. Batch idx: 0.
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | This assertion will fire again on restart; to ignore run with env var COCKROACH_RAFT_CLOSEDTS_ASSERTIONS_ENABLED=false
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | Raft log tail:
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613677 (0x0169ab757266746c0000000000defcad00): Term:24 Index:14613677 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552725 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613676 (0x0169ab757266746c0000000000defcac00): Term:24 Index:14613676 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552724 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613675 (0x0169ab757266746c0000000000defcab00): Term:24 Index:14613675 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552723 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613674 (0x0169ab757266746c0000000000defcaa00): Term:24 Index:14613674 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552722 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613673 (0x0169ab757266746c0000000000defca900): Term:24 Index:14613673 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552721 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613672 (0x0169ab757266746c0000000000defca800): Term:24 Index:14613672 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552720 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613671 (0x0169ab757266746c0000000000defca700): Term:24 Index:14613671 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552719 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613670 (0x0169ab757266746c0000000000defca600): Term:24 Index:14613670 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552718 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613669 (0x0169ab757266746c0000000000defca500): Term:24 Index:14613669 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552717 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613668 (0x0169ab757266746c0000000000defca400): Term:24 Index:14613668 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552716 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613667 (0x0169ab757266746c0000000000defca300): Term:24 Index:14613667 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552715 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613666 (0x0169ab757266746c0000000000defca200): Term:24 Index:14613666 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552714 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613665 (0x0169ab757266746c0000000000defca100): Term:24 Index:14613665 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552713 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613664 (0x0169ab757266746c0000000000defca000): Term:24 Index:14613664 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552712 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613663 (0x0169ab757266746c0000000000defc9f00): Term:24 Index:14613663 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552711 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613662 (0x0169ab757266746c0000000000defc9e00): Term:24 Index:14613662 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552710 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613661 (0x0169ab757266746c0000000000defc9d00): Term:24 Index:14613661 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552709 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613660 (0x0169ab757266746c0000000000defc9c00): Term:24 Index:14613660 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552708 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613659 (0x0169ab757266746c0000000000defc9b00): Term:24 Index:14613659 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552707 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613658 (0x0169ab757266746c0000000000defc9a00): Term:24 Index:14613658 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552706 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613657 (0x0169ab757266746c0000000000defc9900): Term:24 Index:14613657 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552705 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613656 (0x0169ab757266746c0000000000defc9800): Term:24 Index:14613656 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552704 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613655 (0x0169ab757266746c0000000000defc9700): Term:24 Index:14613655 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552703 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613654 (0x0169ab757266746c0000000000defc9600): Term:24 Index:14613654 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552702 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613653 (0x0169ab757266746c0000000000defc9500): Term:24 Index:14613653 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552701 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613652 (0x0169ab757266746c0000000000defc9400): Term:24 Index:14613652 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552700 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613651 (0x0169ab757266746c0000000000defc9300): Term:24 Index:14613651 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552699 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613650 (0x0169ab757266746c0000000000defc9200): Term:24 Index:14613650 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552698 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613649 (0x0169ab757266746c0000000000defc9100): Term:24 Index:14613649 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552697 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613648 (0x0169ab757266746c0000000000defc9000): Term:24 Index:14613648 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552696 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613647 (0x0169ab757266746c0000000000defc8f00): Term:24 Index:14613647 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552695 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613646 (0x0169ab757266746c0000000000defc8e00): Term:24 Index:14613646 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552694 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613645 (0x0169ab757266746c0000000000defc8d00): Term:24 Index:14613645 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552693 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613644 (0x0169ab757266746c0000000000defc8c00): Term:24 Index:14613644 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552692 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613643 (0x0169ab757266746c0000000000defc8b00): Term:24 Index:14613643 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552691 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613642 (0x0169ab757266746c0000000000defc8a00): Term:24 Index:14613642 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552690 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613641 (0x0169ab757266746c0000000000defc8900): Term:24 Index:14613641 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552689 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613640 (0x0169ab757266746c0000000000defc8800): Term:24 Index:14613640 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552688 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613639 (0x0169ab757266746c0000000000defc8700): Term:24 Index:14613639 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552687 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613638 (0x0169ab757266746c0000000000defc8600): Term:24 Index:14613638 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552686 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613637 (0x0169ab757266746c0000000000defc8500): Term:24 Index:14613637 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552685 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613636 (0x0169ab757266746c0000000000defc8400): Term:24 Index:14613636 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552684 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613635 (0x0169ab757266746c0000000000defc8300): Term:24 Index:14613635 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552683 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613634 (0x0169ab757266746c0000000000defc8200): Term:24 Index:14613634 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552682 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613633 (0x0169ab757266746c0000000000defc8100): Term:24 Index:14613633 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552681 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613632 (0x0169ab757266746c0000000000defc8000): Term:24 Index:14613632 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552680 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613631 (0x0169ab757266746c0000000000defc7f00): Term:24 Index:14613631 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552679 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613630 (0x0169ab757266746c0000000000defc7e00): Term:24 Index:14613630 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552678 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613629 (0x0169ab757266746c0000000000defc7d00): Term:24 Index:14613629 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552677 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613628 (0x0169ab757266746c0000000000defc7c00): Term:24 Index:14613628 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552676 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613627 (0x0169ab757266746c0000000000defc7b00): Term:24 Index:14613627 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552675 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613626 (0x0169ab757266746c0000000000defc7a00): Term:24 Index:14613626 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552674 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613625 (0x0169ab757266746c0000000000defc7900): Term:24 Index:14613625 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552673 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613624 (0x0169ab757266746c0000000000defc7800): Term:24 Index:14613624 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552672 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613623 (0x0169ab757266746c0000000000defc7700): Term:24 Index:14613623 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552671 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613622 (0x0169ab757266746c0000000000defc7600): Term:24 Index:14613622 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552670 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613621 (0x0169ab757266746c0000000000defc7500): Term:24 Index:14613621 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552669 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613620 (0x0169ab757266746c0000000000defc7400): Term:24 Index:14613620 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552668 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613619 (0x0169ab757266746c0000000000defc7300): Term:24 Index:14613619 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552667 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613618 (0x0169ab757266746c0000000000defc7200): Term:24 Index:14613618 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552666 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613617 (0x0169ab757266746c0000000000defc7100): Term:24 Index:14613617 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552665 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613616 (0x0169ab757266746c0000000000defc7000): Term:24 Index:14613616 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552664 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613615 (0x0169ab757266746c0000000000defc6f00): Term:24 Index:14613615 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552663 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613614 (0x0169ab757266746c0000000000defc6e00): Term:24 Index:14613614 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552662 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613613 (0x0169ab757266746c0000000000defc6d00): Term:24 Index:14613613 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552661 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613612 (0x0169ab757266746c0000000000defc6c00): Term:24 Index:14613612 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552660 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613611 (0x0169ab757266746c0000000000defc6b00): Term:24 Index:14613611 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552659 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613610 (0x0169ab757266746c0000000000defc6a00): Term:24 Index:14613610 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552658 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613609 (0x0169ab757266746c0000000000defc6900): Term:24 Index:14613609 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552657 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613608 (0x0169ab757266746c0000000000defc6800): Term:24 Index:14613608 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552656 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613607 (0x0169ab757266746c0000000000defc6700): Term:24 Index:14613607 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552655 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613606 (0x0169ab757266746c0000000000defc6600): Term:24 Index:14613606 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552654 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613605 (0x0169ab757266746c0000000000defc6500): Term:24 Index:14613605 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552653 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613604 (0x0169ab757266746c0000000000defc6400): Term:24 Index:14613604 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552652 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613603 (0x0169ab757266746c0000000000defc6300): Term:24 Index:14613603 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552651 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613602 (0x0169ab757266746c0000000000defc6200): Term:24 Index:14613602 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552650 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613601 (0x0169ab757266746c0000000000defc6100): Term:24 Index:14613601 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552649 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613600 (0x0169ab757266746c0000000000defc6000): Term:24 Index:14613600 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552648 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613599 (0x0169ab757266746c0000000000defc5f00): Term:24 Index:14613599 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552647 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613598 (0x0169ab757266746c0000000000defc5e00): Term:24 Index:14613598 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552646 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613597 (0x0169ab757266746c0000000000defc5d00): Term:24 Index:14613597 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552645 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613596 (0x0169ab757266746c0000000000defc5c00): Term:24 Index:14613596 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552644 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613595 (0x0169ab757266746c0000000000defc5b00): Term:24 Index:14613595 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552643 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613594 (0x0169ab757266746c0000000000defc5a00): Term:24 Index:14613594 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552642 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613593 (0x0169ab757266746c0000000000defc5900): Term:24 Index:14613593 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552641 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613592 (0x0169ab757266746c0000000000defc5800): Term:24 Index:14613592 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552640 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613591 (0x0169ab757266746c0000000000defc5700): Term:24 Index:14613591 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552639 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613590 (0x0169ab757266746c0000000000defc5600): Term:24 Index:14613590 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552638 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613589 (0x0169ab757266746c0000000000defc5500): Term:24 Index:14613589 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552637 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613588 (0x0169ab757266746c0000000000defc5400): Term:24 Index:14613588 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552636 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613587 (0x0169ab757266746c0000000000defc5300): Term:24 Index:14613587 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552635 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613586 (0x0169ab757266746c0000000000defc5200): Term:24 Index:14613586 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552634 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613585 (0x0169ab757266746c0000000000defc5100): Term:24 Index:14613585 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552633 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613584 (0x0169ab757266746c0000000000defc5000): Term:24 Index:14613584 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552632 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613583 (0x0169ab757266746c0000000000defc4f00): Term:24 Index:14613583 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552631 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613582 (0x0169ab757266746c0000000000defc4e00): Term:24 Index:14613582 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552630 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613581 (0x0169ab757266746c0000000000defc4d00): Term:24 Index:14613581 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552629 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613580 (0x0169ab757266746c0000000000defc4c00): Term:24 Index:14613580 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552628 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<wall_time:1666765659795902192 logical:2 > delta:<last_update_nanos:1666765662795902192 intent_age:3 gc_bytes_age:504 live_bytes:-169 live_count:-3 key_bytes:36 val_bytes:300 val_count:3 intent_bytes:36 intent_count:3 separated_intent_count:3 > > logical_op_log:<ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765659795902192 logical:2 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > ops:<write_intent:<txn_id:3bc40db3-5447-434b-8613-4379a892235c txn_key:"\257\211\0227i8\004\324\223@\030\257\211M\227=\323Z\033\000\001\210" txn_min_timestamp:<wall_time:1666751400633163757 > timestamp:<wall_time:1666765662795902192 logical:1 > > > > ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 033bc40db35447434b86134379a892235c (0x017a6b12af891237693804d4934018af894d973dd35a1b00ff0188000100033bc40db35447434b86134379a892235c12): 1666765659.795902192,2 txn={id=3bc40db3 key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.01518209 epo=0 ts=1666765659.795902192,2 min=1666751400.633163757,0 seq=1} ts=1666765659.795902192,2 del=true klen=12 vlen=0 mergeTs= txnDidNotUpdateMeta=true›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 1666765659.795902192,2 /Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 (0xaf891237693804d4934018af894d973dd35a1b0001880017218a8963f44ef0000000020d): ""›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: /Local/Lock/Intent/Table/39/1/"{\xcd...›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613579 (0x0169ab757266746c0000000000defc4b00): Term:24 Index:14613579 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552627 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<state:<truncated_state:<index:8061240 term:24 > raft_closed_timestamp:<> > write_timestamp:<> delta:<> raft_log_delta:-73073 raft_expected_first_index:8060923 > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + |
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹0,0 /Local/RangeID/35/u/RaftLog/logIndex:14613578 (0x0169ab757266746c0000000000defc4a00): Term:24 Index:14613578 Type:EntryNormal by lease #16
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹proposer_lease_sequence:16 max_lease_index:6552626 closed_timestamp:<wall_time:1666765659795902192 > replicated_eval_result:<write_timestamp:<> delta:<sys_bytes:157 sys_count:1 > > logical_op_log:<> ›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹write batch:›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 + | ‹Put: 0,0 /Local/Range/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0/Transaction/"d638428d-c92a-49ff-b577-4f25f1ef0df8" (0x016b12af891237693804d4934018af894d973dd35a1b00ff0188000174786e2dd638428dc92a49ffb5774f25f1ef0df800): meta={id=d638428d key=/Table/39/1/"7i8\x04ԓ@\x18\xaf\x89M\x97=\xd3Z\x1b"/0 pri=0.00695377 epo=0 ts=1666751400.701612232,0 min=1666751400.701612232,0 seq=0} lock=true stat=PENDING rts=0,0 wto=false gul=0,0›
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 +Error types: (1) assert.withAssertionFailure (2) withstack.withStack (3) errutil.leafError
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !goroutine 353 [running]:
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/util/log.getStacks(0x0)
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/util/log/get_stacks.go:25 +0x89
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/util/log.(loggerT).outputLogEntry(0xc000ae1ca0, {{{0xc003bf2030, 0x24}, {0x527639a, 0x1}, {0x0, 0x0}, {0x0, 0x0}}, 0x172198346150c92f, ...})
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/util/log/clog.go:260 +0xb8
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/util/log.logfDepthInternal({0x6079968, 0xc00147f530}, 0x3, 0x4, 0x0, 0x0?, {0x51d1c52, 0x7}, {0xc006da3980, 0x2, ...})
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/util/log/channels.go:106 +0x645
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/util/log.logfDepth(...)
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/util/log/channels.go:39
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/util/log.FatalfDepth(...)
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/bazel-out/k8-opt/bin/pkg/util/log/log_channels_generated.go:920
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/kv/kvserver.maybeFatalOnRaftReadyErr({0x6079968, 0xc00147f530}, {0x51c7927, 0x3}, {0x603f700, 0xc007578da0})
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:1155 +0x19b
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/kv/kvserver.(Store).processReady(0xc00173aa80, 0xc001783140?)
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:642 +0x154
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/kv/kvserver.(raftScheduler).worker(0xc003560870, {0x6079968, 0xc0016e1ec0})
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:308 +0x25d
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !github.com/cockroachdb/cockroach/pkg/util/stop.(Stopper).RunAsyncTaskEx.func2()
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:489 +0x146
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !created by github.com/cockroachdb/cockroach/pkg/util/stop.(Stopper).RunAsyncTaskEx
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:480 +0x43b
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !For more context, check log files in: /th/data/roach3/logs
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
***********************************************************
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !This node experienced a fatal error (printed above), and as a result the
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !process is terminating.
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !Fatal errors can occur due to faulty hardware (disks, memory, clocks) or a
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !problem in CockroachDB. With your help, the support team at Cockroach Labs
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !will try to determine the root cause, recommend next steps, and we can
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !improve CockroachDB based on your report.
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !Please submit a crash report by following the instructions here:
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! https://github.com/cockroachdb/cockroach/issues/new/choose
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !If you would rather not post publicly, please contact us directly at:
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 ! support@cockroachlabs.com
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !
F221026 10:38:07.842199 353 kv/kvserver/store_raft.go:642 ⋮ [n2,s2,r35/3:‹/Table/{39-40}›,raft] 69 !The Cockroach Labs team appreciates your feedback.
root@dev-build:/th/data/roach3/logs#

@jiamo
Copy link

jiamo commented Oct 26, 2022

Another node will have different error:

W221026 10:52:14.704369 421 kv/kvserver/replica_gossip.go:153 ⋮ [n3,s3,r2/3:‹/System/NodeLiveness{-Max}›] 6828 could not acquire lease for range gossip: replica unavailable: (n3,s3):3 unable to serve request to r2:‹/System/NodeLiveness{-Max}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780685.099594285,0 (2022-10-26 10:38:05); raft status: {"id":"3","term":180,"vote":"3","commit":5893180,"lead":"3","raftState":"StateLeader","applied":5893180,"progress":{"1":{"match":5893167,"next":5893168,"state":"StateProbe"},"2":{"match":5893180,"next":5893181,"state":"StateProbe"},"3":{"match":5895548,"next":5895549,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 ‹[core]›‹[Channel #2231 SubChannel #2232] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 +‹ "Addr": "192.168.160.7:26259",›
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 +‹ "ServerName": "192.168.160.7:26259",›
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 +‹ "Attributes": null,›
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 +‹ "BalancerAttributes": null,›
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 +‹ "Type": 0,›
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 +‹ "Metadata": null›
W221026 10:52:14.830949 71724 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6829 +‹}. Err: connection error: desc = "transport: Error while dialing cannot reuse client connection"›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 ‹[core]›‹[Channel #2239 SubChannel #2240] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 +‹ "Addr": "192.168.160.7:26259",›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 +‹ "ServerName": "192.168.160.7:26259",›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 +‹ "Attributes": null,›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 +‹ "BalancerAttributes": null,›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 +‹ "Type": 0,›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 +‹ "Metadata": null›
W221026 10:52:14.930870 71989 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6830 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26259: connect: connection refused"›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 ‹[core]›‹[Channel #2241 SubChannel #2242] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 +‹ "Addr": "192.168.160.7:26259",›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 +‹ "ServerName": "192.168.160.7:26259",›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 +‹ "Attributes": null,›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 +‹ "BalancerAttributes": null,›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 +‹ "Type": 0,›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 +‹ "Metadata": null›
W221026 10:52:15.130709 72034 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6831 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26259: connect: connection refused"›
W221026 10:52:15.411967 420 kv/kvserver/replica_gossip.go:153 ⋮ [n3,s3,r1/3:‹/{Min-System/NodeL…}›] 6832 could not acquire lease for range gossip: replica unavailable: (n3,s3):3 unable to serve request to r1:‹/{Min-System/NodeLiveness}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780684.898974723,0 (2022-10-26 10:38:04); raft status: {"id":"3","term":184,"vote":"3","commit":1472617,"lead":"3","raftState":"StateLeader","applied":1472617,"progress":{"1":{"match":1472615,"next":1472616,"state":"StateProbe"},"2":{"match":1472617,"next":1472618,"state":"StateProbe"},"3":{"match":1474731,"next":1474732,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
I221026 10:52:15.455419 66481 kv/kvserver/replica_circuit_breaker.go:149 ⋮ [n3,s3,r2/3:‹/System/NodeLiveness{-Max}›] 6833 breaker: tripped with error: replica unavailable: (n3,s3):3 unable to serve request to r2:‹/System/NodeLiveness{-Max}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780685.099594285,0 (2022-10-26 10:38:05); raft status: {"id":"3","term":180,"vote":"3","commit":5893180,"lead":"3","raftState":"StateLeader","applied":5893180,"progress":{"1":{"match":5893167,"next":5893168,"state":"StateProbe"},"2":{"match":5893180,"next":5893181,"state":"StateProbe"},"3":{"match":5895868,"next":5895869,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
E221026 10:52:15.663756 72043 kv/kvserver/queue.go:1127 ⋮ [n3,replicaGC,s3,r10/2:‹/Table/1{4-5}›] 6834 replica unavailable: (n3,s3):3 unable to serve request to r1:‹/{Min-System/NodeLiveness}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780684.898974723,0 (2022-10-26 10:38:04); raft status: {"id":"3","term":184,"vote":"3","commit":1472617,"lead":"3","raftState":"StateLeader","applied":1472617,"progress":{"1":{"match":1472615,"next":1472616,"state":"StateProbe"},"2":{"match":1472617,"next":1472618,"state":"StateProbe"},"3":{"match":1474731,"next":1474732,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
W221026 10:52:15.673609 421 kv/kvserver/replica_gossip.go:153 ⋮ [n3,s3,r2/3:‹/System/NodeLiveness{-Max}›] 6835 could not acquire lease for range gossip: replica unavailable: (n3,s3):3 unable to serve request to r2:‹/System/NodeLiveness{-Max}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780685.099594285,0 (2022-10-26 10:38:05); raft status: {"id":"3","term":180,"vote":"3","commit":5893180,"lead":"3","raftState":"StateLeader","applied":5893180,"progress":{"1":{"match":5893167,"next":5893168,"state":"StateProbe"},"2":{"match":5893180,"next":5893181,"state":"StateProbe"},"3":{"match":5895868,"next":5895869,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 ‹[core]›‹[Channel #2233 SubChannel #2234] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 +‹ "Attributes": null,›
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 +‹ "BalancerAttributes": null,›
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 +‹ "Type": 0,›
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 +‹ "Metadata": null›
W221026 10:52:16.046527 72100 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6836 +‹}. Err: connection error: desc = "transport: Error while dialing cannot reuse client connection"›
W221026 10:52:16.536367 420 kv/kvserver/replica_gossip.go:153 ⋮ [n3,s3,r1/3:‹/{Min-System/NodeL…}›] 6837 could not acquire lease for range gossip: replica unavailable: (n3,s3):3 unable to serve request to r1:‹/{Min-System/NodeLiveness}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780684.898974723,0 (2022-10-26 10:38:04); raft status: {"id":"3","term":184,"vote":"3","commit":1472617,"lead":"3","raftState":"StateLeader","applied":1472617,"progress":{"1":{"match":1472615,"next":1472616,"state":"StateProbe"},"2":{"match":1472617,"next":1472618,"state":"StateProbe"},"3":{"match":1474731,"next":1474732,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
E221026 10:52:16.565790 66818 kv/kvserver/queue.go:1127 ⋮ [n3,raftlog,s3,r186/3:‹/System/tsd/cr.node.{ad…-ch…}›] 6838 ‹operation "raftlog queue process replica 186" timed out after 1m0s (given timeout 1m0s)›: aborted in DistSender: context deadline exceeded
E221026 10:52:16.664130 71705 kv/kvserver/queue.go:1127 ⋮ [n3,replicaGC,s3,r55/2:‹/Table/11{8-9}›] 6839 replica unavailable: (n3,s3):3 unable to serve request to r1:‹/{Min-System/NodeLiveness}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780684.898974723,0 (2022-10-26 10:38:04); raft status: {"id":"3","term":184,"vote":"3","commit":1472617,"lead":"3","raftState":"StateLeader","applied":1472617,"progress":{"1":{"match":1472615,"next":1472616,"state":"StateProbe"},"2":{"match":1472617,"next":1472618,"state":"StateProbe"},"3":{"match":1474731,"next":1474732,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
W221026 10:52:16.677366 421 kv/kvserver/replica_gossip.go:153 ⋮ [n3,s3,r2/3:‹/System/NodeLiveness{-Max}›] 6840 could not acquire lease for range gossip: replica unavailable: (n3,s3):3 unable to serve request to r2:‹/System/NodeLiveness{-Max}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=4]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780685.099594285,0 (2022-10-26 10:38:05); raft status: {"id":"3","term":180,"vote":"3","commit":5893180,"lead":"3","raftState":"StateLeader","applied":5893180,"progress":{"1":{"match":5893167,"next":5893168,"state":"StateProbe"},"2":{"match":5893180,"next":5893181,"state":"StateProbe"},"3":{"match":5895868,"next":5895869,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
E221026 10:52:16.757333 1406 jobs/registry.go:698 ⋮ [n3] 6841 error getting live session: ‹operation "sqlliveness create session" timed out after 25.001s (given timeout 25s)›: could not insert session ab5f5828cf4b46fbb325fddfd955a6df: aborted during range descriptor lookup: context deadline exceeded
W221026 10:52:16.784815 454 kv/kvserver/liveness/liveness.go:885 ⋮ [n3,liveness-hb] 6842 slow heartbeat took 4.501017033s; err=aborted in DistSender: context deadline exceeded
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 failed node liveness heartbeat: ‹operation "node liveness heartbeat" timed out after 4.501s (given timeout 4.5s)›: aborted in DistSender: context deadline exceeded
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +(1) ‹operation "node liveness heartbeat" timed out after 4.501s (given timeout 4.5s)›
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +Wraps: (2)
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | (opaque error wrapper)
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | type name: github.com/cockroachdb/errors/withstack/*withstack.withStack
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | reportable 0:
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + |
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).deduceRetryEarlyExitError
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1747
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*RangeIterator).Seek
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/range_iter.go:223
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1212
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:842
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnLockGatekeeper).SendLocked
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_lock_gatekeeper.go:82
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnMetricRecorder).SendLocked
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_metric_recorder.go:46
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnCommitter).SendLocked
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_committer.go:202
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).sendLockedWithRefreshAttempts
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:225
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).SendLocked
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:153
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnPipeliner).SendLocked
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_pipeliner.go:290
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSeqNumAllocator).SendLocked
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_seq_num_allocator.go:104
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).SendLocked
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:245
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*TxnCoordSender).Send
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_coord_sender.go:526
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/db.go:1011
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Send
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/txn.go:1092
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/db.go:855
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Run
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/txn.go:673
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).updateLivenessAttempt.func1
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness/liveness.go:1376
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.runTxn.func1
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/db.go:975
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.(*Txn).exec
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/txn.go:961
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.runTxn
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/db.go:974
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.(*DB).TxnWithAdmissionControl
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/db.go:937
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv.(*DB).Txn
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/db.go:916
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).updateLivenessAttempt
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness/liveness.go:1349
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).updateLiveness
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness/liveness.go:1304
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).heartbeatInternal
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness/liveness.go:960
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).Start.func1.1
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness/liveness.go:775
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/util/contextutil.RunWithTimeout
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/util/contextutil/context.go:91
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).Start.func1
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness/liveness.go:758
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:489
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | runtime.goexit
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + | GOROOT/src/runtime/asm_amd64.s:1594
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +Wraps: (3) aborted in DistSender
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +Wraps: (4) context deadline exceeded
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +Error types: (1) *contextutil.TimeoutError (2) *errbase.opaqueWrapper (3) *errutil.withPrefix (4) context.deadlineExceededError
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +An inability to maintain liveness will prevent a node from participating in a
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +cluster. If this problem persists, it may be a sign of resource starvation or
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +of network connectivity problems. For help troubleshooting, visit:
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 +
W221026 10:52:16.784861 454 kv/kvserver/liveness/liveness.go:787 ⋮ [n3,liveness-hb] 6843 + https://www.cockroachlabs.com/docs/stable/cluster-setup-troubleshooting.html#node-liveness-issues
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 ‹[core]›‹[Channel #2235 SubChannel #2236] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 +‹ "Attributes": null,›
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 +‹ "BalancerAttributes": null,›
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 +‹ "Type": 0,›
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 +‹ "Metadata": null›
W221026 10:52:16.931603 72052 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6844 +‹}. Err: connection error: desc = "transport: Error while dialing cannot reuse client connection"›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 ‹[core]›‹[Channel #2243 SubChannel #2244] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 +‹ "Attributes": null,›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 +‹ "BalancerAttributes": null,›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 +‹ "Type": 0,›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 +‹ "Metadata": null›
W221026 10:52:17.047784 72180 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6845 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 ‹[core]›‹[Channel #2237 SubChannel #2238] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 +‹ "Attributes": null,›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 +‹ "BalancerAttributes": null,›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 +‹ "Type": 0,›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 +‹ "Metadata": null›
W221026 10:52:17.231019 72199 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6846 +‹}. Err: connection error: desc = "transport: Error while dialing cannot reuse client connection"›
E221026 10:52:17.239178 66887 kv/kvserver/queue.go:1127 ⋮ [n3,raftlog,s3,r2/3:‹/System/NodeLiveness{-Max}›] 6847 ‹operation "raftlog queue process replica 2" timed out after 1m0.001s (given timeout 1m0s)›: aborted in DistSender: context deadline exceeded
E221026 10:52:17.239587 72202 kv/kvserver/queue.go:1127 ⋮ [n3,raftlog,s3,r86/3:‹/System/tsd/cr.store.{fo…-ra…}›] 6848 replica unavailable: (n3,s3):3 unable to serve request to r86:‹/System/tsd/cr.store.{follower_reads.success_count/10s/2022-09-13T09:00:00Z/2-raft.process.commandcommit.latency-p50/10s/2022-09-19T07:00:00Z/3}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=10]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780691.518301224,0 (2022-10-26 10:38:11); raft status: {"id":"3","term":56,"vote":"3","commit":1783200,"lead":"3","raftState":"StateLeader","applied":1783200,"progress":{"1":{"match":1783200,"next":1783201,"state":"StateProbe"},"2":{"match":1783200,"next":1783201,"state":"StateProbe"},"3":{"match":1785111,"next":1785112,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
E221026 10:52:17.239951 72203 kv/kvserver/queue.go:1127 ⋮ [n3,raftlog,s3,r121/3:‹/System{/tsd/cr.s…-tse}›] 6849 replica unavailable: (n3,s3):3 unable to serve request to r121:‹/System{/tsd/cr.store.ranges.unavailable/10s/2022-09-15T15:00:00Z/3-tse}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=9]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780691.518301224,0 (2022-10-26 10:38:11); raft status: {"id":"3","term":75,"vote":"3","commit":1449707,"lead":"3","raftState":"StateLeader","applied":1449707,"progress":{"1":{"match":1449707,"next":1449708,"state":"StateProbe"},"2":{"match":1449707,"next":1449708,"state":"StateProbe"},"3":{"match":1451609,"next":1451610,"state":"StateReplicate"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
E221026 10:52:17.240281 72204 kv/kvserver/queue.go:1127 ⋮ [n3,raftlog,s3,r101/3:‹/System/tsd/cr.node.{di…-jo…}›] 6850 replica unavailable: (n3,s3):3 unable to serve request to r101:‹/System/tsd/cr.node.{distsender.rpc.err.mintimestampboundunsatisfiableerrtype/10s/2022-09-16T18:00:00Z/1-jobs.auto_create_stats.resume_retry_error/10s/2022-09-13T20:00:00Z/1}› [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=12]: lost quorum (down: (n1,s1):1,(n2,s2):2); closed timestamp: 1666780691.518301224,0 (2022-10-26 10:38:11); raft status: {"id":"3","term":63,"vote":"3","commit":1461662,"lead":"3","raftState":"StateLeader","applied":1461662,"progress":{"2":{"match":1461662,"next":1461663,"state":"StateProbe"},"3":{"match":1463573,"next":1463574,"state":"StateReplicate"},"1":{"match":1461662,"next":1461663,"state":"StateProbe"}},"leadtransferee":"0"}: ‹operation "probe" timed out after 1m0.001s (given timeout 1m0s)›: result is ambiguous: after 60.00s of attempting command: context deadline exceeded
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 ‹[core]›‹[Channel #2245 SubChannel #2246] grpc: addrConn.createTransport failed to connect to {›
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 +‹ "Addr": "192.168.160.7:26257",›
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 +‹ "ServerName": "192.168.160.7:26257",›
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 +‹ "Attributes": null,›
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 +‹ "BalancerAttributes": null,›
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 +‹ "Type": 0,›
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 +‹ "Metadata": null›
W221026 10:52:17.330119 72214 google.golang.org/grpc/grpclog/component.go:41 ⋮ [-] 6851 +‹}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.160.7:26257: connect: connection refused"›

@yuzefovich
Copy link
Member

dup of #78419

@yuzefovich yuzefovich changed the title sentry: store_raft.go:642: log.Fatal: ???: raft closed timestamp regression in cmd: "5'\xe6o\xddR\x1ba" (term: 24, index: 14613676); batch state: 1666765659.799078319,0, command: 1666765659.795902192,0, lease... kvserver: v22.2.0-beta.4: raft closed timestamp regression in cmd Oct 29, 2022
@blathers-crl blathers-crl bot added the T-kv KV Team label Oct 29, 2022
@yuzefovich
Copy link
Member

yuzefovich commented Oct 29, 2022

Sorry, closed before seeing that a user posted here. @erikgrinaker seems like a dup of #70894, I wonder whether you could provide some help to @jiamo.

@yuzefovich yuzefovich reopened this Oct 29, 2022
@erikgrinaker
Copy link
Contributor

erikgrinaker commented Oct 31, 2022

Hi @jiamo, sorry to hear you hit this. As described in the error message, you can get past the error by setting this environment variable:

COCKROACH_RAFT_CLOSEDTS_ASSERTIONS_ENABLED=false

This can cause regressions (due to these faulty commands) in e.g. follower reads (serving stale reads) or changefeeds (emitting values below the checkpoint), but if you're not using those features then this shouldn't have any adverse effects.

We'll have a closer look at this to figure out what's going on.

@blathers-crl
Copy link

blathers-crl bot commented Oct 31, 2022

cc @cockroachdb/replication

@tbg
Copy link
Member

tbg commented Jul 18, 2023

Still open. See #70894 (comment) for the best summary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. T-kv KV Team
Projects
No open projects
Status: Incoming
Development

No branches or pull requests

6 participants