[Bug]: Fail to backup

[wayblink]

Current Behavior

Can't find segment through GetPersistentSegments we need.

SegmentIDs return by flush doesn't exist in GetPersistentSegments response.

This may caused by some segments were compacted during flush.

2023-02-21 09:05:45 | [2023/02/21 09:05:45.339 +00:00] [DEBUG] [core/backup_context.go:244] ["call refreshBackupMetaFunc"] [id=e59f38bd-b1c6-11ed-8864-a242590ec3a2]
-- | --
  |   | 2023-02-21 09:05:47 | [2023/02/21 09:05:47.000 +00:00] [INFO] [core/backup_context.go:438] ["flush segments"] [collectionName=book1] [newSealedSegmentIDs="[439607656426704980,439607656426704981]"] [flushedSegmentIDs="[439607656426704693,439607656426704935,439607656426704754,439607656426704934,439607656426704685,439607656426704817,439607656426704512,439607656426704634,439607656426704897,439607656426704467,439607656426704818,439607656426704633,439607656426704694,439607656426704755,439607656426704449,439607656426704650,439607656426704896,439607656426704561]"] [timeOfSeal=1676970345]
  |   | 2023-02-21 09:05:47 | [2023/02/21 09:05:47.005 +00:00] [INFO] [core/backup_context.go:450] ["GetPersistentSegmentInfo from milvus"] [collectionName=book1] [segmentNum=14]
  |   | 2023-02-21 09:05:47 | [2023/02/21 09:05:47.005 +00:00] [WARN] [core/backup_context.go:463] ["this may be new segments after flush, skip it"] [id=439607656426704852]
  |   | 2023-02-21 09:05:47 | [2023/02/21 09:05:47.005 +00:00] [WARN] [core/backup_context.go:463] ["this may be new segments after flush, skip it"] [id=439607656426704826]
  |   | 2023-02-21 09:05:47 | [2023/02/21 09:05:47.005 +00:00] [WARN] [core/backup_context.go:468] ["Segment return in Flush not exist in GetPersistentSegmentInfo. segment ids: [439607656426704693 439607656426704754 439607656426704633 439607656426704467 439607656426704561 439607656426704512 439607656426704449 439607656426704685]"]

2023-02-21 09:05:27	
[2023/02/21 09:05:27.524 +00:00] [INFO] [datacoord/meta.go:258] ["meta update: adding segment"] ["segment ID"=439607656426704693]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.525 +00:00] [INFO] [datacoord/meta.go:270] ["meta update: adding segment - complete"] ["segment ID"=439607656426704693]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.525 +00:00] [INFO] [datacoord/segment_manager.go:377] ["datacoord: estimateTotalRows: "] [CollectionID=439607656426504209] [SegmentID=439607656426704693] [Rows=986895] [Channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.525 +00:00] [INFO] [datacoord/meta.go:851] ["meta update: add allocation"] [segmentID=439607656426704693] [allocation="SegmentID: 439607656426704693, NumOfRows: 8, ExpireTime: 2023-02-21 09:05:29.499 +0000 UTC"]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.526 +00:00] [INFO] [datacoord/meta.go:875] ["meta update: add allocation - complete"] [segmentID=439607656426704693]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.526 +00:00] [INFO] [datacoord/services.go:188] ["success to assign segments"] [collectionID=439607656426504209] [assignments="[{\"SegmentID\":439607656426704693,\"NumOfRows\":8,\"ExpireTime\":439607710056185858}]"]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.672 +00:00] [INFO] [querynode/flow_graph_insert_node.go:147] ["Add growing segment"] [collectionID=439607656426504209] [segmentID=439607656426704693] [startPosition=439607709531897857]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.673 +00:00] [INFO] [querynode/segment.go:186] ["create segment"] [collectionID=439607656426504209] [partitionID=439607656426504210] [segmentID=439607656426704693] [segmentType=Growing]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.673 +00:00] [INFO] [querynode/partition.go:74] ["add a segment to replica"] [collectionID=439607656426504209] [partitionID=439607656426504210] [segmentID=439607656426704693] [segmentType=Growing]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.673 +00:00] [INFO] [querynode/meta_replica.go:614] ["new segment added to collection replica"] ["query node ID"=18] ["collection ID"=439607656426504209] ["partition ID"=439607656426504210] ["segment ID"=439607656426704693] ["segment type"=Growing] ["row count"=0] ["segment indexed fields"=0]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.677 +00:00] [INFO] [datanode/channel_meta.go:188] ["adding segment"] [type=New] [segmentID=439607656426704693] [collectionID=439607656426504209] [partitionID=439607656426504210] [channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0] [startPosition="channel_name:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" msgID:\"\\306\\000\\000\\000\\000\\000\\000\\000\" msgGroup:\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" timestamp:439607709492314113 "] [endPosition="channel_name:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" msgID:\"\\310\\000\\000\\000\\000\\000\\000\\000\" msgGroup:\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" timestamp:439607709545005057 "] [recoverTs=0] [importing=false]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.677 +00:00] [INFO] [datanode/channel_meta.go:285] ["begin to init pk bloom filter"] [segmentID=439607656426704693] ["stats bin logs"=0]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.677 +00:00] [WARN] [datanode/channel_meta.go:314] ["no stats files to load"] [segmentID=439607656426704693]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.677 +00:00] [INFO] [datanode/channel_meta.go:461] ["updating segment"] ["Segment ID"=439607656426704693] [numRows=8]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.678 +00:00] [INFO] [datanode/flow_graph_insert_buffer_node.go:287] ["segment buffer status"] [no.=0] [segmentID=439607656426704693] [channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0] [size=8] [limit=30841]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.682 +00:00] [INFO] [datacoord/server.go:625] ["Updating segment number of rows"] ["segment ID"=439607656426704693] ["old value"=0] ["new value"=8]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.685 +00:00] [INFO] [datacoord/meta.go:330] ["meta update: setting segment state"] ["segment ID"=439607656426704693] ["target state"=Sealed]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.686 +00:00] [INFO] [datacoord/meta.go:366] ["meta update: setting segment state - complete"] ["segment ID"=439607656426704693] ["target state"=Sealed]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.687 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704693,439607656426704694]"] [flushSegments="[439607656426704633,439607656426704449,439607656426704560,439607656426704511,439607656426704561,439607656426704326,439607656426704450,439607656426704634,439607656426704512,439607656426704416,439607656426704378,439607656426704507,439607656426704467]"] [timeOfSeal=1676970327]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.847 +00:00] [INFO] [proxy/impl.go:3995] ["received get flush state request"] [request="segmentIDs:439607656426704693 segmentIDs:439607656426704694 "]
2023-02-21 09:05:27	
[2023/02/21 09:05:27.847 +00:00] [INFO] [datacoord/services.go:1125] ["DataCoord receive GetFlushState request, Flushed is false"] [segmentIDs="[439607656426704693,439607656426704694]"] [len=2]
2023-02-21 09:05:28	
[2023/02/21 09:05:28.548 +00:00] [INFO] [proxy/impl.go:3995] ["received get flush state request"] [request="segmentIDs:439607656426704693 segmentIDs:439607656426704694 "]
2023-02-21 09:05:28	
[2023/02/21 09:05:28.548 +00:00] [INFO] [datacoord/services.go:1125] ["DataCoord receive GetFlushState request, Flushed is false"] [segmentIDs="[439607656426704693,439607656426704694]"] [len=2]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.111 +00:00] [INFO] [querynode/search.go:100] ["search growing/sealed segments without indexes"] [traceID=2ffbbda788f0b538] [segmentIDs="[439607656426704693,439607656426704511,439607656426704560,439607656426704633]"]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.206 +00:00] [INFO] [proxy/impl.go:3995] ["received get flush state request"] [request="segmentIDs:439607656426704693 segmentIDs:439607656426704694 "]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.207 +00:00] [INFO] [datacoord/services.go:1125] ["DataCoord receive GetFlushState request, Flushed is false"] [segmentIDs="[439607656426704693,439607656426704694]"] [len=2]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.881 +00:00] [INFO] [datacoord/server.go:601] ["start flushing segments"] ["segment IDs"="[439607656426704693]"]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.882 +00:00] [INFO] [datanode/data_node.go:606] ["receiving FlushSegments request"] ["collection ID"=439607656426504209] [segments="[439607656426704693]"]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.882 +00:00] [INFO] [datanode/data_node.go:649] ["flow graph flushSegment tasks triggered"] [flushed=true] ["collection ID"=439607656426504209] ["segments sending to flush channel"="[439607656426704693]"]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.882 +00:00] [INFO] [datanode/data_node.go:659] ["sending segments to flush channel"] ["newly sealed segment IDs"="[439607656426704693]"]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.885 +00:00] [INFO] [proxy/impl.go:3995] ["received get flush state request"] [request="segmentIDs:439607656426704693 segmentIDs:439607656426704694 "]
2023-02-21 09:05:29	
[2023/02/21 09:05:29.885 +00:00] [INFO] [datacoord/services.go:1125] ["DataCoord receive GetFlushState request, Flushed is false"] [segmentIDs="[439607656426704693,439607656426704694]"] [len=2]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.076 +00:00] [INFO] [datanode/flow_graph_insert_buffer_node.go:261] ["(Manual Sync) batch processing flush messages"] [batchSize=1] [flushedSegments="[439607656426704693]"] [staleSegments="[]"] [channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.076 +00:00] [INFO] [datanode/flow_graph_insert_buffer_node.go:451] ["insertBufferNode syncing BufferData"] [segmentID=439607656426704693] [flushed=true] [dropped=false] [auto=false] [position="channel_name:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" msgID:\"\\325\\000\\000\\000\\000\\000\\000\\000\" msgGroup:\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" timestamp:439607710174150657 "] [channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.078 +00:00] [INFO] [datanode/flush_manager.go:287] ["handling insert task"] ["segment ID"=439607656426704693] [flushed=true] [dropped=false] [position="channel_name:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" msgID:\"\\325\\000\\000\\000\\000\\000\\000\\000\" msgGroup:\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" timestamp:439607710174150657 "]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.078 +00:00] [INFO] [datanode/flush_manager.go:139] ["new flush task runner created and initialized"] ["segment ID"=439607656426704693] ["pos message ID"="\ufffd\u0000\u0000\u0000\u0000\u0000\u0000\u0000"]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.078 +00:00] [INFO] [datanode/flush_task.go:134] ["running flush insert task"] ["segment ID"=439607656426704693] [flushed=true] [dropped=false] [position="channel_name:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" msgID:\"\\325\\000\\000\\000\\000\\000\\000\\000\" msgGroup:\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" timestamp:439607710174150657 "] [PosTime=2023/02/21 09:05:29.949 +00:00]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.078 +00:00] [INFO] [datanode/channel_meta.go:353] ["roll pk stats"] ["segment id"=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.078 +00:00] [INFO] [datanode/flush_manager.go:314] ["handling delete task"] ["segment ID"=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.274 +00:00] [INFO] [datanode/flush_manager.go:789] [SaveBinlogPath] [SegmentID=439607656426704693] [CollectionID=439607656426504209] [startPos="[{\"start_position\":{\"channel_name\":\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"msgID\":\"xgAAAAAAAAA=\",\"msgGroup\":\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"timestamp\":439607709492314113},\"segmentID\":439607656426704693}]"] [checkPoints="[{\"segmentID\":439607656426704693,\"position\":{\"channel_name\":\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"msgID\":\"1QAAAAAAAAA=\",\"msgGroup\":\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"timestamp\":439607710174150657},\"num_of_rows\":8}]"] ["Length of Field2BinlogPaths"=5] ["Length of Field2Stats"=1] ["Length of Field2Deltalogs"=0] [vChannelName=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.274 +00:00] [INFO] [datacoord/services.go:400] ["receive SaveBinlogPaths request"] [nodeID=24] [collectionID=439607656426504209] [segmentID=439607656426704693] [isFlush=true] [isDropped=false] [startPositions="[{\"start_position\":{\"channel_name\":\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"msgID\":\"xgAAAAAAAAA=\",\"msgGroup\":\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"timestamp\":439607709492314113},\"segmentID\":439607656426704693}]"] [checkpoints="[{\"segmentID\":439607656426704693,\"position\":{\"channel_name\":\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"msgID\":\"1QAAAAAAAAA=\",\"msgGroup\":\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"timestamp\":439607710174150657},\"num_of_rows\":8}]"]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.274 +00:00] [INFO] [datacoord/meta.go:412] ["meta update: update flush segments info"] [segmentId=439607656426704693] [binlog=5] ["stats log"=1] ["delta logs"=1] [flushed=true] [dropped=false] ["check points"="[{\"segmentID\":439607656426704693,\"position\":{\"channel_name\":\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"msgID\":\"1QAAAAAAAAA=\",\"msgGroup\":\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"timestamp\":439607710174150657},\"num_of_rows\":8}]"] ["start position"="[{\"start_position\":{\"channel_name\":\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"msgID\":\"xgAAAAAAAAA=\",\"msgGroup\":\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\",\"timestamp\":439607709492314113},\"segmentID\":439607656426704693}]"] [importing=false]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.275 +00:00] [INFO] [datacoord/meta.go:548] ["meta update: update flush segments info - update flush segments info successfully"] ["segment ID"=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.275 +00:00] [INFO] [datacoord/services.go:454] ["flush segment with meta"] ["segment id"=439607656426704693] [meta="[{\"fieldID\":100,\"binlogs\":[{\"entries_num\":8,\"timestamp_from\":439607709531897857,\"timestamp_to\":439607709531897857,\"log_path\":\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/100/439607656426704710\",\"log_size\":64}]},{\"fieldID\":101,\"binlogs\":[{\"entries_num\":8,\"timestamp_from\":439607709531897857,\"timestamp_to\":439607709531897857,\"log_path\":\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/101/439607656426704711\",\"log_size\":64}]},{\"fieldID\":102,\"binlogs\":[{\"entries_num\":8,\"timestamp_from\":439607709531897857,\"timestamp_to\":439607709531897857,\"log_path\":\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/102/439607656426704712\",\"log_size\":4100}]},{\"binlogs\":[{\"entries_num\":8,\"timestamp_from\":439607709531897857,\"timestamp_to\":439607709531897857,\"log_path\":\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/0/439607656426704713\",\"log_size\":64}]},{\"fieldID\":1,\"binlogs\":[{\"entries_num\":8,\"timestamp_from\":439607709531897857,\"timestamp_to\":439607709531897857,\"log_path\":\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/1/439607656426704714\",\"log_size\":64}]}]"]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.276 +00:00] [INFO] [datacoord/server.go:784] ["flush successfully"] [segmentID=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.276 +00:00] [INFO] [datacoord/meta.go:330] ["meta update: setting segment state"] ["segment ID"=439607656426704693] ["target state"=Flushed]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.276 +00:00] [INFO] [datacoord/services.go:467] ["compaction triggered for segment"] ["segment ID"=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.276 +00:00] [INFO] [datanode/segment.go:163] ["evictHistoryInsertBuffer done"] [segmentID=439607656426704693] [ts=2023/02/21 09:05:29.949 +00:00] [channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.276 +00:00] [INFO] [datanode/segment.go:186] ["evictHistoryDeleteBuffer done"] [segmentID=439607656426704693] [ts=2023/02/21 09:05:29.949 +00:00] [channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.276 +00:00] [INFO] [indexcoord/index_coord.go:1289] ["watchFlushedSegmentLoop watch event"] [segID=439607656426704693] [isFake=false]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.276 +00:00] [INFO] [indexcoord/flush_segment_watcher.go:143] ["flushed segment task enqueue successfully"] [segID=439607656426704693] [isFake=false]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.277 +00:00] [INFO] [datacoord/meta.go:366] ["meta update: setting segment state - complete"] ["segment ID"=439607656426704693] ["target state"=Flushed]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.277 +00:00] [INFO] [datacoord/server.go:827] ["flush segment complete"] [id=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.277 +00:00] [INFO] [indexcoord/flush_segment_watcher.go:355] ["flushedSegmentWatcher prepare task success"] [segID=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.278 +00:00] [INFO] [indexcoord/index_coord.go:1195] ["create index for flushed segment"] [collID=439607656426504209] [segID=439607656426704693] [numRows=8]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.278 +00:00] [INFO] [indexcoord/index_coord.go:1228] ["IndexCoord createIndex Enqueue successfully"] [collID=439607656426504209] [segID=439607656426704693] [IndexBuildID=439607656426704736]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.278 +00:00] [INFO] [indexcoord/task.go:302] ["IndexCoord IndexAddTask PreExecute"] [segID=439607656426704693] [IndexBuildID=439607656426704736]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.278 +00:00] [INFO] [indexcoord/task.go:309] ["IndexCoord IndexAddTask Execute"] [segID=439607656426704693] [IndexBuildID=439607656426704736]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.278 +00:00] [INFO] [indexcoord/meta_table.go:301] ["IndexCoord metaTable AddIndex"] [collID=439607656426504209] [segID=439607656426704693] [indexID=439607656426704452] [buildID=439607656426704736]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.279 +00:00] [INFO] [indexcoord/meta_table.go:319] ["IndexCoord metaTable AddIndex success"] [collID=439607656426504209] [segID=439607656426704693] [indexID=439607656426704452] [buildID=439607656426704736]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.279 +00:00] [INFO] [indexcoord/task.go:320] ["IndexCoord IndexAddTask PostExecute"] [segID=439607656426704693] [IndexBuildID=439607656426704736]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.279 +00:00] [INFO] [indexcoord/flush_segment_watcher.go:318] ["flushedSegmentWatcher construct task success"] [segID=439607656426704693] [buildID=439607656426704736] ["already have index task"=false]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.279 +00:00] [INFO] [indexcoord/handoff.go:98] ["handoff task enqueue successfully"] [segID=439607656426704693] [isFake=false]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.456 +00:00] [INFO] [indexcoord/handoff.go:329] ["IndexCoord write handoff task success"] [collID=439607656426504209] [partID=439607656426504210] [segID=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.456 +00:00] [INFO] [indexcoord/handoff.go:264] ["write handoff success"] [segID=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.458 +00:00] [INFO] [indexcoord/handoff.go:271] ["mark segment as write handoff success, remove task"] [segID=439607656426704693]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.541 +00:00] [INFO] [proxy/impl.go:3995] ["received get flush state request"] [request="segmentIDs:439607656426704693 segmentIDs:439607656426704694 "]
2023-02-21 09:05:30	
[2023/02/21 09:05:30.541 +00:00] [INFO] [datacoord/services.go:1128] ["DataCoord receive GetFlushState request, Flushed is true"] [segmentIDs="[439607656426704693,439607656426704694]"] [len=2]
2023-02-21 09:05:31	
[2023/02/21 09:05:31.027 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704754,439607656426704755]"] [flushSegments="[439607656426704512,439607656426704634,439607656426704416,439607656426704378,439607656426704507,439607656426704467,439607656426704633,439607656426704694,439607656426704560,439607656426704449,439607656426704326,439607656426704511,439607656426704561,439607656426704450,439607656426704693]"] [timeOfSeal=1676970330]
2023-02-21 09:05:31	
[2023/02/21 09:05:31.343 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704754,439607656426704755]"] [flushSegments="[439607656426704693,439607656426704450,439607656426704634,439607656426704512,439607656426704416,439607656426704378,439607656426704507,439607656426704467,439607656426704633,439607656426704694,439607656426704449,439607656426704560,439607656426704511,439607656426704561,439607656426704326]"] [timeOfSeal=1676970331]
2023-02-21 09:05:32	
[2023/02/21 09:05:32.668 +00:00] [INFO] [querynode/search.go:100] ["search growing/sealed segments without indexes"] [traceID=5df523e185b1d4bf] [segmentIDs="[439607656426704560,439607656426704754,439607656426704633,439607656426704693,439607656426704511]"]
2023-02-21 09:05:32	
[2023/02/21 09:05:32.796 +00:00] [INFO] [indexcoord/index_coord.go:1294] ["the segment info has been deleted"] [key=in01-e0a52d06b33e103/meta/flushed-segment/439607656426504209/439607656426504210/439607656426704693]
2023-02-21 09:05:32	
[2023/02/21 09:05:32.796 +00:00] [INFO] [indexcoord/flush_segment_watcher.go:333] ["IndexCoord remove flushed segment key success"] [collID=439607656426504209] [partID=439607656426504210] [segID=439607656426704693]
2023-02-21 09:05:34	
[2023/02/21 09:05:34.291 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704817,439607656426704818]"] [flushSegments="[439607656426704560,439607656426704450,439607656426704512,439607656426704634,439607656426704416,439607656426704467,439607656426704755,439607656426704633,439607656426704694,439607656426704449,439607656426704326,439607656426704511,439607656426704561,439607656426704693,439607656426704754,439607656426704378,439607656426704507]"] [timeOfSeal=1676970334]
2023-02-21 09:05:35	
[2023/02/21 09:05:35.944 +00:00] [INFO] [datacoord/services.go:636] ["datacoord append channelInfo in GetRecoveryInfo"] [collectionID=439607656426504209] [partitionID=439607656426504210] [channelInfo="collectionID:439607656426504209 channelName:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" seek_position:<channel_name:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" msgID:\"\\007\\000\\000\\000\\000\\000\\000\\000\" msgGroup:\"in01-e0a52d06b33e103-dataNode-24-in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" timestamp:439607700527251457 > flushedSegmentIds:439607656426704693 flushedSegmentIds:439607656426704754 flushedSegmentIds:439607656426704685 flushedSegmentIds:439607656426704633 dropped_segmentIds:439607656426704327 dropped_segmentIds:439607656426704450 dropped_segmentIds:439607656426704379 dropped_segmentIds:439607656426704331 dropped_segmentIds:439607656426704415 dropped_segmentIds:439607656426704507 dropped_segmentIds:439607656426704286 dropped_segmentIds:439607656426704560 dropped_segmentIds:439607656426704226 dropped_segmentIds:439607656426704511 dropped_segmentIds:439607656426704255 "]
2023-02-21 09:05:35	
[2023/02/21 09:05:35.946 +00:00] [INFO] [meta/target_manager.go:134] ["finish to update next targets for collection"] [collectionID=439607656426504209] [segments="[439607656426704512,439607656426704633,439607656426704755,439607656426704650,439607656426704561,439607656426704694,439607656426704449,439607656426704634,439607656426704467,439607656426704693,439607656426704754,439607656426704685]"] [channels="[in01-e0a52d06b33e103-rootcoord-dml_1_439607656426504209v1,in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]"]
2023-02-21 09:05:36	
[2023/02/21 09:05:36.404 +00:00] [INFO] [querynode/search.go:100] ["search growing/sealed segments without indexes"] [traceID=1be1b35a340f33da] [segmentIDs="[439607656426704817,439607656426704693,439607656426704511,439607656426704560,439607656426704633,439607656426704754]"]
2023-02-21 09:05:36	
[2023/02/21 09:05:36.657 +00:00] [INFO] [datacoord/compaction_trigger.go:570] ["generate a plan for small candidates"] [plan="segmentBinlogs:<segmentID:439607656426704685 fieldBinlogs:<fieldID:1 binlogs:<entries_num:39 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704685/1/439607656426704699\" log_size:613 > > fieldBinlogs:<fieldID:100 binlogs:<entries_num:39 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704685/100/439607656426704695\" log_size:626 > > fieldBinlogs:<fieldID:101 binlogs:<entries_num:39 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704685/101/439607656426704696\" log_size:661 > > fieldBinlogs:<fieldID:102 binlogs:<entries_num:39 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704685/102/439607656426704697\" log_size:21371 > > fieldBinlogs:<binlogs:<entries_num:39 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704685/0/439607656426704698\" log_size:666 > > field2StatslogPaths:<fieldID:100 binlogs:<entries_num:39 log_path:\"e0a52d06b33e103/stats_log/439607656426504209/439607656426504210/439607656426704685/100/439607656426704700\" log_size:179 > > > segmentBinlogs:<segmentID:439607656426704633 fieldBinlogs:<binlogs:<entries_num:4 timestamp_from:439607708732358658 timestamp_to:439607708732358658 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704633/0/439607656426704661\" log_size:32 > > fieldBinlogs:<fieldID:1 binlogs:<entries_num:4 timestamp_from:439607708732358658 timestamp_to:439607708732358658 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704633/1/439607656426704662\" log_size:32 > > fieldBinlogs:<fieldID:100 binlogs:<entries_num:4 timestamp_from:439607708732358658 timestamp_to:439607708732358658 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704633/100/439607656426704658\" log_size:32 > > fieldBinlogs:<fieldID:101 binlogs:<entries_num:4 timestamp_from:439607708732358658 timestamp_to:439607708732358658 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704633/101/439607656426704659\" log_size:32 > > fieldBinlogs:<fieldID:102 binlogs:<entries_num:4 timestamp_from:439607708732358658 timestamp_to:439607708732358658 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704633/102/439607656426704660\" log_size:2052 > > field2StatslogPaths:<fieldID:100 binlogs:<log_path:\"e0a52d06b33e103/stats_log/439607656426504209/439607656426504210/439607656426704633/100/439607656426704663\" log_size:115 > > deltalogs:<> > segmentBinlogs:<segmentID:439607656426704754 fieldBinlogs:<fieldID:100 binlogs:<entries_num:5 timestamp_from:439607710409818113 timestamp_to:439607710409818113 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704754/100/439607656426704782\" log_size:40 > > fieldBinlogs:<fieldID:101 binlogs:<entries_num:5 timestamp_from:439607710409818113 timestamp_to:439607710409818113 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704754/101/439607656426704783\" log_size:40 > > fieldBinlogs:<fieldID:102 binlogs:<entries_num:5 timestamp_from:439607710409818113 timestamp_to:439607710409818113 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704754/102/439607656426704784\" log_size:2564 > > fieldBinlogs:<binlogs:<entries_num:5 timestamp_from:439607710409818113 timestamp_to:439607710409818113 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704754/0/439607656426704785\" log_size:40 > > fieldBinlogs:<fieldID:1 binlogs:<entries_num:5 timestamp_from:439607710409818113 timestamp_to:439607710409818113 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704754/1/439607656426704786\" log_size:40 > > field2StatslogPaths:<fieldID:100 binlogs:<log_path:\"e0a52d06b33e103/stats_log/439607656426504209/439607656426504210/439607656426704754/100/439607656426704787\" log_size:117 > > deltalogs:<> > segmentBinlogs:<segmentID:439607656426704693 fieldBinlogs:<fieldID:100 binlogs:<entries_num:8 timestamp_from:439607709531897857 timestamp_to:439607709531897857 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/100/439607656426704710\" log_size:64 > > fieldBinlogs:<fieldID:101 binlogs:<entries_num:8 timestamp_from:439607709531897857 timestamp_to:439607709531897857 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/101/439607656426704711\" log_size:64 > > fieldBinlogs:<fieldID:102 binlogs:<entries_num:8 timestamp_from:439607709531897857 timestamp_to:439607709531897857 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/102/439607656426704712\" log_size:4100 > > fieldBinlogs:<binlogs:<entries_num:8 timestamp_from:439607709531897857 timestamp_to:439607709531897857 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/0/439607656426704713\" log_size:64 > > fieldBinlogs:<fieldID:1 binlogs:<entries_num:8 timestamp_from:439607709531897857 timestamp_to:439607709531897857 log_path:\"e0a52d06b33e103/insert_log/439607656426504209/439607656426504210/439607656426704693/1/439607656426704714\" log_size:64 > > field2StatslogPaths:<fieldID:100 binlogs:<log_path:\"e0a52d06b33e103/stats_log/439607656426504209/439607656426504210/439607656426704693/100/439607656426704715\" log_size:125 > > deltalogs:<> > type:MixCompaction timetravel:439607711930253312 channel:\"in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0\" "] ["target segment row"=56] ["target segment size"=33733]
2023-02-21 09:05:36	
[2023/02/21 09:05:36.940 +00:00] [INFO] [task/scheduler.go:262] ["task added"] [task="[id=22] [type=1] [collectionID=439607656426504209] [replicaID=439607656689172481] [priority=1] [actionsCount=1] [actions={[type=1][node=18][streaming=false]}] [segmentID=439607656426704693]"]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.434 +00:00] [INFO] [task/executor.go:287] ["load segment task committed"] [taskID=22] [collectionID=439607656426504209] [segmentID=439607656426704693] [node=18] [source=2] [shardLeader=18]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.444 +00:00] [INFO] [datanode/compactor.go:676] ["compaction done"] [planID=439607656426704851] [targetSegmentID=439607656426704852] [compactedFrom="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"] ["num of binlog paths"=5] ["num of stats paths"=1] ["num of delta paths"=0]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.927 +00:00] [INFO] [task/executor.go:181] ["load segments..."] [taskIDs="[19,26,24,22]"] [collectionID=439607656426504209] [shard=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0] [segmentIDs="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"] [nodeID=18] [source=2]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.928 +00:00] [INFO] [querynode/impl_utils.go:30] ["LoadSegment start to transfer load with shard cluster"] [traceID=19e47cd308626629] [shard=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0] [segmentIDs="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.928 +00:00] [INFO] [querynode/impl.go:491] ["loadSegmentsTask init"] [collectionID=439607656426504209] [segmentIDs="[439607656426704633,439607656426704685,439607656426704693,439607656426704754]"] [nodeID=18]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.928 +00:00] [INFO] [querynode/impl.go:496] ["loadSegmentsTask start "] [collectionID=439607656426504209] [segmentIDs="[439607656426704633,439607656426704685,439607656426704693,439607656426704754]"] [timeInQueue=27.912µs]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.928 +00:00] [INFO] [querynode/impl.go:509] ["loadSegmentsTask Enqueue done"] [collectionID=439607656426504209] [segmentIDs="[439607656426704633,439607656426704685,439607656426704693,439607656426704754]"] [nodeID=18]
2023-02-21 09:05:37	
[2023/02/21 09:05:37.932 +00:00] [INFO] [querynode/segment.go:186] ["create segment"] [collectionID=439607656426504209] [partitionID=439607656426504210] [segmentID=439607656426704693] [segmentType=Sealed]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.025 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704896,439607656426704897]"] [flushSegments="[439607656426704817,439607656426704634,439607656426704512,439607656426704467,439607656426704818,439607656426704633,439607656426704694,439607656426704755,439607656426704449,439607656426704650,439607656426704561,439607656426704693,439607656426704754,439607656426704685]"] [timeOfSeal=1676970337]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.135 +00:00] [INFO] [querynode/segment_loader.go:231] ["start loading segment data into memory"] [collectionID=439607656426504209] [partitionID=439607656426504210] [segmentID=439607656426704693] [segmentType=Sealed]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.156 +00:00] [INFO] [querynode/segment.go:815] ["load field done"] [fieldID=100] ["row count"=8] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.158 +00:00] [INFO] [querynode/segment.go:815] ["load field done"] [fieldID=0] ["row count"=8] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.158 +00:00] [INFO] [querynode/segment.go:815] ["load field done"] [fieldID=102] ["row count"=8] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.161 +00:00] [INFO] [querynode/segment.go:815] ["load field done"] [fieldID=101] ["row count"=8] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.163 +00:00] [INFO] [querynode/segment.go:815] ["load field done"] [fieldID=1] ["row count"=8] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.163 +00:00] [INFO] [querynode/segment_loader.go:387] ["load field binlogs done for sealed segment"] [collection=439607656426504209] [segment=439607656426704693] [len(field)=5] [segmentType=Sealed]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.163 +00:00] [INFO] [querynode/segment_loader.go:287] ["loading bloom filter..."] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.189 +00:00] [INFO] [querynode/segment_loader.go:669] ["Successfully load pk stats"] [time=26.409347ms] [segment=439607656426704693] [size=89]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.189 +00:00] [INFO] [querynode/segment_loader.go:295] ["loading delta..."] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.189 +00:00] [INFO] [querynode/segment_loader.go:690] ["there are no delta logs saved with segment, skip loading delete record"] [segmentID=439607656426704693]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.212 +00:00] [INFO] [querynode/partition.go:74] ["add a segment to replica"] [collectionID=439607656426504209] [partitionID=439607656426504210] [segmentID=439607656426704693] [segmentType=Sealed]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.212 +00:00] [INFO] [querynode/meta_replica.go:614] ["new segment added to collection replica"] ["query node ID"=18] ["collection ID"=439607656426504209] ["partition ID"=439607656426504210] ["segment ID"=439607656426704693] ["segment type"=Sealed] ["row count"=8] ["segment indexed fields"=0]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.227 +00:00] [INFO] [querynode/impl.go:524] ["loadSegmentsTask WaitToFinish done"] [collectionID=439607656426504209] [segmentIDs="[439607656426704633,439607656426704685,439607656426704693,439607656426704754]"] [nodeID=18]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.227 +00:00] [INFO] [querynode/shard_cluster.go:267] ["ShardCluster update segment"] [collectionID=439607656426504209] [channel=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0] [replicaID=439607656689172481] [nodeID=18] [segmentID=439607656426704693] [state=3]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.227 +00:00] [INFO] [querynode/impl_utils.go:57] ["LoadSegment transfer load done"] [traceID=19e47cd308626629] [shard=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0] [segmentIDs="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.228 +00:00] [INFO] [task/executor.go:198] ["load segments done"] [taskIDs="[19,26,24,22]"] [collectionID=439607656426504209] [shard=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0] [segmentIDs="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"] [nodeID=18] [source=2] [taskID=19] [timeTaken=300.64393ms]
2023-02-21 09:05:38	
[2023/02/21 09:05:38.428 +00:00] [INFO] [task/scheduler.go:690] ["task removed"] [taskID=22] [taskStatus=3] [segmentID=439607656426704693]
2023-02-21 09:05:40	
[2023/02/21 09:05:40.947 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704934,439607656426704935]"] [flushSegments="[439607656426704693,439607656426704754,439607656426704685,439607656426704817,439607656426704512,439607656426704634,439607656426704897,439607656426704467,439607656426704818,439607656426704633,439607656426704694,439607656426704755,439607656426704896,439607656426704449,439607656426704650,439607656426704561]"] [timeOfSeal=1676970340]
2023-02-21 09:05:41	
[2023/02/21 09:05:41.098 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704934,439607656426704935]"] [flushSegments="[439607656426704817,439607656426704512,439607656426704634,439607656426704897,439607656426704467,439607656426704818,439607656426704694,439607656426704755,439607656426704633,439607656426704650,439607656426704896,439607656426704449,439607656426704561,439607656426704693,439607656426704754,439607656426704685]"] [timeOfSeal=1676970341]
2023-02-21 09:05:44	
[2023/02/21 09:05:44.485 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704980,439607656426704981]"] [flushSegments="[439607656426704512,439607656426704634,439607656426704897,439607656426704467,439607656426704818,439607656426704694,439607656426704755,439607656426704633,439607656426704650,439607656426704896,439607656426704449,439607656426704561,439607656426704693,439607656426704935,439607656426704754,439607656426704934,439607656426704685,439607656426704817]"] [timeOfSeal=1676970344]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.359 +00:00] [INFO] [datacoord/services.go:121] ["flush response with segments"] [collectionID=439607656426504209] [sealSegments="[439607656426704980,439607656426704981]"] [flushSegments="[439607656426704693,439607656426704935,439607656426704754,439607656426704934,439607656426704685,439607656426704817,439607656426704512,439607656426704634,439607656426704897,439607656426704467,439607656426704818,439607656426704633,439607656426704694,439607656426704755,439607656426704449,439607656426704650,439607656426704896,439607656426704561]"] [timeOfSeal=1676970345]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.662 +00:00] [INFO] [datacoord/meta.go:996] ["meta update: prepare for complete compaction mutation - complete"] ["collection ID"=439607656426504209] ["partition ID"=439607656426504210] ["new segment ID"=439607656426704852] ["new segment num of rows"=56] ["compacted from"="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.662 +00:00] [INFO] [datacoord/meta.go:1033] ["meta update: alter meta store for compaction updates"] ["compact from segments (segments to be updated as dropped)"="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"] ["new segmentId"=439607656426704852] [binlog=5] ["stats log"=1] ["delta logs"=0] ["compact to segment"=439607656426704852]
[2023/02/21 09:05:45.671 +00:00] [INFO] [datanode/data_node.go:890] ["DataNode receives SyncSegments"] [traceID=7dfd9951eb8dcbfc] [planID=439607656426704851] ["target segmentID"=439607656426704852] ["compacted from"="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"] [numOfRows=56]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.719 +00:00] [INFO] [datanode/channel_meta.go:548] ["merge flushed segments"] ["segment ID"=439607656426704852] ["collection ID"=439607656426504209] ["partition ID"=439607656426504210] ["compacted from"="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"] [planID=439607656426704851] ["channel name"=in01-e0a52d06b33e103-rootcoord-dml_0_439607656426504209v0]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.720 +00:00] [INFO] [datacoord/meta.go:1058] ["meta update: alter in memory meta after compaction"] ["compact to segment ID"=439607656426704852] ["compact from segment IDs"="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.720 +00:00] [INFO] [datacoord/meta.go:1072] ["meta update: alter in memory meta after compaction - complete"] ["compact to segment ID"=439607656426704852] ["compact from segment IDs"="[439607656426704685,439607656426704633,439607656426704754,439607656426704693]"]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.878 +00:00] [INFO] [datanode/flow_graph_delete_node.go:171] ["update delBuf for compacted segments"] ["compactedTo segmentID"=439607656426704852] ["compactedFrom segmentIDs"="[439607656426704693,439607656426704754,439607656426704685,439607656426704633]"]
2023-02-21 09:05:45	
[2023/02/21 09:05:45.878 +00:00] [INFO] [datanode/channel_meta.go:420] ["remove segments if exist"] [segmentIDs="[439607656426704693,439607656426704754,439607656426704685,439607656426704633]"]

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

No response

[wayblink]

/assign