xuhuaiyu cluster_L File: xuhuaiyu File: xuhuaiyu Type: cpu Time: Sep 3, 2018 at 7:34pm (CST) Duration: 48s, Total samples = 410s (854.16%) Showing nodes accounting for 381.58s, 93.07% of 410s total Dropped 599 nodes (cum <= 2.05s) Dropped 62 edges (freq <= 0.41s) Showing top 80 nodes out of 108 N1 runtime systemstack 0.66s (0.16%) of 161.03s (39.28%) N39 runtime gcDrain 0.69s (0.17%) of 79.82s (19.47%) N1->N39 79.79s N75 runtime wbBufFlush func1 0.05s (0.012%) of 54.38s (13.26%) N1->N75 54.37s N68 runtime largeAlloc 0 of 8.94s (2.18%) N1->N68 8.94s N78 runtime (*mcache) nextFree func1 0.05s (0.012%) of 8.16s (1.99%) N1->N78 8.16s N74 runtime gcDrainN 0.09s (0.022%) of 7.89s (1.92%) N1->N74 7.89s N2 github com/pingcap/tidb/executor baseHashAggWorker getPartialResult 2.23s (0.54%) of 142.27s (34.70%) N11 runtime mapassign_faststr 4.51s (1.10%) of 65.39s (15.95%) N2->N11 61.15s N4 runtime mapaccess2_faststr 50.56s (12.33%) of 83.55s (20.38%) N2->N4 60.94s N30 runtime makeslice 0.83s (0.2%) of 10.12s (2.47%) N2->N30 5.72s N73 github com/pingcap/tidb/executor/aggfuncs (*baseAvgFloat64) AllocPartialResult 0.17s (0.041%) of 5.65s (1.38%) N2->N73 5.65s N50 runtime slicebytetostring 0.35s (0.085%) of 3.46s (0.84%) N2->N50 3.46s N10 runtime gcWriteBarrier 5.53s (1.35%) of 42.28s (10.31%) N2->N10 2.62s N3 github com/pingcap/tidb/executor (*HashAggPartialWorker) run 0.01s (0.0024%) of 202.55s (49.40%) N5 github com/pingcap/tidb/executor (*HashAggPartialWorker) updatePartialResult 9.99s (2.44%) of 155.08s (37.82%) N3->N5 155.08s N14 github com/pingcap/tidb/executor (*HashAggPartialWorker) shuffleIntermData 3.12s (0.76%) of 46.69s (11.39%) N3->N14 46.69s N19 runtime memeqbody 25.82s (6.30%) N4->N19 25.75s N13 runtime aeshashbody 31.59s (7.70%) N4->N13 6.79s N5->N2 112.64s N23 github com/pingcap/tidb/executor (*HashAggPartialWorker) getGroupKey 2.27s (0.55%) of 18.67s (4.55%) N5->N23 18.67s N28 runtime newobject 1.03s (0.25%) of 15.13s (3.69%) N5->N28 7.72s N44 github com/pingcap/tidb/executor/aggfuncs (*avgOriginal4Float64) UpdatePartialResult 2.43s (0.59%) of 4.31s (1.05%) N5->N44 4.31s N5->N10 0.95s N6 runtime scanobject 28.13s (6.86%) of 86.39s (21.07%) N18 runtime greyobject 32.04s (7.81%) of 32.22s (7.86%) N6->N18 32.21s N9 runtime heapBitsForObject 55.10s (13.44%) N6->N9 26.05s N7 github com/pingcap/tidb/executor (*HashAggFinalWorker) consumeIntermData 4.50s (1.10%) of 88.94s (21.69%) N24 github com/pingcap/tidb/executor (*HashAggIntermData) getPartialResultBatch 3.23s (0.79%) of 28.67s (6.99%) N7->N24 28.67s N7->N2 27.04s N7->N4 22.61s N7->N11 4.23s N8 runtime mallocgc 8.85s (2.16%) of 40.41s (9.86%) N8->N1 16.94s N76 runtime (*mcache) nextFree 0.06s (0.015%) of 8.51s (2.08%) N8->N76 8.51s N47 runtime heapBitsSetType 3.03s (0.74%) N8->N47 3.03s N49 runtime gcmarknewobject 1.66s (0.4%) of 2.78s (0.68%) N8->N49 2.78s N21 runtime wbBufFlush 0.09s (0.022%) of 54.47s (13.29%) N10->N21 36.75s N72 runtime growWork_faststr 0.13s (0.032%) of 42.48s (10.36%) N11->N72 42.48s N11->N8 13.35s N54 runtime (*hmap) newoverflow 0.76s (0.19%) of 2.32s (0.57%) N11->N54 2.26s N11->N10 1.85s N11->N13 0.88s N12 github com/pingcap/tidb/executor (*HashAggFinalWorker) run 0 of 93.90s (22.90%) N12->N7 88.94s N38 github com/pingcap/tidb/executor (*HashAggFinalWorker) getFinalResult 0.40s (0.098%) of 4.96s (1.21%) N12->N38 4.96s N32 runtime mapiternext 2.82s (0.69%) of 17.65s (4.30%) N14->N32 17.43s N34 runtime stringtoslicebyte 0.66s (0.16%) of 12.76s (3.11%) N14->N34 11.07s N14->N10 8.22s N41 runtime growslice 0.04s (0.0098%) of 6.08s (1.48%) N14->N41 5.48s N14->N30 0.66s N15 runtime evacuate_faststr 7.30s (1.78%) of 42.35s (10.33%) N15->N13 13.16s N59 runtime memclrHasPointers 0.08s (0.02%) of 10.77s (2.63%) N15->N59 10.77s N26 runtime typedmemmove 0.86s (0.21%) of 15.15s (3.70%) N15->N26 6.27s N15->N10 3.93s N16 runtime gcBgMarkWorker 0 of 79.79s (19.46%) N16->N1 79.79s N17 runtime wbBufFlush1 24.95s (6.09%) of 54.34s (13.25%) N17->N9 29.03s N20 runtime memmove 15.28s (3.73%) N21->N1 54.37s N22 runtime bulkBarrierPreWrite 6.04s (1.47%) of 23.76s (5.80%) N22->N21 17.72s N51 github com/pingcap/tidb/util/codec EncodeValue 0.73s (0.18%) of 6.05s (1.48%) N23->N51 6.05s N53 github com/pingcap/tidb/expression (*Column) Eval 0.70s (0.17%) of 5.20s (1.27%) N23->N53 5.20s N23->N26 3.65s N23->N10 0.95s N29 runtime mapaccess1_faststr 8.78s (2.14%) of 19.74s (4.81%) N24->N29 19.74s N24->N10 5.70s N25 github com/pingcap/tidb/util/codec (*Decoder) DecodeOne 2.20s (0.54%) of 15.40s (3.76%) N61 github com/pingcap/tidb/util/codec appendIntToChunk 0.57s (0.14%) of 4.24s (1.03%) N25->N61 4.24s N66 github com/pingcap/tidb/util/codec appendFloatToChunk 0.42s (0.1%) of 3.99s (0.97%) N25->N66 3.99s N56 github com/pingcap/tidb/util/codec DecodeVarint 0.73s (0.18%) of 2.75s (0.67%) N25->N56 2.75s N58 github com/pingcap/tidb/util/codec DecodeFloat 1.06s (0.26%) of 2.22s (0.54%) N25->N58 2.22s N26->N22 13.40s N26->N20 0.89s N27 runtime memclrNoHeapPointers 12.12s (2.96%) N28->N8 14.10s N29->N13 10.74s N30->N8 9.29s N31 github com/pingcap/tidb/executor (*HashAggExec) fetchChildData 0.03s (0.0073%) of 18.72s (4.57%) N48 github com/pingcap/tidb/distsql (*selectResult) Next 0.06s (0.015%) of 18.33s (4.47%) N31->N48 18.31s N32->N10 14.83s N33 runtime (*mheap) alloc 0.12s (0.029%) of 13.03s (3.18%) N33->N27 11.15s N34->N20 12.10s N35 runtime futex 2.70s (0.66%) N36 github com/pingcap/tidb/distsql (*selectResult) readRowsData 1.37s (0.33%) of 16.81s (4.10%) N36->N25 15.40s N37 github com/pingcap/tidb/util/chunk Row GetDatum 4.08s (1%) of 4.20s (1.02%) N38->N2 2.59s N38->N34 1.38s N39->N6 78.61s N40 runtime (*mcentral) cacheSpan 0.18s (0.044%) of 8.05s (1.96%) N71 runtime (*mcentral) grow 0.02s (0.0049%) of 4.99s (1.22%) N40->N71 4.99s N40->N35 1.10s N41->N26 5.02s N41->N8 1.02s N42 github com/pingcap/tidb/util/chunk (*Chunk) AppendInt64 1.80s (0.44%) of 3.67s (0.9%) N42->N10 1.42s N42->N20 0.45s N43 github com/pingcap/tidb/util/chunk (*Chunk) AppendFloat32 1.77s (0.43%) of 3.57s (0.87%) N43->N10 1.38s N43->N20 0.42s N45 github com/pingcap/tidb/util/codec encode 1.60s (0.39%) of 5.32s (1.30%) N52 github com/pingcap/tidb/util/codec encodeSignedInt 1.02s (0.25%) of 3.26s (0.8%) N45->N52 3.26s N46 github com/pingcap/tidb/vendor/google golang org/grpc/transport (*http2Client) reader 0.01s (0.0024%) of 3.57s (0.87%) N69 github com/pingcap/tidb/vendor/google golang org/grpc/transport (*http2Client) handleData 0.01s (0.0024%) of 2.09s (0.51%) N46->N69 2.09s N48->N36 16.81s N48->N41 0.46s N50->N8 2.61s N50->N20 0.50s N51->N45 5.32s N63 github com/pingcap/tidb/util/codec EncodeVarint 0.88s (0.21%) of 2.24s (0.55%) N52->N63 2.24s N53->N37 4.20s N54->N28 1.48s N55 runtime mcall 0.01s (0.0024%) of 2.80s (0.68%) N80 runtime park_m 0.01s (0.0024%) of 2.69s (0.66%) N55->N80 2.69s N57 github com/pingcap/tidb/store/tikv (*copIteratorWorker) run 0.01s (0.0024%) of 2.57s (0.63%) N79 github com/pingcap/tidb/vendor/google golang org/grpc invoke 0.01s (0.0024%) of 2.40s (0.59%) N57->N79 2.40s N59->N22 10.33s N60 github com/pingcap/tidb/server (*Server) onConn 0 of 2.99s (0.73%) N70 github com/pingcap/tidb/server (*clientConn) writeChunks 0.04s (0.0098%) of 2.99s (0.73%) N60->N70 2.99s N61->N42 3.67s N62 runtime schedule 0.11s (0.027%) of 2.76s (0.67%) N64 runtime findrunnable 0.26s (0.063%) of 2.14s (0.52%) N62->N64 2.14s N64->N35 0.49s N65 github com/pingcap/tidb/server dumpTextRow 0.12s (0.029%) of 2.32s (0.57%) N66->N43 3.57s N67 github com/pingcap/tidb/vendor/google golang org/grpc (*parser) recvMsg 0 of 2.32s (0.57%) N67->N30 1.92s N68->N33 8.65s N69->N30 1.73s N70->N65 2.32s N71->N33 4.38s N72->N15 42.35s N73->N28 5.48s N74->N6 7.78s N75->N17 54.33s N76->N1 8.16s N77 runtime (*mcache) refill 0.06s (0.015%) of 8.11s (1.98%) N77->N40 8.05s N78->N77 8.11s N79->N67 2.31s N80->N62 2.65s