Operator | Shape | Hand-Written Plugin | TPAT Plugin | Improvement |
---|---|---|---|---|
GatherNd | shape=(1, 128, 128, 224) | 180.0 us | 127.0 us | 1.4x |
shape=(1,158, 128, 128) | 21.1 us | 17.5 s | 1.2x | |
ScatterND-update | data=(32,128,128,256) indices=(32, 600, 3) | 0.36 ms(ScatterND-kernel) | 0.18 ms(ScatterND-kernel) | 2.0x |
ScatterND- | data=(32,128,128,256) indices=(32, 600, 3) | 2.37 ms | 2.13 ms | 1.1x |
OneHot | depth = 16384 | 9.3 us | 11.6 us | 0.8x |