MPP test suite using schrodinger/sqllogic

[zanmato1984]

Conduct testing for MPP using schrodinger sqllogic suite.

Suite source code: https://github.com/pingcap/schrodinger-test/tree/test-tiflash2
Usage: doc

Bugs found:

• NULL pointer when pushdown aggregation #1492

[tisonkun]

Manually verify sqllogic with tidb_allow_mpp = 1 and all query passed and from tidb.log it exactly dispatched mpp tasks.

Keep hacking...

$(59 /root/tison/tiflash/integrated) ops/ti.sh tison.ti prop
[172.16.5.59_] pd #0 (/root/tison/mpp/pd0)
[172.16.5.59_]     pd_name: pd0
[172.16.5.59_]     advertise_host: 172.16.5.59
[172.16.5.59_]     pd_port: 7596
[172.16.5.59_]     peer_port: 8096
[172.16.5.59_]     initial_cluster: pd0=http://172.16.5.59:8096,pd1=http://172.16.5.82:8096,pd2=http://172.16.5.85:8096
[172.16.5.59_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.59_]     pid: 152706
[172.16.5.82_] pd #1 (/root/tison/mpp/pd1)
[172.16.5.82_]     pd_name: pd1
[172.16.5.82_]     advertise_host: 172.16.5.82
[172.16.5.82_]     pd_port: 7596
[172.16.5.82_]     peer_port: 8096
[172.16.5.82_]     initial_cluster: pd0=http://172.16.5.59:8096,pd1=http://172.16.5.82:8096,pd2=http://172.16.5.85:8096
[172.16.5.82_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.82_]     pid: 131300
[172.16.5.85_] pd #2 (/root/tison/mpp/pd2)
[172.16.5.85_]     pd_name: pd2
[172.16.5.85_]     advertise_host: 172.16.5.85
[172.16.5.85_]     pd_port: 7596
[172.16.5.85_]     peer_port: 8096
[172.16.5.85_]     initial_cluster: pd0=http://172.16.5.59:8096,pd1=http://172.16.5.82:8096,pd2=http://172.16.5.85:8096
[172.16.5.85_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.85_]     pid: 72627
[172.16.5.59_] tikv #0 (/root/tison/mpp/tikv0)
[172.16.5.59_]     listen_host: 172.16.5.59
[172.16.5.59_]     status_port: 17596
[172.16.5.59_]     tikv_port: 8596
[172.16.5.59_]     advertise_host: 172.16.5.59
[172.16.5.59_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.59_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.59_]     pid: 155014
[172.16.5.82_] tikv #1 (/root/tison/mpp/tikv1)
[172.16.5.82_]     listen_host: 172.16.5.82
[172.16.5.82_]     status_port: 17596
[172.16.5.82_]     tikv_port: 8596
[172.16.5.82_]     advertise_host: 172.16.5.82
[172.16.5.82_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.82_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.82_]     pid: 132377
[172.16.5.85_] tikv #2 (/root/tison/mpp/tikv2)
[172.16.5.85_]     listen_host: 172.16.5.85
[172.16.5.85_]     status_port: 17596
[172.16.5.85_]     tikv_port: 8596
[172.16.5.85_]     advertise_host: 172.16.5.85
[172.16.5.85_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.85_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.85_]     pid: 76540
[172.16.5.59_] tidb #0 (/root/tison/mpp/tidb)
[172.16.5.59_]     advertise_host: 172.16.5.59
[172.16.5.59_]     tidb_port: 9096
[172.16.5.59_]     status_port: 9596
[172.16.5.59_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.59_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.59_]     pid: 158227
[172.16.5.81_] tidb #1 (/root/tison/mpp/tidb)
[172.16.5.81_]     advertise_host: 172.16.5.81
[172.16.5.81_]     tidb_port: 9096
[172.16.5.81_]     status_port: 9596
[172.16.5.81_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.81_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.81_]     pid: 66823
[172.16.5.59_] tiflash #0 (/root/tison/mpp/tiflash0)
[172.16.5.59_]     listen_host: 172.16.5.59
[172.16.5.59_]     interserver_http_port: 6596
[172.16.5.59_]     raft_and_cop_port: 10596
[172.16.5.59_]     http_port: 5596
[172.16.5.59_]     tcp_port: 6096
[172.16.5.59_]     proxy_port: 10096
[172.16.5.59_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.59_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.59_]     standalone: false
[172.16.5.59_]     storage_engine: dt
[172.16.5.59_]     pid: 165889
[172.16.5.82_] tiflash #1 (/root/tison/mpp/tiflash1)
[172.16.5.82_]     listen_host: 172.16.5.82
[172.16.5.82_]     interserver_http_port: 6596
[172.16.5.82_]     raft_and_cop_port: 10596
[172.16.5.82_]     http_port: 5596
[172.16.5.82_]     tcp_port: 6096
[172.16.5.82_]     proxy_port: 10096
[172.16.5.82_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.82_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.82_]     standalone: false
[172.16.5.82_]     storage_engine: dt
[172.16.5.82_]     pid: 136896
[172.16.5.85_] tiflash #2 (/root/tison/mpp/tiflash2)
[172.16.5.85_]     listen_host: 172.16.5.85
[172.16.5.85_]     interserver_http_port: 6596
[172.16.5.85_]     raft_and_cop_port: 10596
[172.16.5.85_]     http_port: 5596
[172.16.5.85_]     tcp_port: 6096
[172.16.5.85_]     proxy_port: 10096
[172.16.5.85_]     pd_addr: 172.16.5.59:7596,172.16.5.82:7596,172.16.5.85:7596
[172.16.5.85_]     cluster_id: 172.16.5.59:/data2/tison/tiflash/integrated/tison.ti
[172.16.5.85_]     standalone: false
[172.16.5.85_]     storage_engine: dt
[172.16.5.85_]     pid: 106199

sqllogic.log is place at /root/tison/sqllogic.log.0205bak and all components' log under directory as shown above.

[tisonkun]

ref https://github.com/pingcap/schrodinger-test/pull/473

[tisonkun]

no more issue reported by schrodinger/sqllogic

tidb: 5a4d89416bc0961d96d661616d7f5983ae46ee96
tiflash: 0fa52e7