Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

information of column xxx is not fund #42017

Closed
aytrack opened this issue Mar 8, 2023 · 4 comments
Closed

information of column xxx is not fund #42017

aytrack opened this issue Mar 8, 2023 · 4 comments
Assignees
@tiancaiamao
Labels
affects-6.5 affects-7.1 affects-7.5 duplicate Issues or pull requests already exists. fuzz/schrddl may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 severity/major sig/sql-infra SIG: SQL Infra type/bug The issue is confirmed as a bug.

Comments

@aytrack
Copy link
Contributor

aytrack commented Mar 8, 2023

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

  1. create table
drop table if exists t1;
create table t1(a int, b int, c int) partition by hash(a) partitions 10;
insert into t1(a, b, c) values (1,2,3), (4,5,6), (7,8,9);
insert into t1(a,b,c) select a, b, c from t1;    --some times
  1. do some update OR delete
delete from t1 limit 1;  -- some times
  1. add column and index with other session while execute dml
 alter table t1 add column d int null default 10;

2. What did you expect to see? (Required)

execute successfully

3. What did you see instead (Required)

[2023/03/08 16:54:33.933 +08:00] [WARN] [session.go:2185] ["compile SQL failed"] [conn=3740839823879963031] [error="information of column test.t1.d is not found"] [SQL="delete from t1 limit 1"]
[2023/03/08 16:54:33.933 +08:00] [INFO] [conn.go:1181] ["command dispatched failed"] [conn=3740839823879963031] [connInfo="id:3740839823879963031, addr:127.0.0.1:55149 status:10, collation:utf8_general_ci, user:root"] [command=Query] [status="inTxn:0, autocommit:1"] [sql= "delete from t1 limit 1"] [txn_mode=PESSIMISTIC] [timestamp=0] [err="information of column test.t1.d is not found
github.com/pingcap/errors.AddStack
	/Users/pingcap/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174
github.com/pingcap/errors.Trace
	/Users/pingcap/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/juju_adaptor.go:15
github.com/pingcap/tidb/planner/core.(*partitionProcessor).reconstructTableColNames
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:334
github.com/pingcap/tidb/planner/core.(*partitionProcessor).processHashPartition
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:340
github.com/pingcap/tidb/planner/core.(*partitionProcessor).prune
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:649
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:72
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:100
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:100
github.com/pingcap/tidb/planner/core.(*partitionProcessor).optimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:64
github.com/pingcap/tidb/planner/core.logicalOptimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:874
github.com/pingcap/tidb/planner/core.DoOptimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:285
github.com/pingcap/tidb/planner/core.(*PlanBuilder).buildDelete
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/logical_plan_builder.go:5889
github.com/pingcap/tidb/planner/core.(*PlanBuilder).Build
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/planbuilder.go:775
github.com/pingcap/tidb/planner.buildLogicalPlan
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:461
github.com/pingcap/tidb/planner.optimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:382
github.com/pingcap/tidb/planner.Optimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:245
github.com/pingcap/tidb/executor.(*Compiler).Compile
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/executor/compiler.go:116
github.com/pingcap/tidb/session.(*session).ExecuteStmt
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/session/session.go:2173
github.com/pingcap/tidb/server.(*TiDBContext).ExecuteStmt
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/driver_tidb.go:247
github.com/pingcap/tidb/server.(*clientConn).handleStmt
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:2122
github.com/pingcap/tidb/server.(*clientConn).handleQuery
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1972
github.com/pingcap/tidb/server.(*clientConn).dispatch
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1403
github.com/pingcap/tidb/server.(*clientConn).Run
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1152
github.com/pingcap/tidb/server.(*Server).onConn
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/server.go:646
runtime.goexit
	/usr/local/go1.19.5/src/runtime/asm_arm64.s:1172"]

4. What is your TiDB version? (Required)

[16:57:52]TiDB root:test> select tidb_version();
+-----------------------------------------------------------+
| tidb_version()                                            |
+-----------------------------------------------------------+
| Release Version: v6.5.1                                   |
| Edition: Community                                        |
| Git Commit Hash: 9a3f362639ddeb837246fd9f5d821f49d495b516 |
| Git Branch: heads/refs/tags/v6.5.1                        |
| UTC Build Time: 2023-03-03 12:51:29                       |
| GoVersion: go1.19.5                                       |
| Race Enabled: false                                       |
| TiKV Min Version: 6.2.0-alpha                             |
| Check Table Before Drop: false                            |
| Store: tikv                                               |
+-----------------------------------------------------------+
1 row in set
@aytrack aytrack added type/bug The issue is confirmed as a bug. fuzz/schrddl severity/major labels Mar 8, 2023
@ti-chi-bot ti-chi-bot added may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 may-affects-6.5 labels Mar 8, 2023
@tiancaiamao
Copy link
Contributor

Root cause is the same with #41622

@tiancaiamao tiancaiamao added the duplicate Issues or pull requests already exists. label Mar 16, 2023
@aytrack
Copy link
Contributor Author

aytrack commented Apr 13, 2023

Since v6.5.2-pre has the fix pr #42027, but it still can reproduce in the fuzz test.
The error stack is same with the issue descirbe but I can't reproduce it with the issue step. It maybe another issue.
so reopen this issue @tiancaiamao

[2023/04/13 07:43:01.216 +08:00] [WARN] [session.go:2184] ["compile SQL failed"] [conn=6589672252424323851] [error="information of column test.d4b38bf1.252e3907 is not found"] [SQL="delete from `d4b38bf1` where `d4b38bf1`.`b49d3b99` in ( 4790.6679297484925 ,9504.339305142064 ,2051.1826176062823 ,5707.99414964935 ) "]
[2023/04/13 07:43:01.216 +08:00] [INFO] [conn.go:1181] ["command dispatched failed"] [conn=6589672252424323851] [connInfo="id:6589672252424323851, addr:10.233.80.42:45092 status:10, collation:utf8mb4_general_ci, user:root"] [command=Query] [status="inTxn:0, autocommit:1"] [sql="delete from `d4b38bf1` where `d4b38bf1`.`b49d3b99` in ( 4790.6679297484925 ,9504.339305142064 ,2051.1826176062823 ,5707.99414964935 ) "] [txn_mode=PESSIMISTIC] [timestamp=0] [err="information of column test.d4b38bf1.252e3907 is not found
github.com/pingcap/errors.AddStack
	/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174
github.com/pingcap/errors.Trace
	/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/juju_adaptor.go:15
github.com/pingcap/tidb/planner/core.(*partitionProcessor).reconstructTableColNames
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:334
github.com/pingcap/tidb/planner/core.(*partitionProcessor).processHashPartition
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:340
github.com/pingcap/tidb/planner/core.(*partitionProcessor).prune
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:654
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:72
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:100
github.com/pingcap/tidb/planner/core.(*partitionProcessor).optimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:64
github.com/pingcap/tidb/planner/core.logicalOptimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:874
github.com/pingcap/tidb/planner/core.DoOptimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:285
github.com/pingcap/tidb/planner/core.(*PlanBuilder).buildDelete
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/logical_plan_builder.go:5889
github.com/pingcap/tidb/planner/core.(*PlanBuilder).Build
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/planbuilder.go:775
github.com/pingcap/tidb/planner.buildLogicalPlan
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:461
github.com/pingcap/tidb/planner.optimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:382
github.com/pingcap/tidb/planner.Optimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:245
github.com/pingcap/tidb/executor.(*Compiler).Compile
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/executor/compiler.go:116
github.com/pingcap/tidb/session.(*session).ExecuteStmt
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/session/session.go:2172
github.com/pingcap/tidb/server.(*TiDBContext).ExecuteStmt
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/driver_tidb.go:252
github.com/pingcap/tidb/server.(*clientConn).handleStmt
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:2122
github.com/pingcap/tidb/server.(*clientConn).handleQuery
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1972
github.com/pingcap/tidb/server.(*clientConn).dispatch
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1403
github.com/pingcap/tidb/server.(*clientConn).Run
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1152
github.com/pingcap/tidb/server.(*Server).onConn
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/server.go:648
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1594"]

@aytrack aytrack reopened this Apr 13, 2023
@tiancaiamao
Copy link
Contributor

Does the master branch still get this error? @aytrack

@tiancaiamao
Copy link
Contributor

I wonder whether do queries during the intemediate DDL state can cause this problem, and still no reproduce.

func TestHashPartitionAddColumn(t *testing.T) {
	store, dom := testkit.CreateMockStoreAndDomain(t)

	tk := testkit.NewTestKit(t, store)
	tk.MustExec("use test")
	tk.MustExec("create table t1(a int, b int, c int) partition by hash(a) partitions 10;")
	tk.MustExec("insert into t1(a, b, c) values (1,2,3), (4,5,6), (7,8,9);")
	for i:=0; i<5; i++ {
		tk.MustExec("insert into t1(a,b,c) select a, b, c from t1;")
	}


	hook := &callback.TestDDLCallback{Do: dom}
	hook.OnJobRunBeforeExported = func(job *model.Job) {
		tk2 := testkit.NewTestKit(t, store)
		tk2.MustExec("use test")
		tk2.MustExec("delete from t1 limit 1 ")
	}
	dom.DDL().SetHook(hook)
	tk.MustExec("alter table t1 add column d int null default 10;")
}

It's a long time after the issue been reported, so I think it's safe to close it if there isn't a stable way to reproduce it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tiancaiamao tiancaiamao

Labels
affects-6.5 affects-7.1 affects-7.5 duplicate Issues or pull requests already exists. fuzz/schrddl may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 severity/major sig/sql-infra SIG: SQL Infra type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@tiancaiamao @VelocityLight @aytrack @ti-chi-bot