distsql: add support for distributed sql queries in multi-tenant environments #80680
Assignees
Labels
C-enhancement
Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception)
T-sql-queries
SQL Queries Team
Comments
rharding6373
added
C-enhancement
rharding6373
added a commit
to rharding6373/cockroach
that referenced
this issue
May 4, 2022
This change allows SQL queries to be distributed in multi-tenant environments. The distribution algorithm randomly assigns spans to SQL instances, but if only one instance is used the spans are assigned instead to the gateway instance. Distribution does not take locality into account, which will be implemented in a future PR. This change also supports running execbuilder tests with the 3node-tenant configuration, which is under CCL. These tests can be run in the following manner: ``` make test PKG=./pkg/ccl/logictestccl TESTS=TestTenantExecBuild ./dev test pkg/ccl/logictestccl -f=TestTenantExecBuild ``` Fixes: cockroachdb#80680 Release note: None
rharding6373
added a commit
to rharding6373/cockroach
that referenced
this issue
May 7, 2022
This change allows SQL queries to be distributed in multi-tenant environments. The distribution algorithm randomly assigns spans to SQL instances, but if only one instance is used the spans are assigned instead to the gateway instance. Distribution does not take locality into account, which will be implemented in a future PR. This change also supports running execbuilder tests with the 3node-tenant configuration, which is under CCL. These tests can be run in the following manner: ``` make test PKG=./pkg/ccl/logictestccl TESTS=TestTenantExecBuild ./dev test pkg/ccl/logictestccl -f=TestTenantExecBuild ``` Fixes: cockroachdb#80680 Release note: None
rharding6373
added a commit
to rharding6373/cockroach
that referenced
this issue
May 17, 2022
This change allows SQL queries to be distributed in multi-tenant environments. The distribution algorithm randomly assigns spans to SQL instances, but if only one instance is used the spans are assigned instead to the gateway instance. Distribution does not take locality into account, which will be implemented in a future PR. This change also supports running execbuilder tests with the 3node-tenant configuration, which is under CCL. These tests can be run in the following manner: ``` make test PKG=./pkg/ccl/logictestccl TESTS=TestTenantExecBuild ./dev test pkg/ccl/logictestccl -f=TestTenantExecBuild ``` Fixes: cockroachdb#80680 Release note: None
rharding6373
added a commit
to rharding6373/cockroach
that referenced
this issue
May 17, 2022
This change allows SQL queries to be distributed in multi-tenant environments. The distribution algorithm randomly assigns spans to SQL instances, but if only one instance is used the spans are assigned instead to the gateway instance. Distribution does not take locality into account, which will be implemented in a future PR. This change also supports running execbuilder tests with the 3node-tenant configuration, which is under CCL. These tests can be run in the following manner: ``` make test PKG=./pkg/ccl/logictestccl TESTS=TestTenantExecBuild ./dev test pkg/ccl/logictestccl -f=TestTenantExecBuild ``` Fixes: cockroachdb#80680 Release note: None
rharding6373
added a commit
to rharding6373/cockroach
that referenced
this issue
May 18, 2022
This change allows SQL queries to be distributed in multi-tenant environments. The distribution algorithm randomly assigns spans to SQL instances, but if only one instance is used the spans are assigned instead to the gateway instance. Distribution does not take locality into account, which will be implemented in a future PR. This change also supports running execbuilder tests with the 3node-tenant configuration, which is under CCL. These tests can be run in the following manner: ``` make test PKG=./pkg/ccl/logictestccl TESTS=TestTenantExecBuild ./dev test pkg/ccl/logictestccl -f=TestTenantExecBuild ``` Fixes: cockroachdb#80680 Release note: None
craig bot
pushed a commit
that referenced
this issue
May 18, 2022
80353: sql: enables distributed distsql queries for multi-tenant r=rharding6373 a=rharding6373
sql: enables distributed distsql queries for multi-tenant
This change allows SQL queries to be distributed in multi-tenant
environments. The distribution algorithm randomly assigns spans to SQL
instances, but if only one instance is used the spans are assigned
instead to the gateway instance. Distribution does not take locality
into account, which will be implemented in a future PR.
This change also supports running execbuilder tests with the
3node-tenant configuration, which is under CCL. These tests can be run
in the following manner:
```
make test PKG=./pkg/ccl/logictestccl TESTS=TestTenantExecBuild
./dev test pkg/ccl/logictestccl -f=TestTenantExecBuild
```
Fixes: #80680
Release note: None
81452: release: publish latest docker tag for unstable releases r=rail a=rail
Previously, when we published the pre-release docker images, we never
touched the `latest` tag in the `cockroachdb/cockroach-unstable` docker
repository, even though the script comments say we should.
This patch adds a check to ensure we push every pre-release docker image
with `latest` tag.
Fixes #78663
Release note: None
81465: opt: remove panic when in between filters are not constrained r=rharding6373 a=rharding6373
Before this change, the optimizer assumed that if partition filters are
constrained on an index then the in-between filters are also
constrained, and would panic if it was unable to find a constraint.
However, when an index is partitioned on multiple columns and the
columns have different orders, the optimizer may be unable to generate a
constraint for the in between filters of the partitions, even if the
partition filters are constrained. This change removes the panic, since
the assumption does not hold. As a consequence, the optimizer abandons
the GenerateConstrainedScan rule, but doesn't crash.
I did not include a release note since this appears to be a rare bug
that we have not encountered in the wild.
Fixes #80820
Release note: None
Co-authored-by: rharding6373 <rharding6373@users.noreply.github.com>
Co-authored-by: Rail Aliiev <rail@iqchoice.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Enable distributed queries in non-system tenants, where queries are distributed to any available SQL instance.
JIRA: https://cockroachlabs.atlassian.net/browse/CRDB-10360
Jira issue: CRDB-15553
The text was updated successfully, but these errors were encountered: