Skip to content

Conversation

@kungasc
Copy link
Contributor

@kungasc kungasc commented Sep 8, 2025

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Description for reviewers

https://t.me/c/1952638471/9033

@kungasc kungasc changed the title Fulltext-repeated Support multiple columns in fulltext index Sep 8, 2025
@github-actions
Copy link

github-actions bot commented Sep 8, 2025

2025-09-08 14:59:58 UTC Pre-commit check linux-x86_64-release-asan for 4862d14 has started.
2025-09-08 15:01:00 UTC Artifacts will be uploaded here
2025-09-08 15:05:36 UTC ya make is running...
🟡 2025-09-08 17:52:12 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
17962 17463 0 152 321 26

🟢 2025-09-08 17:53:55 UTC Build successful.

}

// See Layout enum
Layout layout = 1;
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

не вижу пока причин делать какой-то разный layout для разных колонок, поэтому он на уровне выше

@kungasc kungasc self-assigned this Sep 8, 2025
@github-actions
Copy link

github-actions bot commented Sep 8, 2025

2025-09-08 15:02:36 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4862d14 has started.
2025-09-08 15:02:52 UTC Artifacts will be uploaded here
2025-09-08 15:06:45 UTC ya make is running...
🟡 2025-09-08 17:08:03 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40699 37939 0 4 2720 36

2025-09-08 17:11:46 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-09-08 17:26:04 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
673 (only retried tests) 644 0 2 1 26

2025-09-08 17:26:16 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-09-08 17:40:18 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
481 (only retried tests) 458 0 0 0 23

🟢 2025-09-08 17:40:28 UTC Build successful.

@github-actions
Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 08:57:35 UTC Pre-commit check linux-x86_64-release-asan for a4d72d9 has started.
2025-09-09 08:57:49 UTC Artifacts will be uploaded here
2025-09-09 09:00:13 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 08:57:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for a4d72d9 has started.
2025-09-09 08:57:50 UTC Artifacts will be uploaded here
2025-09-09 09:00:13 UTC Check cancelled

@kungasc kungasc requested a review from Copilot September 9, 2025 08:58
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR modernizes fulltext index configuration by replacing the flat field-based settings structure with a nested column-specific analyzer configuration system.

  • Introduces a new ColumnAnalyzers message that encapsulates analyzer settings per column
  • Migrates existing tokenizer, language, and filter settings into an Analyzers structure
  • Updates test cases to use the new configuration format with proper validation for column matching

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

File Description
ydb/public/api/protos/ydb_table.proto Restructures FulltextIndexSettings with column-specific analyzers and moves analyzer settings into nested messages
ydb/core/tx/schemeshard/ut_index/ut_fulltext_index.cpp Updates test cases to use new column-based fulltext settings format and adds validation tests
ydb/core/tx/schemeshard/ut_helpers/ls_checks.cpp Enhances SpecializedIndexDescription to use proper protobuf comparison instead of string comparison
ydb/core/tx/schemeshard/schemeshard_utils.h Adds validation logic to ensure column settings match index key columns
Comments suppressed due to low confidence (3)

ydb/public/api/protos/ydb_table.proto:1

  • Method name should be GetColumns() instead of Getcolumns(). Proto field accessors typically use PascalCase.
syntax = "proto3";

ydb/public/api/protos/ydb_table.proto:1

  • Method names should be GetColumns() and GetColumn() instead of Getcolumns() and Getcolumn(). Proto field accessors typically use PascalCase.
syntax = "proto3";

ydb/public/api/protos/ydb_table.proto:1

  • Method names should be GetColumns() and GetColumn() instead of Getcolumns() and Getcolumn(). Proto field accessors typically use PascalCase.
syntax = "proto3";

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@github-actions
Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 09:01:38 UTC Pre-commit check linux-x86_64-release-asan for 87fa0af has started.
2025-09-09 09:01:52 UTC Artifacts will be uploaded here
2025-09-09 09:05:50 UTC ya make is running...
2025-09-09 11:41:49 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 09:01:40 UTC Pre-commit check linux-x86_64-relwithdebinfo for 87fa0af has started.
2025-09-09 09:01:54 UTC Artifacts will be uploaded here
2025-09-09 09:05:59 UTC ya make is running...
🟡 2025-09-09 11:19:43 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40699 37925 0 7 2731 36

2025-09-09 11:23:22 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-09-09 11:38:59 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
691 (only retried tests) 664 0 1 0 26

2025-09-09 11:39:10 UTC ya make is running... (failed tests rerun, try 3)
2025-09-09 11:41:16 UTC Check cancelled

@kungasc kungasc requested a review from azevaykin September 9, 2025 10:04
@kungasc kungasc marked this pull request as ready for review September 9, 2025 10:04
@kungasc kungasc requested a review from a team as a code owner September 9, 2025 10:04
@github-actions
Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 11:42:38 UTC Pre-commit check linux-x86_64-release-asan for 6ecef53 has started.
2025-09-09 11:42:42 UTC Artifacts will be uploaded here
2025-09-09 11:46:35 UTC ya make is running...
🟡 2025-09-09 13:50:46 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
17964 17524 0 112 301 27

🟢 2025-09-09 13:52:24 UTC Build successful.

@github-actions
Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 11:45:16 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6ecef53 has started.
2025-09-09 11:45:30 UTC Artifacts will be uploaded here
2025-09-09 11:49:22 UTC ya make is running...
🟡 2025-09-09 13:08:05 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40701 37776 0 5 2881 39

2025-09-09 13:12:01 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-09-09 13:27:54 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
811 (only retried tests) 708 0 0 79 24

🟢 2025-09-09 13:28:05 UTC Build successful.

@kungasc kungasc requested a review from snaury September 9, 2025 13:28
@kungasc kungasc merged commit b2d18fd into ydb-platform:dev-fulltext Sep 9, 2025
12 checks passed
@kungasc kungasc mentioned this pull request Sep 9, 2025
13 tasks
AlexanderShprot pushed a commit to AlexanderShprot/ydb that referenced this pull request Sep 25, 2025
neyrox pushed a commit to neyrox/ydb that referenced this pull request Oct 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants