Skip to content

Conversation

@alexv-smirnov
Copy link
Member

@alexv-smirnov alexv-smirnov commented Mar 14, 2025

Change description

Missed implementation for blobs precharge

Changelog category

  • Bugfix

@github-actions
Copy link

github-actions bot commented Mar 14, 2025

🔴 2025-03-14 08:31:46 UTC The validation of the Pull Request description has failed. Please update the description.

The changelog entry is less than 20 characters or missing.

@github-actions
Copy link

github-actions bot commented Mar 14, 2025

2025-03-14 08:13:24 UTC Pre-commit check linux-x86_64-release-asan for fc0c412 has started.
2025-03-14 08:13:39 UTC Artifacts will be uploaded here
2025-03-14 08:16:56 UTC ya make is running...
🟡 2025-03-14 09:59:45 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Details

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13963 13870 0 41 17 35

2025-03-14 10:01:11 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-14 10:13:23 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Details

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
140 (only retried tests) 97 0 2 5 36

2025-03-14 10:13:33 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-14 10:31:00 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
71 (only retried tests) 32 0 0 5 34

🟢 2025-03-14 10:31:07 UTC Build successful.
🟢 2025-03-14 10:31:37 UTC ydbd size 3.8 GiB changed* by +15.8 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: d843851 merge: fc0c412 diff diff %
ydbd size 4 045 992 936 Bytes 4 046 009 112 Bytes +15.8 KiB +0.000%
ydbd stripped size 1 399 898 600 Bytes 1 399 903 272 Bytes +4.6 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Mar 14, 2025

2025-03-14 08:15:47 UTC Pre-commit check linux-x86_64-relwithdebinfo for fc0c412 has started.
2025-03-14 08:16:02 UTC Artifacts will be uploaded here
2025-03-14 08:19:17 UTC ya make is running...
🟡 2025-03-14 10:06:08 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28396 25798 0 3 2476 119

2025-03-14 10:08:53 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-14 10:27:07 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
175 (only retried tests) 65 0 1 1 108

2025-03-14 10:27:17 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-03-14 10:38:42 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
149 (only retried tests) 43 0 1 1 104

🟢 2025-03-14 10:38:51 UTC Build successful.
🟢 2025-03-14 10:39:11 UTC ydbd size 2.1 GiB changed* by +13.1 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: d843851 merge: fc0c412 diff diff %
ydbd size 2 297 866 000 Bytes 2 297 879 400 Bytes +13.1 KiB +0.001%
ydbd stripped size 481 033 568 Bytes 481 039 328 Bytes +5.6 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

NTable::TRowState rowState;
rowState.Init(State.Columns.size());
NTable::TSelectStats stats;
txc.DB.Select(TableInfo.LocalTid, key, State.Columns, rowState, stats, 0, State.ReadVersion, GetReadTxMap(), GetReadTxObserver());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Весь смысл вызова Precharge в том, что он чуть-чуть дешевле - не пытается собрать row state, а только потрогать те страницы, которые могут пригодиться на следующей итерации. Вы же делаете и Precharge и Select, т.е. буквально делаете два раза одно и то же разными способами. Оставьте тогда уж только Select, если вам нужна более точная работа?

TTransactionContext& txc,
ui32 queryIndex)
{
if (UseNewPrecharge) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Очень плохо называть что-либо "New". Мы будем на это переходить? Если это лучше работает, то почему это не включено сразу без флагов "new"?

NTable::TRowState rowState;
rowState.Init(State.Columns.size());
NTable::TSelectStats stats;
txc.DB.Select(TableInfo.LocalTid, key, State.Columns, rowState, stats, 0, State.ReadVersion, GetReadTxMap(), GetReadTxObserver());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Это чтение используется исключительно ради Precharge, так что передавать GetReadTxObserver() не нужно - любые обнаруженные конфликты по транзакциям не должны учитываться.

Copy link
Member

@snaury snaury left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Обсудили голосом и решили что сейчас замержим, а потом поправим (этот код уже в проде в Nebius, поверх него есть другие PR).

@maximyurchuk maximyurchuk merged commit 6b6beae into ydb-platform:main Mar 14, 2025
14 of 20 checks passed
adameat pushed a commit to adameat/ydb that referenced this pull request Mar 20, 2025
blinkov pushed a commit that referenced this pull request Mar 21, 2025
Emgariko pushed a commit to Emgariko/ydb that referenced this pull request Mar 24, 2025
lberserq pushed a commit to lberserq/ydb that referenced this pull request Mar 28, 2025
UgnineSirdis pushed a commit that referenced this pull request Jun 8, 2025
…14707) (#15730)

Co-authored-by: Semyon Danilov <senya@ydb.tech>
(cherry picked from commit 6b6beae)
@liruoko liruoko added the changelog/f25-3 PR участвует в списке изменений label Nov 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugfix changelog/f25-3 PR участвует в списке изменений

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants