Wilson parallel upload #1875

domwst · 2024-02-13T06:44:01Z

Implemented parallel upload in wilson

...

Changelog category

Not for changelog (changelog entry is not required)

Additional information

...

github-actions · 2024-02-13T06:44:27Z

⚪ 2024-02-13 06:44:27 UTC Pre-commit check for 3816761 has started.
⚪ 2024-02-13 06:44:28 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-13 07:26:01 UTC Build successful.
⚪ 2024-02-13 07:26:10 UTC Tests are running...
🔴 2024-02-13 09:01:55 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
67445	56452	0	1	10958	34

github-actions · 2024-02-13T06:44:36Z

⚪ 2024-02-13 06:44:36 UTC Pre-commit check for 3816761 has started.
⚪ 2024-02-13 06:44:37 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-13 07:24:24 UTC Build successful.
⚪ 2024-02-13 07:24:32 UTC Tests are running...
🔴 2024-02-13 09:05:03 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14748	14562	0	10	141	35

ydb/library/actors/wilson/wilson_uploader.cpp

github-actions · 2024-02-19T11:18:20Z

⚪ 2024-02-19 11:18:20 UTC Pre-commit check for d3c0297 has started.
⚪ 2024-02-19 11:18:22 UTC Build linux-x86_64-relwithdebinfo is running...
⚫ 2024-02-19 11:23:27 UTC Check cancelled

github-actions · 2024-02-19T11:18:59Z

⚪ 2024-02-19 11:18:59 UTC Pre-commit check for d3c0297 has started.
⚪ 2024-02-19 11:19:00 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-02-19 11:23:27 UTC Check cancelled

…of TWilsonUploader

github-actions · 2024-02-19T11:33:55Z

⚪ 2024-02-19 11:33:53 UTC Pre-commit check for 7d866ec has started.
⚪ 2024-02-19 11:33:55 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-19 12:08:22 UTC Build successful.
⚪ 2024-02-19 12:08:32 UTC Tests are running...
🔴 2024-02-19 13:41:20 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
67568	56546	0	9	10978	35

github-actions · 2024-02-19T11:34:13Z

⚪ 2024-02-19 11:34:13 UTC Pre-commit check for 7d866ec has started.
⚪ 2024-02-19 11:34:14 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-19 12:10:59 UTC Build successful.
⚪ 2024-02-19 12:11:11 UTC Tests are running...
🔴 2024-02-19 13:52:25 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14785	14566	0	24	158	37

github-actions · 2024-02-19T19:19:18Z

⚪ 2024-02-19 19:19:18 UTC Pre-commit check for 97fe841 has started.
⚪ 2024-02-19 19:19:20 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-19 19:59:50 UTC Build successful.
⚪ 2024-02-19 20:00:07 UTC Tests are running...
🔴 2024-02-19 21:34:14 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
67694	56700	0	14	10943	37

github-actions · 2024-02-19T19:22:37Z

⚪ 2024-02-19 19:22:37 UTC Pre-commit check for 97fe841 has started.
⚪ 2024-02-19 19:22:39 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-19 20:03:02 UTC Build successful.
⚪ 2024-02-19 20:03:17 UTC Tests are running...
🔴 2024-02-19 21:46:52 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14677	14459	0	27	153	38

github-actions · 2024-02-20T05:49:09Z

⚪ 2024-02-20 05:49:09 UTC Pre-commit check for e4a25b4 has started.
⚪ 2024-02-20 05:49:11 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-20 06:20:58 UTC Build successful.
⚪ 2024-02-20 06:21:14 UTC Tests are running...
🔴 2024-02-20 06:33:42 UTC Test run completed, no test results found for commit c56f76a. Please check build logs.
⚫ 2024-02-20 06:33:45 UTC Check cancelled

github-actions · 2024-02-20T05:51:30Z

⚪ 2024-02-20 05:51:30 UTC Pre-commit check for e4a25b4 has started.
⚪ 2024-02-20 05:51:32 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-20 06:26:24 UTC Build successful.
⚪ 2024-02-20 06:26:40 UTC Tests are running...
🔴 2024-02-20 06:33:43 UTC Test run completed, no test results found for commit c56f76a. Please check build logs.
⚫ 2024-02-20 06:33:46 UTC Check cancelled

github-actions · 2024-02-20T06:35:13Z

⚪ 2024-02-20 06:35:13 UTC Pre-commit check for 546be84 has started.
⚪ 2024-02-20 06:35:14 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-20 06:37:37 UTC Build successful.
⚪ 2024-02-20 06:37:49 UTC Tests are running...
🔴 2024-02-20 08:24:07 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14686	14437	0	35	169	45

github-actions · 2024-02-20T06:37:11Z

⚪ 2024-02-20 06:37:11 UTC Pre-commit check for 546be84 has started.
⚪ 2024-02-20 06:37:13 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-20 06:40:09 UTC Build successful.
⚪ 2024-02-20 06:40:25 UTC Tests are running...
🔴 2024-02-20 08:12:25 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
67696	56691	0	13	10943	49

ydb/core/protos/config.proto

ydb/library/actors/wilson/wilson_uploader.cpp

github-actions · 2024-02-20T11:12:52Z

⚪ 2024-02-20 11:12:52 UTC Pre-commit check for 52bcbcc has started.
⚪ 2024-02-20 11:12:54 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-20 11:49:37 UTC Build successful.
⚪ 2024-02-20 11:49:53 UTC Tests are running...
🔴 2024-02-20 12:01:37 UTC Test run completed, no test results found for commit c05e964. Please check build logs.
⚫ 2024-02-20 12:01:40 UTC Check cancelled

github-actions · 2024-02-20T11:13:42Z

⚪ 2024-02-20 11:13:42 UTC Pre-commit check for 52bcbcc has started.
⚪ 2024-02-20 11:13:43 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-20 11:52:55 UTC Build successful.
⚪ 2024-02-20 11:53:03 UTC Tests are running...
🔴 2024-02-20 12:01:30 UTC Test run completed, no test results found for commit c05e964. Please check build logs.
⚫ 2024-02-20 12:01:33 UTC Check cancelled

github-actions · 2024-02-20T12:06:13Z

⚪ 2024-02-20 12:06:13 UTC Pre-commit check for 0a9335b has started.
⚪ 2024-02-20 12:06:16 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-20 12:07:26 UTC Build successful.
⚪ 2024-02-20 12:10:49 UTC Tests are running...
🔴 2024-02-20 13:44:36 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14690	14464	0	27	163	36

github-actions · 2024-02-20T12:06:29Z

⚪ 2024-02-20 12:06:28 UTC Pre-commit check for 0a9335b has started.
⚪ 2024-02-20 12:06:31 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-20 12:07:40 UTC Build successful.
⚪ 2024-02-20 12:11:24 UTC Tests are running...
🔴 2024-02-20 13:33:23 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
67609	56605	0	15	10946	43

github-actions bot added the not-for-changelog label Feb 13, 2024

domwst commented Feb 14, 2024

View reviewed changes

ydb/library/actors/wilson/wilson_uploader.cpp Outdated Show resolved Hide resolved

domwst added 3 commits February 19, 2024 09:48

Implemented parallel upload in wilson

51e34ff

Added configuration option for inflight control

aa87f06

Changed log message

f68efd8

domwst force-pushed the wilson-parallel-upload branch from 32405e5 to f68efd8 Compare February 19, 2024 11:16

domwst added 2 commits February 19, 2024 11:22

Renamed TUploadData to TExportRequestData. Moved it's definition out …

daff145

…of TWilsonUploader

Fixed critical issue

fd03142

Adjusted static.py and validation.py

f6d655e

Config validation fixed

c56f76a

domwst added 2 commits February 20, 2024 06:02

Fixed static py

1e9d2fa

Added inflight request counted

dea61af

alexvru requested changes Feb 20, 2024

View reviewed changes

Resolved comments, renamed inflight config parameter

c05e964

domwst linked an issue Feb 20, 2024 that may be closed by this pull request

Allow for parallel export requests in wilson #2101

Closed

static.py fix

07747d5

alexvru approved these changes Feb 20, 2024

View reviewed changes

domwst merged commit 4a5e2ba into ydb-platform:main Feb 20, 2024
2 of 4 checks passed

domwst added a commit to domwst/ydb that referenced this pull request Feb 20, 2024

Wilson parallel upload (ydb-platform#1875)

863932f

This was referenced Feb 21, 2024

YQ-2873 fix hanging in kqp compute actor #2131

Merged

YQ-2786 partly unmute tests fq s3 #2143

Merged

StekPerepolnen mentioned this pull request Feb 22, 2024

YDB-1453 added CORS headers to healthcheck handler #2174

Merged

GrigoriyPA mentioned this pull request Feb 26, 2024

YQ-2898 fix query failed with unknown uncommitted upload issue #2240

Merged

domwst added a commit to domwst/ydb that referenced this pull request Feb 28, 2024

Wilson parallel upload (ydb-platform#1875)

934345d

GrigoriyPA mentioned this pull request Mar 7, 2024

YQ-2737 add TOKEN auth for YT datasource #2561

Merged

domwst added a commit to domwst/ydb that referenced this pull request Mar 11, 2024

Wilson parallel upload (ydb-platform#1875)

7927cc0

domwst added a commit to domwst/ydb that referenced this pull request Mar 12, 2024

Wilson parallel upload (ydb-platform#1875)

d700b31

GrigoriyPA mentioned this pull request Mar 13, 2024

YQ-2957 fix error in s3 stream read actor #2702

Merged

domwst added a commit to domwst/ydb that referenced this pull request Mar 19, 2024

Wilson parallel upload (ydb-platform#1875)

5797b25

This was referenced Mar 19, 2024

Fixed error due to empty token #2966

Merged

YQ-2738 add integration tests for YT in KQP #3150

Merged

domwst added a commit to domwst/ydb that referenced this pull request Apr 3, 2024

Wilson parallel upload (ydb-platform#1875)

926355f

SammyVimes pushed a commit that referenced this pull request Apr 4, 2024

Wilson parallel upload (#1875)

e3dec6d

serbel324 mentioned this pull request Jun 11, 2024

Merge tracing fixes to 24-1 #5458

Merged

serbel324 pushed a commit to serbel324/ydb that referenced this pull request Jun 11, 2024

Wilson parallel upload (ydb-platform#1875)

bed5f3d

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Wilson parallel upload #1875

Wilson parallel upload #1875

domwst commented Feb 13, 2024

github-actions bot commented Feb 13, 2024 •

edited

Loading

github-actions bot commented Feb 13, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

Wilson parallel upload #1875

Wilson parallel upload #1875

Conversation

domwst commented Feb 13, 2024

Implemented parallel upload in wilson

Changelog category

Additional information

github-actions bot commented Feb 13, 2024 • edited Loading

github-actions bot commented Feb 13, 2024 • edited Loading

github-actions bot commented Feb 19, 2024 • edited Loading

github-actions bot commented Feb 19, 2024 • edited Loading

github-actions bot commented Feb 19, 2024 • edited Loading

github-actions bot commented Feb 19, 2024 • edited Loading

github-actions bot commented Feb 19, 2024 • edited Loading

github-actions bot commented Feb 19, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 20, 2024 • edited Loading

github-actions bot commented Feb 13, 2024 •

edited

Loading

github-actions bot commented Feb 13, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 19, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading

github-actions bot commented Feb 20, 2024 •

edited

Loading