Skip to content

Conversation

@cxzl25
Copy link
Contributor

@cxzl25 cxzl25 commented Jul 20, 2023

What changes were proposed in this pull request?

Remove TaskPagedTable

Why are the changes needed?

In SPARK-21809, we introduced stagespage-template.html to show the running status of Stage.
TaskPagedTable is no longer effective, but there are still many PRs updating related codes.

Does this PR introduce any user-facing change?

No

How was this patch tested?

local test

@cxzl25
Copy link
Contributor Author

cxzl25 commented Jul 28, 2023

@LuciferYang Please help to review, thanks.

@LuciferYang
Copy link
Contributor

also cc @yaooqinn FYI

@yaooqinn
Copy link
Member

Could you please attach one or more screenshots in the description?

@cxzl25
Copy link
Contributor Author

cxzl25 commented Jul 28, 2023

Could you please attach one or more screenshots in the description?

PR

stage_task

@HyukjinKwon
Copy link
Member

cc @sarutak @gengliangwang

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you. It's reasonable to avoid the calsulation if the timeline feature is disabled.

@sarutak
Copy link
Member

sarutak commented Jul 28, 2023

@cxzl25 Could you attach another screenshot showing a task table which consists of multiple pages to verify it works with pagenation?

@cxzl25
Copy link
Contributor Author

cxzl25 commented Jul 28, 2023

Could you attach another screenshot showing a task table which consists of multiple pages to verify it works with pagenation?

stage_task_pagenation

@yaooqinn
Copy link
Member

yaooqinn commented Aug 1, 2023

Hi @cxzl25, would you please rebase the master branch?

Copy link
Member

@sarutak sarutak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pending GA.

@yaooqinn yaooqinn changed the title [SPARK-44490][WEBUI] Remove TaskPagedTable in StagePage [SPARK-44490][WEBUI] Remove unused TaskPagedTable in StagePage Aug 1, 2023
@sarutak
Copy link
Member

sarutak commented Aug 1, 2023

Merging to master.
Thank you @cxzl25 and all!

@sarutak sarutak closed this in 546e39c Aug 1, 2023
LuciferYang added a commit that referenced this pull request Jan 29, 2025
…eSuite.scala`

### What changes were proposed in this pull request?
This pr removes a test file `StagePageSuite.scala` that is no longer needed.

### Why are the changes needed?
The current `StagePageSuite.scala` contains one test case and one private method. The reasons for cleaning them up are as follows:

1. The assertion in the test case "ApiHelper.COLUMN_TO_INDEX should match headers of the task table" was cleaned up in SPARK-44490 | #42085. Currently, this test case only creates a `StageData` object and an `AppStatusStore` object, with no other operations or assertions. Moreover, the creation of these objects is also covered in other test cases, such as `KVStoreProtobufSerializerSuite`, `AppStatusStoreSuite`, etc. Therefore, this is already an unnecessary test case and can be cleaned up.

2. The private method `renderStagePage` has not been used since SPARK-21809 | #21688, so it can be cleaned up.

After cleaning up the above content, `StagePageSuite.scala` becomes an empty file, so it can be completely deleted.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Pass GitHub Actions

### Was this patch authored or co-authored using generative AI tooling?
No

Closes #49721 from LuciferYang/SPARK-51026.

Authored-by: yangjie01 <yangjie01@baidu.com>
Signed-off-by: yangjie01 <yangjie01@baidu.com>
LuciferYang added a commit that referenced this pull request Jan 29, 2025
…eSuite.scala`

### What changes were proposed in this pull request?
This pr removes a test file `StagePageSuite.scala` that is no longer needed.

### Why are the changes needed?
The current `StagePageSuite.scala` contains one test case and one private method. The reasons for cleaning them up are as follows:

1. The assertion in the test case "ApiHelper.COLUMN_TO_INDEX should match headers of the task table" was cleaned up in SPARK-44490 | #42085. Currently, this test case only creates a `StageData` object and an `AppStatusStore` object, with no other operations or assertions. Moreover, the creation of these objects is also covered in other test cases, such as `KVStoreProtobufSerializerSuite`, `AppStatusStoreSuite`, etc. Therefore, this is already an unnecessary test case and can be cleaned up.

2. The private method `renderStagePage` has not been used since SPARK-21809 | #21688, so it can be cleaned up.

After cleaning up the above content, `StagePageSuite.scala` becomes an empty file, so it can be completely deleted.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Pass GitHub Actions

### Was this patch authored or co-authored using generative AI tooling?
No

Closes #49721 from LuciferYang/SPARK-51026.

Authored-by: yangjie01 <yangjie01@baidu.com>
Signed-off-by: yangjie01 <yangjie01@baidu.com>
(cherry picked from commit 3badfd2)
Signed-off-by: yangjie01 <yangjie01@baidu.com>
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 14, 2025
…eSuite.scala`

### What changes were proposed in this pull request?
This pr removes a test file `StagePageSuite.scala` that is no longer needed.

### Why are the changes needed?
The current `StagePageSuite.scala` contains one test case and one private method. The reasons for cleaning them up are as follows:

1. The assertion in the test case "ApiHelper.COLUMN_TO_INDEX should match headers of the task table" was cleaned up in SPARK-44490 | apache#42085. Currently, this test case only creates a `StageData` object and an `AppStatusStore` object, with no other operations or assertions. Moreover, the creation of these objects is also covered in other test cases, such as `KVStoreProtobufSerializerSuite`, `AppStatusStoreSuite`, etc. Therefore, this is already an unnecessary test case and can be cleaned up.

2. The private method `renderStagePage` has not been used since SPARK-21809 | apache#21688, so it can be cleaned up.

After cleaning up the above content, `StagePageSuite.scala` becomes an empty file, so it can be completely deleted.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Pass GitHub Actions

### Was this patch authored or co-authored using generative AI tooling?
No

Closes apache#49721 from LuciferYang/SPARK-51026.

Authored-by: yangjie01 <yangjie01@baidu.com>
Signed-off-by: yangjie01 <yangjie01@baidu.com>
(cherry picked from commit fb742ff)
Signed-off-by: yangjie01 <yangjie01@baidu.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants