Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat_863][taier-worker-plugin] spark sql proxy auto upload #866

Merged
merged 4 commits into from
Nov 15, 2022

Conversation

jiemotongxue
Copy link
Collaborator

增加spark uploader 用于传输spark-sql-proxy.jar


public static final String SP = File.separator;

// 默认hdfs resource文件清除频率
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment in English, please.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@jiemotongxue
Copy link
Collaborator Author

spark组件故意填写错误的spark-sql-proxy.jar的路径,测试通过~

image

image

@jiemotongxue jiemotongxue self-assigned this Nov 10, 2022
@jiemotongxue jiemotongxue added feature New feature spark spark labels Nov 10, 2022
Copy link
Member

@FlechazoW FlechazoW left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@jiemotongxue
Copy link
Collaborator Author

@vainhope please review it

Copy link
Member

@FlechazoW FlechazoW left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@vainhope vainhope merged commit b546cdb into DTStack:master Nov 15, 2022
@jiemotongxue jiemotongxue linked an issue Jan 4, 2023 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature spark spark
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improve] taier-sql-proxy.jar 自动上传
3 participants