Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

provided some shell scripts for reducing parameters to submit a job #930

Merged
merged 1 commit into from
Jun 9, 2022
Merged

provided some shell scripts for reducing parameters to submit a job #930

merged 1 commit into from
Jun 9, 2022

Conversation

lvyanquan
Copy link
Contributor

@lvyanquan lvyanquan commented Jun 9, 2022

提供一些脚本,用于减少在不同模式下任务提交需要传入的参数,只需要传递-job和-confProp即可。
其他参数如flink配置文件和hadoop配置文件,通过FLINK_HOME/HADOOP_HOME等参数预先设定。
例如:
在local 模式

 bash chunjun-local.sh -job ../chunjun-examples/json/stream/stream.json

在standalone模式

 bash chunjun-standalone.sh -job ../chunjun-examples/json/stream/stream.json

启动效果

 % bash local.sh -job ../chunjun-examples/json/stream/stream.json

CHUNJUN_HOME is auto set  /Users/admin/fsdownload/chunjun-dist
FLINK_HOME is /Users/admin/flink-1.12.4
HADOOP_HOME is /Users/admin/hadoop
ChunJun starting ...
2022-06-09 14:43:37.128 [main] INFO  com.dtstack.chunjun.Main  - ------------program params-------------------------
2022-06-09 14:43:37.165 [main] INFO  com.dtstack.chunjun.Main  - -flinkLibDir
2022-06-09 14:43:37.166 [main] INFO  com.dtstack.chunjun.Main  - /Users/admin/flink-1.12.4/lib
2022-06-09 14:43:37.166 [main] INFO  com.dtstack.chunjun.Main  - -p
2022-06-09 14:43:37.166 [main] INFO  com.dtstack.chunjun.Main  - 
2022-06-09 14:43:37.166 [main] INFO  com.dtstack.chunjun.Main  - -job

@FlechazoW FlechazoW linked an issue Jun 9, 2022 that may be closed by this pull request
@FlechazoW FlechazoW merged commit bf5b80e into DTStack:master Jun 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

减少提交任务需要传递的参数
2 participants