Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] A code question about getting yarn task state #3796

Closed
xloya opened this issue Sep 23, 2020 · 1 comment
Closed

[Question] A code question about getting yarn task state #3796

xloya opened this issue Sep 23, 2020 · 1 comment
Labels
question Further information is requested

Comments

@xloya
Copy link
Contributor

xloya commented Sep 23, 2020

Recently, I looked at the code of the job status on YARN after the job was submitted and got the job status on the YARN.When I saw incubator-dolphinscheduler/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/AbstractCommandExecutor.java , I found a method named isSuccessOfYarnState(List appIds).Why here is a list of appid?I think through log file to get state is one-to-one with yarn app.I really hope to get the answer, thx!

最近我在看作业提交到yarn之后,获取yarn上作业状态的代码.当我看到incubator-dolphinscheduler/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/AbstractCommandExecutor.java这个类时,有个方法叫isSuccessOfYarnState(List appIds).为什么这里会是一个appid的列表?我理解的通过log文件获取当前app状态应该是一对一的关系.非常希望得到解答,谢谢!
image
image
image
image

Which version of DolphinScheduler:
-[dev-branch]

@xloya xloya added the question Further information is requested label Sep 23, 2020
@xloya xloya changed the title [Question] A code question about get yarn task state [Question] A code question about getting yarn task state Sep 23, 2020
@davidzollo
Copy link
Contributor

because shell task can submit many yarn task,the task runtime log will return many application ids


因为 shell 任务类型可以写多个 MR 任务,这样的话,这个shell任务的运行日志里会返回多个 application id

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants