gbdt training error

[wqh17101]

and i got

when i train

Originally posted by @wqh17101 in #48 (comment)

[wqh17101]

my script

[rachelsunrh]

Please confirm if the data contains only labels with no features

[wqh17101]

@rachelsunrh this is your sample data for multiclass_classification

[wqh17101]

also there is no data contains only labels with no features in the dataset

[rachelsunrh]

please set smaller resources because the dataset is very small, and check the num.class.
maybe you can set
--driver-memory 1g \
--num-executors 2 \
--executor-cores 1 \
--executor-memory 1g
please have a try.

[wqh17101]

let me try.
Some advice, you can offer your test submit script and dataset in the repo.
So that everybody can run the sample and get the same result if nothing is wrong.
Document is very important for the user. Make sure that it is right.

[wqh17101]

well it worked. @rachelsunrh
so do you know why it happened.

[rachelsunrh]

thanks your advice, I will check the docs latter.
as for this problem, because there is some executor without data.

[wqh17101]

why my feature_importance is empty after training @rachelsunrh

[wqh17101]

also , it seems that there is no parameter which is like ml.log.path to save the training log from yarn logs ,isn`t it?

[rachelsunrh]

yes, training log is not saved in a path
feature_importance empty maybe because the number of features is too little, you can use other dataset with more features to try again.

[wqh17101]

is there any way to save training log? it is hard to read the log from yarn logs which have too many system logs that i don`t care @rachelsunrh

[wqh17101]

there was a ml.log.path parameter in the old version of Angel , why you cancel it

[wqh17101]

also , could you teach me how to calculate and set these parameters

--driver-memory 1g \
--num-executors 2 \
--executor-cores 1 \
--executor-memory 1g

maybe you can add the way into the doc
@rachelsunrh

[wqh17101]

now i use a big dataset about 250GB
with script

and i got this

@rachelsunrh
what can i do ,29g per executor is the max memory i can get