Add Dart booster.

[marugari]

#1199

[tqchen]

remove inline, inline and virtual are conflicting with each other

[tqchen]

@marugari Thanks for the updates. You donot need to open another PR normally, simply update the contents in your branch will update this PR

I have made a few more comments. Please also fix the lint error as indicated in https://travis-ci.org/dmlc/xgboost/jobs/132091950

You can reproduce the style check locally by typing make lint

[tqchen]

Any updates on this ?

[marugari]

Update.
Sorry for my slow-paced work.

[tqchen]

default= "original"

[marugari]

I fixed it.

[tqchen]

One last thing. The name original gbtree and learning rate for normalize
type can be a bit confusing as they are terms used elsewhere. Any idea of
better terms ? What are the terms used by the paper ?
On Mon, Jun 6, 2016 at 5:06 PM Yoshinori Nakano notifications@github.com
wrote:

I fixed it.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#1220 (comment), or mute
the thread
https://github.com/notifications/unsubscribe/ACdUIOslVONMZxMXE_OoU5Tm642txlLvks5qJLXrgaJpZM4IkBFL
.

[marugari]

In the paper, the authors propose a normalize type. ("original" in my implementation)
It is applicable for learning_rate = 1.
For learning_rate < 1, I add "learning_rate".

I will consider appropriate names.

[tqchen]

Does that mean we should automatically choosing the current "learning_rate" by default?

[marugari]

If My calculation is correct, we should choose "learning_rate" as normalize type.

[tqchen]

Let us directly remove normalize type for now, and go with your implementation by default then :)

[tqchen]

please make the update and i will merge the changes in

[tqchen]

Thanks this is merged!

[tqchen]

@marugari Thanks for the great job of bringing in the DART trainer.

To make it more well known and widely accessible to users, I would like to invite you to write a markdown guest blogpost introducing what DART is and how you can use it in xgboost with a few code examples. We can post it on the DMLC website as well documents of XGBoost. Please let me know how you think about it and let me know if you need help in reviewing it.

You can first create a PR to https://github.com/dmlc/xgboost/tree/master/doc/tutorials

[marugari]

Thank you for your great support.

I'm writing a Japanese blog post. Documents will be submitted afterward.

[marugari]

I found my mistakes.
marugari@17bafbe
https://github.com/marugari/Notebooks/blob/master/test_dart.ipynb

I apologize for the trouble.

[tqchen]

no problem, please feel free to open a pr to update the code

[tqchen]

@marugari Any updates on possible guest blogpost?