[11:36:08] 2250000x3231962 matrix with 260342940 entries loaded from data/url.train.libsvm [11:36:08] 146130x3231960 matrix with 16715704 entries loaded from data/url.test.libsvm [11:36:08] Tree method is selected to be 'hist', which uses a single updater grow_fast_histmaker. [11:36:08] src/cli_main.cc:198: Loading data: 2.35692 sec [11:36:08] boosting round 0, 2.38419e-07 sec elapsed [11:36:09] src/common/hist_util.cc:37: Generating sketches... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [0, 32896)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [32896, 65792)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [65792, 98688)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [98688, 131584)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [131584, 164480)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [164480, 197376)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [197376, 230272)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [230272, 263168)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [263168, 296064)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [296064, 328960)... [11:36:43] src/common/hist_util.cc:75: Computing quantiles for features [328960, 361856)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [361856, 394752)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [394752, 427648)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [427648, 460544)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [460544, 493440)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [493440, 526336)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [526336, 559232)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [559232, 592128)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [592128, 625024)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [625024, 657920)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [657920, 690816)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [690816, 723712)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [723712, 756608)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [756608, 789504)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [789504, 822400)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [822400, 855296)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [855296, 888192)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [888192, 921088)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [921088, 953984)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [953984, 986880)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [986880, 1019776)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1019776, 1052672)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1052672, 1085568)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1085568, 1118464)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1118464, 1151360)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1151360, 1184256)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1184256, 1217152)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1217152, 1250048)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1250048, 1282944)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1282944, 1315840)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1315840, 1348736)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1348736, 1381632)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1381632, 1414528)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1414528, 1447424)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1447424, 1480320)... [11:36:44] src/common/hist_util.cc:75: Computing quantiles for features [1480320, 1513216)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1513216, 1546112)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1546112, 1579008)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1579008, 1611904)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1611904, 1644800)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1644800, 1677696)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1677696, 1710592)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1710592, 1743488)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1743488, 1776384)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1776384, 1809280)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1809280, 1842176)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1842176, 1875072)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1875072, 1907968)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1907968, 1940864)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1940864, 1973760)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [1973760, 2006656)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2006656, 2039552)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2039552, 2072448)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2072448, 2105344)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2105344, 2138240)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2138240, 2171136)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2171136, 2204032)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2204032, 2236928)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2236928, 2269824)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2269824, 2302720)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2302720, 2335616)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2335616, 2368512)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2368512, 2401408)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2401408, 2434304)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2434304, 2467200)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2467200, 2500096)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2500096, 2532992)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2532992, 2565888)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2565888, 2598784)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2598784, 2631680)... [11:36:45] src/common/hist_util.cc:75: Computing quantiles for features [2631680, 2664576)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2664576, 2697472)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2697472, 2730368)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2730368, 2763264)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2763264, 2796160)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2796160, 2829056)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2829056, 2861952)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2861952, 2894848)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2894848, 2927744)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2927744, 2960640)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2960640, 2993536)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [2993536, 3026432)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [3026432, 3059328)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [3059328, 3092224)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [3092224, 3125120)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [3125120, 3158016)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [3158016, 3190912)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [3190912, 3223808)... [11:36:46] src/common/hist_util.cc:75: Computing quantiles for features [3223808, 3231962)... [11:36:48] src/tree/updater_fast_hist.cc:70: Quantizing data matrix entries into quantile indices... [11:36:48] src/tree/updater_fast_hist.cc:75: Generating columnar access structure... [11:36:48] src/tree/updater_fast_hist.cc:92: Done initializing training: 39.9403 sec [11:36:54] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:36:54] src/tree/updater_fast_hist.cc:273: InitData: 0.1161 ( 2.06%) InitNewNode: 0.0236 ( 0.42%) BuildHist: 3.5936 (63.85%) EvaluateSplit: 1.7773 (31.58%) ApplySplit: 0.1175 ( 2.09%) ======================================== Total: 5.6284 [11:36:54] src/gbm/gbtree.cc:274: CommitModel(): 0.0854 sec [11:36:54] src/learner.cc:373: EvalOneIter(): 0.1302 sec [11:36:54] [0] test-auc:0.974065 train-auc:0.979026 [11:36:54] boosting round 1, 46.0396 sec elapsed [11:36:59] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:36:59] src/tree/updater_fast_hist.cc:273: InitData: 0.1013 ( 2.41%) InitNewNode: 0.0224 ( 0.53%) BuildHist: 2.2750 (54.12%) EvaluateSplit: 1.7170 (40.84%) ApplySplit: 0.0880 ( 2.09%) ======================================== Total: 4.2038 [11:36:59] src/gbm/gbtree.cc:274: CommitModel(): 0.0088 sec [11:36:59] src/learner.cc:373: EvalOneIter(): 0.1292 sec [11:36:59] [1] test-auc:0.982248 train-auc:0.984430 [11:36:59] boosting round 2, 50.3874 sec elapsed [11:37:04] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:04] src/tree/updater_fast_hist.cc:273: InitData: 0.0999 ( 1.93%) InitNewNode: 0.0243 ( 0.47%) BuildHist: 2.4445 (47.19%) EvaluateSplit: 2.4549 (47.39%) ApplySplit: 0.1563 ( 3.02%) ======================================== Total: 5.1801 [11:37:04] src/gbm/gbtree.cc:274: CommitModel(): 0.0265 sec [11:37:04] src/learner.cc:373: EvalOneIter(): 0.1436 sec [11:37:04] [2] test-auc:0.984265 train-auc:0.986600 [11:37:04] boosting round 3, 55.7431 sec elapsed [11:37:09] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:09] src/tree/updater_fast_hist.cc:273: InitData: 0.1077 ( 2.40%) InitNewNode: 0.0259 ( 0.58%) BuildHist: 2.4250 (54.07%) EvaluateSplit: 1.7829 (39.75%) ApplySplit: 0.1431 ( 3.19%) ======================================== Total: 4.4848 [11:37:09] src/gbm/gbtree.cc:274: CommitModel(): 0.0195 sec [11:37:09] src/learner.cc:373: EvalOneIter(): 0.1408 sec [11:37:09] [3] test-auc:0.986066 train-auc:0.987921 [11:37:09] boosting round 4, 60.3982 sec elapsed [11:37:14] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:14] src/tree/updater_fast_hist.cc:273: InitData: 0.1036 ( 1.84%) InitNewNode: 0.0277 ( 0.49%) BuildHist: 2.7843 (49.59%) EvaluateSplit: 2.4824 (44.21%) ApplySplit: 0.2169 ( 3.86%) ======================================== Total: 5.6152 [11:37:14] src/gbm/gbtree.cc:274: CommitModel(): 0.0226 sec [11:37:14] src/learner.cc:373: EvalOneIter(): 0.1462 sec [11:37:14] [4] test-auc:0.986952 train-auc:0.988863 [11:37:14] boosting round 5, 66.1879 sec elapsed [11:37:19] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:19] src/tree/updater_fast_hist.cc:273: InitData: 0.1096 ( 2.32%) InitNewNode: 0.0232 ( 0.49%) BuildHist: 2.5897 (54.91%) EvaluateSplit: 1.7885 (37.92%) ApplySplit: 0.2053 ( 4.35%) ======================================== Total: 4.7164 [11:37:19] src/gbm/gbtree.cc:274: CommitModel(): 0.0176 sec [11:37:19] src/learner.cc:373: EvalOneIter(): 0.1470 sec [11:37:19] [5] test-auc:0.987314 train-auc:0.989364 [11:37:19] boosting round 6, 71.0807 sec elapsed [11:37:25] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:25] src/tree/updater_fast_hist.cc:273: InitData: 0.1074 ( 2.02%) InitNewNode: 0.0222 ( 0.42%) BuildHist: 2.5508 (48.04%) EvaluateSplit: 2.4797 (46.70%) ApplySplit: 0.1499 ( 2.82%) ======================================== Total: 5.3102 [11:37:25] src/gbm/gbtree.cc:274: CommitModel(): 0.0294 sec [11:37:25] src/learner.cc:373: EvalOneIter(): 0.1494 sec [11:37:25] [6] test-auc:0.988370 train-auc:0.989973 [11:37:25] boosting round 7, 76.5782 sec elapsed [11:37:30] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:30] src/tree/updater_fast_hist.cc:273: InitData: 0.1041 ( 2.20%) InitNewNode: 0.0252 ( 0.53%) BuildHist: 2.6011 (54.99%) EvaluateSplit: 1.8300 (38.69%) ApplySplit: 0.1697 ( 3.59%) ======================================== Total: 4.7303 [11:37:30] src/gbm/gbtree.cc:274: CommitModel(): 0.0248 sec [11:37:30] src/learner.cc:373: EvalOneIter(): 0.1521 sec [11:37:30] [7] test-auc:0.989324 train-auc:0.990924 [11:37:30] boosting round 8, 81.4957 sec elapsed [11:37:35] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:35] src/tree/updater_fast_hist.cc:273: InitData: 0.1069 ( 1.98%) InitNewNode: 0.0235 ( 0.43%) BuildHist: 2.5885 (47.98%) EvaluateSplit: 2.4910 (46.17%) ApplySplit: 0.1847 ( 3.42%) ======================================== Total: 5.3948 [11:37:35] src/gbm/gbtree.cc:274: CommitModel(): 0.0214 sec [11:37:35] src/learner.cc:373: EvalOneIter(): 0.1536 sec [11:37:35] [8] test-auc:0.989863 train-auc:0.991518 [11:37:35] boosting round 9, 87.0795 sec elapsed [11:37:40] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:37:40] src/tree/updater_fast_hist.cc:273: InitData: 0.1069 ( 2.36%) InitNewNode: 0.0250 ( 0.55%) BuildHist: 2.5791 (56.93%) EvaluateSplit: 1.7408 (38.42%) ApplySplit: 0.0784 ( 1.73%) ======================================== Total: 4.5304 [11:37:40] src/gbm/gbtree.cc:274: CommitModel(): 0.0164 sec [11:37:40] src/learner.cc:373: EvalOneIter(): 0.1522 sec [11:37:40] [9] test-auc:0.990217 train-auc:0.991943 [11:37:40] update end, 91.7887 sec in all Command being timed: "./xgboost/xgboost url.conf debug_verbose=1 enable_feature_grouping=0 use_columnar_access=0" User time (seconds): 1051.39 System time (seconds): 34.27 Percent of CPU this job got: 1150% Elapsed (wall clock) time (h:mm:ss or m:ss): 1:34.35 Average shared text size (kbytes): 0 Average unshared data size (kbytes): 0 Average stack size (kbytes): 0 Average total size (kbytes): 0 Maximum resident set size (kbytes): 12977652 Average resident set size (kbytes): 0 Major (requiring I/O) page faults: 0 Minor (reclaiming a frame) page faults: 11496239 Voluntary context switches: 3502674 Involuntary context switches: 5771 Swaps: 0 File system inputs: 0 File system outputs: 128 Socket messages sent: 0 Socket messages received: 0 Signals delivered: 0 Page size (bytes): 4096 Exit status: 0