[11:06:50] 2250000x3231962 matrix with 260342940 entries loaded from data/url.train.libsvm [11:06:51] 146130x3231960 matrix with 16715704 entries loaded from data/url.test.libsvm [11:06:51] Tree method is selected to be 'hist', which uses a single updater grow_fast_histmaker. [11:06:51] src/cli_main.cc:198: Loading data: 16.6707 sec [11:06:51] boosting round 0, 0 sec elapsed [11:06:52] src/common/hist_util.cc:37: Generating sketches... [11:07:24] src/common/hist_util.cc:75: Computing quantiles for features [0, 32896)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [32896, 65792)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [65792, 98688)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [98688, 131584)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [131584, 164480)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [164480, 197376)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [197376, 230272)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [230272, 263168)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [263168, 296064)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [296064, 328960)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [328960, 361856)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [361856, 394752)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [394752, 427648)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [427648, 460544)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [460544, 493440)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [493440, 526336)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [526336, 559232)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [559232, 592128)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [592128, 625024)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [625024, 657920)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [657920, 690816)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [690816, 723712)... [11:07:25] src/common/hist_util.cc:75: Computing quantiles for features [723712, 756608)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [756608, 789504)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [789504, 822400)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [822400, 855296)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [855296, 888192)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [888192, 921088)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [921088, 953984)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [953984, 986880)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [986880, 1019776)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1019776, 1052672)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1052672, 1085568)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1085568, 1118464)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1118464, 1151360)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1151360, 1184256)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1184256, 1217152)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1217152, 1250048)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1250048, 1282944)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1282944, 1315840)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1315840, 1348736)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1348736, 1381632)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1381632, 1414528)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1414528, 1447424)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1447424, 1480320)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1480320, 1513216)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1513216, 1546112)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1546112, 1579008)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1579008, 1611904)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1611904, 1644800)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1644800, 1677696)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1677696, 1710592)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1710592, 1743488)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1743488, 1776384)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1776384, 1809280)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1809280, 1842176)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1842176, 1875072)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1875072, 1907968)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1907968, 1940864)... [11:07:26] src/common/hist_util.cc:75: Computing quantiles for features [1940864, 1973760)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [1973760, 2006656)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2006656, 2039552)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2039552, 2072448)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2072448, 2105344)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2105344, 2138240)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2138240, 2171136)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2171136, 2204032)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2204032, 2236928)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2236928, 2269824)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2269824, 2302720)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2302720, 2335616)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2335616, 2368512)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2368512, 2401408)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2401408, 2434304)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2434304, 2467200)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2467200, 2500096)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2500096, 2532992)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2532992, 2565888)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2565888, 2598784)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2598784, 2631680)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2631680, 2664576)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2664576, 2697472)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2697472, 2730368)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2730368, 2763264)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2763264, 2796160)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2796160, 2829056)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2829056, 2861952)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2861952, 2894848)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2894848, 2927744)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2927744, 2960640)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2960640, 2993536)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [2993536, 3026432)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [3026432, 3059328)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [3059328, 3092224)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [3092224, 3125120)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [3125120, 3158016)... [11:07:27] src/common/hist_util.cc:75: Computing quantiles for features [3158016, 3190912)... [11:07:28] src/common/hist_util.cc:75: Computing quantiles for features [3190912, 3223808)... [11:07:28] src/common/hist_util.cc:75: Computing quantiles for features [3223808, 3231962)... [11:07:29] src/tree/updater_fast_hist.cc:70: Quantizing data matrix entries into quantile indices... [11:07:30] src/tree/updater_fast_hist.cc:75: Generating columnar access structure... [11:08:04] src/tree/updater_fast_hist.cc:82: Grouping features together... [11:09:06] src/common/hist_util.cc:370: here [11:09:06] src/common/hist_util.cc:383: here [11:09:06] src/common/hist_util.cc:403: here, gmat.index = 260342940 [11:09:54] src/common/hist_util.cc:416: here [11:10:02] src/common/hist_util.cc:439: here [11:10:02] src/tree/updater_fast_hist.cc:92: Done initializing training: 190.53 sec [11:10:06] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:06] src/tree/updater_fast_hist.cc:273: InitData: 0.1191 ( 2.66%) InitNewNode: 0.0231 ( 0.52%) BuildHist: 2.1509 (48.05%) EvaluateSplit: 2.1409 (47.83%) ApplySplit: 0.0421 ( 0.94%) ======================================== Total: 4.4764 [11:10:06] src/gbm/gbtree.cc:274: CommitModel(): 0.0997 sec [11:10:06] src/learner.cc:373: EvalOneIter(): 0.1385 sec [11:10:06] [0] test-auc:0.974065 train-auc:0.979026 [11:10:06] boosting round 1, 195.486 sec elapsed [11:10:10] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:10] src/tree/updater_fast_hist.cc:273: InitData: 0.1039 ( 2.90%) InitNewNode: 0.0233 ( 0.65%) BuildHist: 1.3163 (36.78%) EvaluateSplit: 2.0567 (57.47%) ApplySplit: 0.0784 ( 2.19%) ======================================== Total: 3.5788 [11:10:10] src/gbm/gbtree.cc:274: CommitModel(): 0.0083 sec [11:10:10] src/learner.cc:373: EvalOneIter(): 0.1334 sec [11:10:10] [1] test-auc:0.982248 train-auc:0.984430 [11:10:10] boosting round 2, 199.217 sec elapsed [11:10:13] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:13] src/tree/updater_fast_hist.cc:273: InitData: 0.0994 ( 3.04%) InitNewNode: 0.0224 ( 0.69%) BuildHist: 1.1185 (34.22%) EvaluateSplit: 2.0035 (61.30%) ApplySplit: 0.0246 ( 0.75%) ======================================== Total: 3.2685 [11:10:13] src/gbm/gbtree.cc:274: CommitModel(): 0.0072 sec [11:10:14] src/learner.cc:373: EvalOneIter(): 0.1342 sec [11:10:14] [2] test-auc:0.984265 train-auc:0.986600 [11:10:14] boosting round 3, 202.632 sec elapsed [11:10:17] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:17] src/tree/updater_fast_hist.cc:273: InitData: 0.0994 ( 2.63%) InitNewNode: 0.0250 ( 0.66%) BuildHist: 1.4325 (37.82%) EvaluateSplit: 2.1941 (57.93%) ApplySplit: 0.0365 ( 0.96%) ======================================== Total: 3.7877 [11:10:17] src/gbm/gbtree.cc:274: CommitModel(): 0.0083 sec [11:10:18] src/learner.cc:373: EvalOneIter(): 0.1339 sec [11:10:18] [3] test-auc:0.986066 train-auc:0.987921 [11:10:18] boosting round 4, 206.568 sec elapsed [11:10:21] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:21] src/tree/updater_fast_hist.cc:273: InitData: 0.1013 ( 2.96%) InitNewNode: 0.0244 ( 0.72%) BuildHist: 1.2810 (37.49%) EvaluateSplit: 1.9833 (58.04%) ApplySplit: 0.0272 ( 0.80%) ======================================== Total: 3.4173 [11:10:21] src/gbm/gbtree.cc:274: CommitModel(): 0.0074 sec [11:10:21] src/learner.cc:373: EvalOneIter(): 0.1338 sec [11:10:21] [4] test-auc:0.986952 train-auc:0.988863 [11:10:21] boosting round 5, 210.132 sec elapsed [11:10:25] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:25] src/tree/updater_fast_hist.cc:273: InitData: 0.0995 ( 2.86%) InitNewNode: 0.0238 ( 0.68%) BuildHist: 1.2759 (36.62%) EvaluateSplit: 2.0458 (58.71%) ApplySplit: 0.0385 ( 1.10%) ======================================== Total: 3.4847 [11:10:25] src/gbm/gbtree.cc:274: CommitModel(): 0.0144 sec [11:10:25] src/learner.cc:373: EvalOneIter(): 0.1638 sec [11:10:25] [5] test-auc:0.987314 train-auc:0.989364 [11:10:25] boosting round 6, 213.8 sec elapsed [11:10:28] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:28] src/tree/updater_fast_hist.cc:273: InitData: 0.1232 ( 3.36%) InitNewNode: 0.0225 ( 0.61%) BuildHist: 1.3370 (36.45%) EvaluateSplit: 2.1158 (57.68%) ApplySplit: 0.0696 ( 1.90%) ======================================== Total: 3.6683 [11:10:28] src/gbm/gbtree.cc:274: CommitModel(): 0.0080 sec [11:10:29] src/learner.cc:373: EvalOneIter(): 0.1409 sec [11:10:29] [6] test-auc:0.988370 train-auc:0.989973 [11:10:29] boosting round 7, 217.628 sec elapsed [11:10:32] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:32] src/tree/updater_fast_hist.cc:273: InitData: 0.1022 ( 2.87%) InitNewNode: 0.0256 ( 0.72%) BuildHist: 1.3474 (37.80%) EvaluateSplit: 2.0356 (57.11%) ApplySplit: 0.0537 ( 1.51%) ======================================== Total: 3.5647 [11:10:32] src/gbm/gbtree.cc:274: CommitModel(): 0.0135 sec [11:10:32] src/learner.cc:373: EvalOneIter(): 0.1382 sec [11:10:32] [7] test-auc:0.989324 train-auc:0.990924 [11:10:32] boosting round 8, 221.35 sec elapsed [11:10:35] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:35] src/tree/updater_fast_hist.cc:273: InitData: 0.1004 ( 3.16%) InitNewNode: 0.0236 ( 0.74%) BuildHist: 1.2562 (39.60%) EvaluateSplit: 1.7423 (54.93%) ApplySplit: 0.0495 ( 1.56%) ======================================== Total: 3.1721 [11:10:35] src/gbm/gbtree.cc:274: CommitModel(): 0.0121 sec [11:10:36] src/learner.cc:373: EvalOneIter(): 0.1441 sec [11:10:36] [8] test-auc:0.989863 train-auc:0.991518 [11:10:36] boosting round 9, 224.684 sec elapsed [11:10:39] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:10:39] src/tree/updater_fast_hist.cc:273: InitData: 0.1003 ( 3.25%) InitNewNode: 0.0251 ( 0.81%) BuildHist: 1.1974 (38.80%) EvaluateSplit: 1.7172 (55.64%) ApplySplit: 0.0459 ( 1.49%) ======================================== Total: 3.0861 [11:10:39] src/gbm/gbtree.cc:274: CommitModel(): 0.0075 sec [11:10:39] src/learner.cc:373: EvalOneIter(): 0.1449 sec [11:10:39] [9] test-auc:0.990217 train-auc:0.991943 [11:10:39] update end, 227.929 sec in all Command being timed: "./xgboost/xgboost url.conf debug_verbose=1 enable_feature_grouping=1" User time (seconds): 2247.91 System time (seconds): 99.65 Percent of CPU this job got: 954% Elapsed (wall clock) time (h:mm:ss or m:ss): 4:05.96 Average shared text size (kbytes): 0 Average unshared data size (kbytes): 0 Average stack size (kbytes): 0 Average total size (kbytes): 0 Maximum resident set size (kbytes): 32049764 Average resident set size (kbytes): 0 Major (requiring I/O) page faults: 5 Minor (reclaiming a frame) page faults: 19744905 Voluntary context switches: 3617687 Involuntary context switches: 9064 Swaps: 0 File system inputs: 4115760 File system outputs: 96 Socket messages sent: 0 Socket messages received: 0 Signals delivered: 0 Page size (bytes): 4096 Exit status: 0