[11:39:44] 2250000x3231962 matrix with 260342940 entries loaded from data/url.train.libsvm [11:39:44] 146130x3231960 matrix with 16715704 entries loaded from data/url.test.libsvm [11:39:44] Tree method is selected to be 'hist', which uses a single updater grow_fast_histmaker. [11:39:44] src/cli_main.cc:198: Loading data: 2.43055 sec [11:39:44] boosting round 0, 0 sec elapsed [11:39:45] src/common/hist_util.cc:37: Generating sketches... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [0, 32896)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [32896, 65792)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [65792, 98688)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [98688, 131584)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [131584, 164480)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [164480, 197376)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [197376, 230272)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [230272, 263168)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [263168, 296064)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [296064, 328960)... [11:40:19] src/common/hist_util.cc:75: Computing quantiles for features [328960, 361856)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [361856, 394752)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [394752, 427648)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [427648, 460544)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [460544, 493440)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [493440, 526336)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [526336, 559232)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [559232, 592128)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [592128, 625024)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [625024, 657920)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [657920, 690816)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [690816, 723712)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [723712, 756608)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [756608, 789504)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [789504, 822400)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [822400, 855296)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [855296, 888192)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [888192, 921088)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [921088, 953984)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [953984, 986880)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [986880, 1019776)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1019776, 1052672)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1052672, 1085568)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1085568, 1118464)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1118464, 1151360)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1151360, 1184256)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1184256, 1217152)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1217152, 1250048)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1250048, 1282944)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1282944, 1315840)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1315840, 1348736)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1348736, 1381632)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1381632, 1414528)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1414528, 1447424)... [11:40:20] src/common/hist_util.cc:75: Computing quantiles for features [1447424, 1480320)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1480320, 1513216)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1513216, 1546112)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1546112, 1579008)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1579008, 1611904)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1611904, 1644800)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1644800, 1677696)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1677696, 1710592)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1710592, 1743488)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1743488, 1776384)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1776384, 1809280)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1809280, 1842176)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1842176, 1875072)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1875072, 1907968)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1907968, 1940864)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1940864, 1973760)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [1973760, 2006656)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2006656, 2039552)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2039552, 2072448)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2072448, 2105344)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2105344, 2138240)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2138240, 2171136)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2171136, 2204032)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2204032, 2236928)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2236928, 2269824)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2269824, 2302720)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2302720, 2335616)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2335616, 2368512)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2368512, 2401408)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2401408, 2434304)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2434304, 2467200)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2467200, 2500096)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2500096, 2532992)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2532992, 2565888)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2565888, 2598784)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2598784, 2631680)... [11:40:21] src/common/hist_util.cc:75: Computing quantiles for features [2631680, 2664576)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2664576, 2697472)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2697472, 2730368)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2730368, 2763264)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2763264, 2796160)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2796160, 2829056)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2829056, 2861952)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2861952, 2894848)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2894848, 2927744)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2927744, 2960640)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2960640, 2993536)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [2993536, 3026432)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [3026432, 3059328)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [3059328, 3092224)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [3092224, 3125120)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [3125120, 3158016)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [3158016, 3190912)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [3190912, 3223808)... [11:40:22] src/common/hist_util.cc:75: Computing quantiles for features [3223808, 3231962)... [11:40:24] src/tree/updater_fast_hist.cc:70: Quantizing data matrix entries into quantile indices... [11:40:25] src/tree/updater_fast_hist.cc:75: Generating columnar access structure... [11:40:53] src/tree/updater_fast_hist.cc:92: Done initializing training: 69.3158 sec [11:41:00] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:00] src/tree/updater_fast_hist.cc:273: InitData: 0.1172 ( 1.79%) InitNewNode: 0.0253 ( 0.39%) BuildHist: 3.8680 (59.17%) EvaluateSplit: 2.4338 (37.23%) ApplySplit: 0.0923 ( 1.41%) ======================================== Total: 6.5368 [11:41:00] src/gbm/gbtree.cc:274: CommitModel(): 0.0962 sec [11:41:00] src/learner.cc:373: EvalOneIter(): 0.1661 sec [11:41:00] [0] test-auc:0.974065 train-auc:0.979026 [11:41:00] boosting round 1, 76.3613 sec elapsed [11:41:05] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:05] src/tree/updater_fast_hist.cc:273: InitData: 0.1009 ( 2.15%) InitNewNode: 0.0237 ( 0.51%) BuildHist: 2.7490 (58.69%) EvaluateSplit: 1.7651 (37.68%) ApplySplit: 0.0451 ( 0.96%) ======================================== Total: 4.6839 [11:41:05] src/gbm/gbtree.cc:274: CommitModel(): 0.0133 sec [11:41:05] src/learner.cc:373: EvalOneIter(): 0.1364 sec [11:41:05] [1] test-auc:0.982248 train-auc:0.984430 [11:41:05] boosting round 2, 81.2019 sec elapsed [11:41:09] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:09] src/tree/updater_fast_hist.cc:273: InitData: 0.1012 ( 2.49%) InitNewNode: 0.0259 ( 0.64%) BuildHist: 2.2808 (56.22%) EvaluateSplit: 1.6129 (39.76%) ApplySplit: 0.0351 ( 0.86%) ======================================== Total: 4.0569 [11:41:09] src/gbm/gbtree.cc:274: CommitModel(): 0.0278 sec [11:41:09] src/learner.cc:373: EvalOneIter(): 0.1378 sec [11:41:09] [2] test-auc:0.984265 train-auc:0.986600 [11:41:09] boosting round 3, 85.4316 sec elapsed [11:41:14] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:14] src/tree/updater_fast_hist.cc:273: InitData: 0.1000 ( 2.27%) InitNewNode: 0.0249 ( 0.56%) BuildHist: 2.5479 (57.85%) EvaluateSplit: 1.6662 (37.83%) ApplySplit: 0.0655 ( 1.49%) ======================================== Total: 4.4047 [11:41:14] src/gbm/gbtree.cc:274: CommitModel(): 0.0161 sec [11:41:14] src/learner.cc:373: EvalOneIter(): 0.1353 sec [11:41:14] [3] test-auc:0.986066 train-auc:0.987921 [11:41:14] boosting round 4, 89.9937 sec elapsed [11:41:18] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:18] src/tree/updater_fast_hist.cc:273: InitData: 0.0984 ( 2.43%) InitNewNode: 0.0251 ( 0.62%) BuildHist: 2.2699 (55.95%) EvaluateSplit: 1.6265 (40.09%) ApplySplit: 0.0371 ( 0.91%) ======================================== Total: 4.0573 [11:41:18] src/gbm/gbtree.cc:274: CommitModel(): 0.0274 sec [11:41:18] src/learner.cc:373: EvalOneIter(): 0.1454 sec [11:41:18] [4] test-auc:0.986952 train-auc:0.988863 [11:41:18] boosting round 5, 94.2295 sec elapsed [11:41:23] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:23] src/tree/updater_fast_hist.cc:273: InitData: 0.1034 ( 2.23%) InitNewNode: 0.0206 ( 0.44%) BuildHist: 2.7994 (60.33%) EvaluateSplit: 1.6787 (36.18%) ApplySplit: 0.0382 ( 0.82%) ======================================== Total: 4.6405 [11:41:23] src/gbm/gbtree.cc:274: CommitModel(): 0.0100 sec [11:41:23] src/learner.cc:373: EvalOneIter(): 0.1410 sec [11:41:23] [5] test-auc:0.987314 train-auc:0.989364 [11:41:23] boosting round 6, 99.0332 sec elapsed [11:41:27] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:27] src/tree/updater_fast_hist.cc:273: InitData: 0.0999 ( 2.32%) InitNewNode: 0.0241 ( 0.56%) BuildHist: 2.3961 (55.68%) EvaluateSplit: 1.7340 (40.29%) ApplySplit: 0.0494 ( 1.15%) ======================================== Total: 4.3036 [11:41:27] src/gbm/gbtree.cc:274: CommitModel(): 0.0217 sec [11:41:27] src/learner.cc:373: EvalOneIter(): 0.1538 sec [11:41:27] [6] test-auc:0.988370 train-auc:0.989973 [11:41:27] boosting round 7, 103.52 sec elapsed [11:41:32] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:32] src/tree/updater_fast_hist.cc:273: InitData: 0.1027 ( 2.21%) InitNewNode: 0.0262 ( 0.56%) BuildHist: 2.6951 (58.06%) EvaluateSplit: 1.7223 (37.10%) ApplySplit: 0.0957 ( 2.06%) ======================================== Total: 4.6422 [11:41:32] src/gbm/gbtree.cc:274: CommitModel(): 0.0141 sec [11:41:32] src/learner.cc:373: EvalOneIter(): 0.1498 sec [11:41:32] [7] test-auc:0.989324 train-auc:0.990924 [11:41:32] boosting round 8, 108.337 sec elapsed [11:41:38] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:38] src/tree/updater_fast_hist.cc:273: InitData: 0.0989 ( 1.80%) InitNewNode: 0.0242 ( 0.44%) BuildHist: 2.8969 (52.71%) EvaluateSplit: 2.4270 (44.16%) ApplySplit: 0.0491 ( 0.89%) ======================================== Total: 5.4962 [11:41:38] src/gbm/gbtree.cc:274: CommitModel(): 0.0159 sec [11:41:38] src/learner.cc:373: EvalOneIter(): 0.1537 sec [11:41:38] [8] test-auc:0.989863 train-auc:0.991518 [11:41:38] boosting round 9, 114.013 sec elapsed [11:41:42] src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 14 extra nodes, 0 pruned nodes, max_depth=3 [11:41:42] src/tree/updater_fast_hist.cc:273: InitData: 0.0992 ( 2.19%) InitNewNode: 0.0244 ( 0.54%) BuildHist: 2.6184 (57.91%) EvaluateSplit: 1.7297 (38.25%) ApplySplit: 0.0499 ( 1.10%) ======================================== Total: 4.5218 [11:41:42] src/gbm/gbtree.cc:274: CommitModel(): 0.0104 sec [11:41:43] src/learner.cc:373: EvalOneIter(): 0.1471 sec [11:41:43] [9] test-auc:0.990217 train-auc:0.991943 [11:41:43] update end, 118.699 sec in all Command being timed: "./xgboost/xgboost url.conf debug_verbose=1 enable_feature_grouping=0 use_columnar_access=1" User time (seconds): 1729.02 System time (seconds): 91.74 Percent of CPU this job got: 1499% Elapsed (wall clock) time (h:mm:ss or m:ss): 2:01.43 Average shared text size (kbytes): 0 Average unshared data size (kbytes): 0 Average stack size (kbytes): 0 Average total size (kbytes): 0 Maximum resident set size (kbytes): 12940292 Average resident set size (kbytes): 0 Major (requiring I/O) page faults: 0 Minor (reclaiming a frame) page faults: 16078217 Voluntary context switches: 3641782 Involuntary context switches: 8486 Swaps: 0 File system inputs: 0 File system outputs: 72 Socket messages sent: 0 Socket messages received: 0 Signals delivered: 0 Page size (bytes): 4096 Exit status: 0