Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CPU optimizations #4433

Closed
wants to merge 57 commits into from
Closed

CPU optimizations #4433

wants to merge 57 commits into from

Commits on Jun 2, 2019

  1. Configuration menu
    Copy the full SHA
    7085bf3 View commit details
    Browse the repository at this point in the history
  2. max_digits10 guarantees float decimal roundtrip (#4435)

    2 additional digits are not needed to guarantee that casting the decimal representation will result in the same float, see #3980 (comment)
    ras44 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    33e3669 View commit details
    Browse the repository at this point in the history
  3. Make AUCPR work with multiple query groups (#4436)

    * Make AUCPR work with multiple query groups
    
    * Check AUCPR <= 1.0 in distributed setting
    hcho3 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    5670bdb View commit details
    Browse the repository at this point in the history
  4. In AUC and AUCPR metrics, detect whether weights are per-instance or …

    …per-group (#4216)
    
    * In AUC and AUCPR metrics, detect whether weights are per-instance or per-group
    
    * Fix C++ style check
    
    * Add a test for weighted AUC
    xydrolase authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    6f3feae View commit details
    Browse the repository at this point in the history
  5. Change obj name to reg:squarederror in learner. (#4427)

    * Change memory dump size in R test.
    trivialfis authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    b6d65b6 View commit details
    Browse the repository at this point in the history
  6. [jvm-packages] Tutorial on handling missing values (#4425)

    Add tutorial on missing values and how to handle those within XGBoost.
    Daniel8hen authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    dfd8404 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    8f4f85f View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    ef7c0e8 View commit details
    Browse the repository at this point in the history
  9. Enable building with shared NCCL. (#4447)

    * Add `BUILD_WITH_SHARED_NCCL` to CMake.
    trivialfis authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    8e9ced9 View commit details
    Browse the repository at this point in the history
  10. [jvm-packages] Automatically set maximize_evaluation_metrics if not e…

    …xplicitly given in XGBoost4J-Spark (#4446)
    
    * Automatically set maximize_evaluation_metrics if not explicitly given.
    
    * When custom_eval is set, require maximize_evaluation_metrics.
    
    * Update documents on early stop in XGBoost4J-Spark.
    
    * Fix code error.
    shishaochen authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    6e119a9 View commit details
    Browse the repository at this point in the history
  11. [BLOCKING][CI] Upgrade to Spark 2.4.3 (#4414)

    * [CI] Upgrade to Spark 2.4.2
    
    * Pass Spark version to build script
    
    * Allow multiple --build-arg in ci_build.sh
    
    * Fix syntax
    
    * Fix container name
    
    * Update pom.xml
    
    * Fix container name
    
    * Update Jenkinsfile
    
    * Update pom.xml
    
    * Update Dockerfile.jvm_cross
    hcho3 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    060e12f View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    63514b6 View commit details
    Browse the repository at this point in the history
  13. mgpu predictor using explicit offsets (#4438)

    * mgpu prediction using explicit sharding
    rongou authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    972ddcd View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    5f8918a View commit details
    Browse the repository at this point in the history
  15. [CI] Build XGBoost wheels with CUDA 9.0 (#4459)

    * [CI] Build XGBoost wheels with CUDA 9.0
    
    * Do not call archiveArtifacts for 8.0 wheel
    hcho3 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    b2aa0f3 View commit details
    Browse the repository at this point in the history
  16. [CI] Add Windows GPU to Jenkins CI pipeline (#4463)

    * Fix #4462: Use /MT flag consistently for MSVC target
    
    * First attempt at Windows CI
    
    * Distinguish stages in Linux and Windows pipelines
    
    * Try running CMake in Windows pipeline
    
    * Add build step
    hcho3 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    a9cc3d2 View commit details
    Browse the repository at this point in the history
  17. add cuda 10.1 support (#4468)

    rongou authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    c4f3650 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    e1cff4e View commit details
    Browse the repository at this point in the history
  19. added JSON vignette (#4439)

    ras44 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    158abfb View commit details
    Browse the repository at this point in the history
  20. [CI] Add Python and C++ tests for Windows GPU target (#4469)

    * Add CMake option to use bundled gtest from dmlc-core, so that it is easy to build XGBoost with gtest on Windows
    
    * Consistently apply OpenMP flag to all targets. Force enable OpenMP when USE_CUDA is turned on.
    
    * Insert vcomp140.dll into Windows wheels
    
    * Add C++ and Python tests for CPU and GPU targets (CUDA 9.0, 10.0, 10.1)
    
    * Prevent spurious msbuild failure
    
    * Add GPU tests
    
    * Upgrade dmlc-core
    hcho3 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    d2a6bbf View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    8bf185f View commit details
    Browse the repository at this point in the history
  22. [RFC] Version 0.90 release candidate (#4475)

    * Release 0.90
    
    * Add script to automatically generate acknowledgment
    
    * Update NEWS.md
    hcho3 authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    de8c987 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    4a89a9a View commit details
    Browse the repository at this point in the history
  24. Add support for cross-validation using query ID (#4474)

    * adding support for matrix slicing with query ID for cross-validation
    
    * hail mary test of unrar installation for windows tests
    
    * trying to modify tests to run in Github CI
    
    * Remove dependency on wget and unrar
    
    * Save error log from R test
    
    * Relax assertion in test_training
    
    * Use int instead of bool in C function interface
    
    * Revise R interface
    
    * Add XGDMatrixSliceDMatrixEx and keep old XGDMatrixSliceDMatrix for API compatibility
    bryan-woods authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    b0fc145 View commit details
    Browse the repository at this point in the history
  25. [jvm-packages] Add back reg:linear for scala. (#4490)

    * Add back reg:linear for scala.
    
    * Fix linter.
    trivialfis authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    23b0cfe View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    4f86f2e View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    25a6316 View commit details
    Browse the repository at this point in the history
  28. Add native support for Dask (#4473)

    * Add native support for Dask
    
    * Add multi-GPU demo
    
    * Add sklearn example
    RAMitchell authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    8289379 View commit details
    Browse the repository at this point in the history
  29. Configuration menu
    Copy the full SHA
    aef055d View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    2c94d2b View commit details
    Browse the repository at this point in the history
  31. remove includes

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    c28f768 View commit details
    Browse the repository at this point in the history
  32. fix for CI

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    34bc965 View commit details
    Browse the repository at this point in the history
  33. fix for CI

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    00f6c9d View commit details
    Browse the repository at this point in the history
  34. Configuration menu
    Copy the full SHA
    196b2ae View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    ee60036 View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    238616e View commit details
    Browse the repository at this point in the history
  37. Build fixes

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    8102c7b View commit details
    Browse the repository at this point in the history
  38. CI fixing

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    3a52753 View commit details
    Browse the repository at this point in the history
  39. Configuration menu
    Copy the full SHA
    69c9688 View commit details
    Browse the repository at this point in the history
  40. CI fixing

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    1d8d018 View commit details
    Browse the repository at this point in the history
  41. Fix for gpu building

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    9fff636 View commit details
    Browse the repository at this point in the history
  42. Configuration menu
    Copy the full SHA
    8856db0 View commit details
    Browse the repository at this point in the history
  43. Configuration menu
    Copy the full SHA
    6dbd2e8 View commit details
    Browse the repository at this point in the history
  44. Configuration menu
    Copy the full SHA
    f4de83d View commit details
    Browse the repository at this point in the history
  45. Configuration menu
    Copy the full SHA
    d8a9248 View commit details
    Browse the repository at this point in the history
  46. Configuration menu
    Copy the full SHA
    f95c58c View commit details
    Browse the repository at this point in the history
  47. Configuration menu
    Copy the full SHA
    f4d9b1a View commit details
    Browse the repository at this point in the history
  48. code cleaning

    SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    4229063 View commit details
    Browse the repository at this point in the history
  49. Fix dask API sphinx docstrings (#4507)

    * Fix dask API sphinx docstrings
    
    * Update GPU docs page
    RAMitchell authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    7d85133 View commit details
    Browse the repository at this point in the history
  50. De-duplicate GPU parameters. (#4454)

    * Only define `gpu_id` and `n_gpus` in `LearnerTrainParam`
    * Pass LearnerTrainParam through XGBoost vid factory method.
    * Disable all GPU usage when GPU related parameters are not specified (fixes XGBoost choosing GPU over aggressively).
    * Test learner train param io.
    * Fix gpu pickling.
    trivialfis authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    3b710ce View commit details
    Browse the repository at this point in the history
  51. Configuration menu
    Copy the full SHA
    65dc511 View commit details
    Browse the repository at this point in the history
  52. - training with external memory part 1 of 2 (#4486)

    * - training with external memory part 1 of 2
       - this pr focuses on computing the quantiles using multiple gpus on a
         dataset that uses the external cache capabilities
       - there will a follow-up pr soon after this that will support creation
         of histogram indices on large dataset as well
       - both of these changes are required to support training with external memory
       - the sparse pages in dmatrix are taken in batches and the the cut matrices
         are incrementally built
       - also snuck in some (perf) changes related to sketches aggregation amongst multiple
         features across multiple sparse page batches. instead of aggregating the summary
         inside each device and merged later, it is aggregated in-place when the device
         is working on different rows but the same feature
    sriramch authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    ebee414 View commit details
    Browse the repository at this point in the history
  53. Configuration menu
    Copy the full SHA
    039a902 View commit details
    Browse the repository at this point in the history
  54. Simplify INI-style config reader using C++11 STL (#4478)

    * simplify the config.h file
    
    * revise config.h
    
    * revised config.h
    
    * revise format
    
    * revise format issues
    
    * revise whitespace issues
    
    * revise whitespace namespace format issues
    
    * revise namespace format issues
    
    * format issues
    
    * format issues
    
    * format issues
    
    * format issues
    
    * Revert submodule changes
    
    * minor change
    
    * Update src/common/config.h
    
    Co-Authored-By: Philip Hyunsu Cho <chohyu01@cs.washington.edu>
    
    * address format issue from trivialfis
    
    * Use correct cub submodule
    fuhaoda authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    331e929 View commit details
    Browse the repository at this point in the history
  55. Smarter choice of histogram construction for distributed gpu_hist (#…

    …4519)
    
    * Smarter choice of histogram construction for distributed gpu_hist
    
    * Limit omp team size in ExecuteShards
    RAMitchell authored and SmirnovEgorRu committed Jun 2, 2019
    Configuration menu
    Copy the full SHA
    826d560 View commit details
    Browse the repository at this point in the history
  56. Configuration menu
    Copy the full SHA
    7923f64 View commit details
    Browse the repository at this point in the history
  57. Configuration menu
    Copy the full SHA
    9d44acf View commit details
    Browse the repository at this point in the history