Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Auto Parallel] Integrate all modules #35483

Merged
merged 134 commits into from
Sep 8, 2021

Commits on Jun 28, 2021

  1. add auto_parallel dir

    sandyhouse committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    b985745 View commit details
    Browse the repository at this point in the history
  2. mv to paddle.distributed

    sandyhouse committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    b79e749 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2021

  1. add shard_xx api

    sandyhouse committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    1671850 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2021

  1. add distributed attrs for var

    sandyhouse committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    ec55a43 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2021

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

    … auto_parallel_basic
    sandyhouse committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    25abc00 View commit details
    Browse the repository at this point in the history
  2. add ut, test=develop

    sandyhouse committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    bf24fb7 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2021

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

    … auto_parallel_basic
    sandyhouse committed Jul 18, 2021
    Configuration menu
    Copy the full SHA
    8ea9363 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2021

  1. add dist

    sandyhouse committed Jul 21, 2021
    Configuration menu
    Copy the full SHA
    9e4b3d8 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2021

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

    … auto_parallel_basic
    sandyhouse committed Jul 22, 2021
    Configuration menu
    Copy the full SHA
    e65f77e View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2021

  1. update

    sandyhouse committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    8b95c1e View commit details
    Browse the repository at this point in the history
  2. update

    sandyhouse committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    ccae6ae View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2021

  1. update

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    d107751 View commit details
    Browse the repository at this point in the history
  2. update

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    f7e70ea View commit details
    Browse the repository at this point in the history
  3. update

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    3111159 View commit details
    Browse the repository at this point in the history
  4. update, test=develop

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    70cdb69 View commit details
    Browse the repository at this point in the history
  5. update, test=develop

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    9e5b0f0 View commit details
    Browse the repository at this point in the history
  6. update, test=develop

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    59936ef View commit details
    Browse the repository at this point in the history
  7. update, test=develop

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    27ee413 View commit details
    Browse the repository at this point in the history
  8. update, test=develop

    sandyhouse committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    3a8ceef View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2021

  1. update, test=develop

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    d11f317 View commit details
    Browse the repository at this point in the history
  2. update, test=develop

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    f5ef245 View commit details
    Browse the repository at this point in the history
  3. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    7293b4f View commit details
    Browse the repository at this point in the history
  4. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    1240edc View commit details
    Browse the repository at this point in the history
  5. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    05455fb View commit details
    Browse the repository at this point in the history
  6. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    3e1b3a0 View commit details
    Browse the repository at this point in the history
  7. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    8950c35 View commit details
    Browse the repository at this point in the history
  8. update, test=develop

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    b94a9f2 View commit details
    Browse the repository at this point in the history
  9. update, test=develop

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    e121349 View commit details
    Browse the repository at this point in the history
  10. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    fe51aa3 View commit details
    Browse the repository at this point in the history
  11. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    4563d42 View commit details
    Browse the repository at this point in the history
  12. Merge branch 'develop' into auto_parallel_basic

    lilong12 authored Jul 28, 2021
    Configuration menu
    Copy the full SHA
    192580d View commit details
    Browse the repository at this point in the history
  13. delete unused proto

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    2e69980 View commit details
    Browse the repository at this point in the history
  14. resotre op_desc

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    608dd3f View commit details
    Browse the repository at this point in the history
  15. restore type_defs

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    cb9b6bf View commit details
    Browse the repository at this point in the history
  16. update var_desc

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    8e6559e View commit details
    Browse the repository at this point in the history
  17. remove dimss_mapping for proto_pybind

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    00f5f4d View commit details
    Browse the repository at this point in the history
  18. update interface.py

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    1aa94da View commit details
    Browse the repository at this point in the history
  19. update framework.py

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    97a446c View commit details
    Browse the repository at this point in the history
  20. update

    sandyhouse committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    c586fc6 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2021

  1. update

    sandyhouse committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    fc6cde9 View commit details
    Browse the repository at this point in the history
  2. add auto_parallel dir

    sandyhouse authored and aoyulong committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    9d1a664 View commit details
    Browse the repository at this point in the history
  3. mv to paddle.distributed

    sandyhouse authored and aoyulong committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    5d1b472 View commit details
    Browse the repository at this point in the history
  4. add shard_xx api

    sandyhouse authored and aoyulong committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    d1aabad View commit details
    Browse the repository at this point in the history
  5. add distributed attrs for var

    sandyhouse authored and aoyulong committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    e6ba855 View commit details
    Browse the repository at this point in the history
  6. add ut, test=develop

    sandyhouse authored and aoyulong committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    3bf613c View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    8942a99 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    6916cf2 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    cafdd18 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    4d6dd52 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    3f05d09 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    2c56e12 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    a83e9cd View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    203ea14 View commit details
    Browse the repository at this point in the history
  15. [WIP] Add a minor change

    aoyulong committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    bbc2c39 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    2b6f992 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    921c53d View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    a03d503 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    3770f13 View commit details
    Browse the repository at this point in the history
  20. fix process_mesh ut

    sandyhouse committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    967d0e7 View commit details
    Browse the repository at this point in the history
  21. fix process_mesh ut

    sandyhouse committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    cd1e390 View commit details
    Browse the repository at this point in the history
  22. update

    sandyhouse committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    f48ec91 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2021

  1. update, test=develop

    sandyhouse committed Jul 30, 2021
    Configuration menu
    Copy the full SHA
    b07affa View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f304b47 View commit details
    Browse the repository at this point in the history
  3. update

    sandyhouse committed Jul 30, 2021
    Configuration menu
    Copy the full SHA
    a00fe9e View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2021

  1. update

    sandyhouse committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    da9fe30 View commit details
    Browse the repository at this point in the history
  2. update

    sandyhouse committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    3daecf2 View commit details
    Browse the repository at this point in the history
  3. fix doc sample codes, test=develop

    sandyhouse committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    5640879 View commit details
    Browse the repository at this point in the history
  4. improve coverage, test=develop

    sandyhouse committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    05b0f82 View commit details
    Browse the repository at this point in the history
  5. add static_mode check, test=develop

    sandyhouse committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    fe93d0e View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2021

  1. Configuration menu
    Copy the full SHA
    033c541 View commit details
    Browse the repository at this point in the history
  2. update, test=develop

    sandyhouse committed Aug 4, 2021
    Configuration menu
    Copy the full SHA
    9856d47 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2021

  1. add set_placement, test=develop

    sandyhouse committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    890c70c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6291697 View commit details
    Browse the repository at this point in the history
  3. update doc, test=develop

    sandyhouse committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    4b90b03 View commit details
    Browse the repository at this point in the history
  4. update doc, test=develop

    sandyhouse committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    c395b84 View commit details
    Browse the repository at this point in the history
  5. update doc, test=develop

    sandyhouse committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    8390e01 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2021

  1. update doc, test=develop

    sandyhouse committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    f7d5631 View commit details
    Browse the repository at this point in the history
  2. update, test=develop

    sandyhouse committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    3a2666e View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2021

  1. Configuration menu
    Copy the full SHA
    fa98e39 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b5b8b9b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    70bc589 View commit details
    Browse the repository at this point in the history
  4. Merge PR#33804

    aoyulong committed Aug 9, 2021
    Configuration menu
    Copy the full SHA
    b9bd421 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b59bc33 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2021

  1. update ndarray to nested list, test=develop

    sandyhouse committed Aug 10, 2021
    Configuration menu
    Copy the full SHA
    773516b View commit details
    Browse the repository at this point in the history
  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

    … auto_parallel_basic
    sandyhouse committed Aug 10, 2021
    Configuration menu
    Copy the full SHA
    685504f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    632eeac View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    87abb4b View commit details
    Browse the repository at this point in the history
  5. update, test=develop

    sandyhouse committed Aug 10, 2021
    Configuration menu
    Copy the full SHA
    7ac6299 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2021

  1. Configuration menu
    Copy the full SHA
    c724593 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    63e66bc View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7087b1e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1908acf View commit details
    Browse the repository at this point in the history
  5. Remove unnecessary files

    aoyulong committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    86ccd47 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    3f7dca2 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2021

  1. Configuration menu
    Copy the full SHA
    ed02152 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2021

  1. Configuration menu
    Copy the full SHA
    88e9e23 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2021

  1. Minor changes for CI

    aoyulong committed Aug 17, 2021
    Configuration menu
    Copy the full SHA
    63a6ec6 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2021

  1. Improve some codes based on new comments

    * Fix bugs caused by shallow copy in attributes.py
    * Imporve amend_distributed_attr_for_program in context.py
    * Other changes for weihang's comments
    aoyulong committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    6b77bc8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    411507d View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2021

  1. support shard reader

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    2ef97ba View commit details
    Browse the repository at this point in the history
  2. support shard reader

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    5993a30 View commit details
    Browse the repository at this point in the history
  3. add parallel mode

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    a8a26de View commit details
    Browse the repository at this point in the history
  4. update process mesh

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    93348eb View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e957043 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    291d1b7 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    c74ee5a View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    4c00571 View commit details
    Browse the repository at this point in the history
  9. add transpiler framework

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    b75ceca View commit details
    Browse the repository at this point in the history
  10. add transpiler forward

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    67abec3 View commit details
    Browse the repository at this point in the history
  11. implement transpiler forward

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    cd2526c View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    d7d3b74 View commit details
    Browse the repository at this point in the history
  13. add process

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    52d054c View commit details
    Browse the repository at this point in the history
  14. add unitest

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    1b8ddfb View commit details
    Browse the repository at this point in the history
  15. chmod

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    ae3e506 View commit details
    Browse the repository at this point in the history
  16. chmod

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    e2fa7cd View commit details
    Browse the repository at this point in the history
  17. chmod

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    de53039 View commit details
    Browse the repository at this point in the history
  18. update unitest

    JZ-LIANG committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    fbe3356 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2021

  1. add unitest for gpt

    JZ-LIANG committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    d0798cb View commit details
    Browse the repository at this point in the history
  2. remove unused print

    JZ-LIANG committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    fbc42d6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f0f58dc View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f5cd926 View commit details
    Browse the repository at this point in the history
  5. chmod

    JZ-LIANG committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    2ebece8 View commit details
    Browse the repository at this point in the history
  6. chmod

    JZ-LIANG committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    b22ea19 View commit details
    Browse the repository at this point in the history
  7. bug fixed

    JZ-LIANG committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    cc694b1 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2021

  1. remove amp function

    JZ-LIANG committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    1cc96ca View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2021

  1. update case for dp mode

    JZ-LIANG committed Aug 27, 2021
    Configuration menu
    Copy the full SHA
    4fb30ef View commit details
    Browse the repository at this point in the history
  2. update case for dp mode

    JZ-LIANG committed Aug 27, 2021
    1 Configuration menu
    Copy the full SHA
    56ff62e View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2021

  1. Configuration menu
    Copy the full SHA
    4ec9f80 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0cb34e2 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2021

  1. Configuration menu
    Copy the full SHA
    89b467f View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2021

  1. Integrate all parts of auto parallel and improve codes

    * Integrate all parts by AutoParallelizer
    * Add unit test for AutoParallelizer
    * Improve auto completion module for pipeline parallel
    * Add support for matmul_v2 in dist_matmul
    * Correct the typo "stratergy" to "strategy"
    aoyulong committed Sep 6, 2021
    Configuration menu
    Copy the full SHA
    d7286cb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4fb96e6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    00d699e View commit details
    Browse the repository at this point in the history
  4. 1 Configuration menu
    Copy the full SHA
    79f1025 View commit details
    Browse the repository at this point in the history