Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: NVIDIA/Megatron-LM
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: AlibabaPAI/Megatron
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: acc
Choose a head ref
Can’t automatically merge. Don’t worry, you can still create the pull request.
  • 2 commits
  • 13 files changed
  • 1 contributor

Commits on Aug 8, 2024

  1. Llama3-8B Performance Test Code (#1) 

    * add megatron test code

* update pp experiments

* style: change script name

* scripts: add some configurable parameters for model size

* scripts: add tokenizer and modify comments

* scripts: add tokenizer class and model params and modify log name

* fix: typo in tokenizer

* style: remove blank line

* scripts: add notation for best performance in each group

* scripts: only preserve optimal configuration in each group
    @lausannel
    lausannel authored Aug 8, 2024
    Copy the full SHA
    92177a4 View commit details

Commits on Sep 13, 2024

  1. Add performance test code for llama3-70b model (#2) 

    * add data for megatron

* feat: add llama3-70b script
    @lausannel
    lausannel authored Sep 13, 2024
    Copy the full SHA
    08ee6bd View commit details
Binary file added data/_text_document.bin
View file
Binary file not shown.
Binary file added data/_text_document.idx
View file
Binary file not shown.
Loading