Code

Dataloader prefetch batch#28484

Code

Closed

qmeeus wants to merge 8 commits intohuggingface:mainhuggingface/transformers:mainfrom qmeeus:patch-4qmeeus/transformers:patch-4Copy head branch name to clipboard

+199-122

Commits

Commits on Dec 11, 2023

• Release: v4.36.0

  LysandreJik

  committed
  1466677

  Copy full SHA for 1466677

Commits on Dec 14, 2023

• [Tokenizer Serialization] Fix the broken serialisation (huggingface#27099)

  Show description for a5ee6f0
  ArthurZucker

  committed
  a5ee6f0

  Copy full SHA for a5ee6f0

• Hot-fix-mixstral-loss (huggingface#27948)

  Show description for 6c3c0dc
  ArthurZucker

  committed
  6c3c0dc

  Copy full SHA for 6c3c0dc

• Fix SDPA correctness following torch==2.1.2 regression (huggingface#27973)

  Show description for 5b7d5bd
  

  fxmarty

  authored and

  ArthurZucker

  committed
  5b7d5bd

  Copy full SHA for 5b7d5bd

• Fix bug with rotating checkpoints (huggingface#28009)

  Show description for 6342b9b
  

  muellerzr

  authored and

  ArthurZucker

  committed
  6342b9b

  Copy full SHA for 6342b9b

• Release: v4.36.1

  ArthurZucker

  committed
  bd65410

  Copy full SHA for bd65410

• fix seamless import

  ArthurZucker

  committed
  c48787f

  Copy full SHA for c48787f

Commits on Jan 12, 2024

• add dataloader_prefetch_factor as a training_args attribute

  qmeeus

  authored
  d8b4b6a

  Copy full SHA for d8b4b6a