Skip to content

Commit

Permalink
updating to 80 layers
Browse files Browse the repository at this point in the history
  • Loading branch information
chanind committed Aug 5, 2024
1 parent 810fd8a commit cb9aa7f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion repepo/experiments/sweep_llama3_70b_layers.py
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ def sweep_llama3_70b_layers(config: LlamaSweepLayersConfig):
sweep_results = sweep_layers(
model=model,
tokenizer=tokenizer,
layers=range(32),
layers=range(80),
train_split=config.train_split,
test_split=config.test_split,
datasets=config.datasets,
Expand Down

0 comments on commit cb9aa7f

Please sign in to comment.