Skip to content

Latest commit

 

History

History

safari

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
configs
configs
 
 
csrc/fftconv
csrc/fftconv
 
 
evals
evals
 
 
src
src
 
 
.gitignore
.gitignore
 
 
.gitmodules
.gitmodules
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 
requirements.txt
requirements.txt
 
 
train.py
train.py
 
 

README.md

Wikitext-103 Experiments

This directory was directly adapted from HazyResearch's safari repository.

Setup

Install fftconv with:

cd csrc/fftconv && pip install .

Run Wikitext-103 Experiments

# Hyena-RTF
DATA_PATH=data python3 train.py experiment=wt103/hyena_rtf dataset.batch_size=16 
# Hyena
DATA_PATH=data python3 train.py experiment=wt103/hyena dataset.batch_size=16