GitHub - blcuicall/LCTG-SP

environment (requirements.txt)

apex 0.1

pytorch 1.7.0

...

pretrain

bash scripts/pretrain_blank.sh

fintune

bash scripts/finetune_seq2seq_onebillionword.sh \ 
     config_tasks/model_blocklm_large.sh \ 
     config_tasks/seq_blank.sh

bash scripts/evaluate_seq2seq.sh

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
__pycache__		__pycache__
config		config
config_tasks		config_tasks
fp16		fp16
model		model
mpu		mpu
scripts		scripts
tasks		tasks
test		test
LICENSE		LICENSE
README.md		README.md
arguments.py		arguments.py
blocklm_utils.py		blocklm_utils.py
generat_test.py		generat_test.py
generate.sh		generate.sh
generate_samples.py		generate_samples.py
generate_test.py		generate_test.py
generation_utils.py		generation_utils.py
hostfile		hostfile
learning_rates.py		learning_rates.py
requirements.txt		requirements.txt
run_test.py		run_test.py
train_utils.py		train_utils.py
utils.py		utils.py
view.txt		view.txt