Skip to content

Latest commit

 

History

History
40 lines (32 loc) · 1011 Bytes

README.md

File metadata and controls

40 lines (32 loc) · 1011 Bytes

Autonomous Learning (AL)

This is the official repository for the paper 'LLMs Could Autonomously Learn Without External Supervision'.

Autonomous Learning

Requirements

  • Python == 3.10.13
  • torch == 2.0.1
  • transformers == 4.35.0
  • alignment-handbook == 0.3.0.dev0
  • numpy == 1.26.3
  • vllm == 0.2.1
  • trl == 0.7.4
  • accelerate == 0.23.2

run

bash run_AL.sh

Reproducibility

We experiment on 8 Tesla A100-80GB GPU.

Bugs or Questions?

If you have any questions related to the code or the paper, feel free to email Ke Ji (keji@link.cuhk.edu.cn).

Citation

Please cite our paper if you find the repo helpful in your work:

@article{ji2024llms,
  title={LLMs Could Autonomously Learn Without External Supervision},
  author={Ji, Ke and Chen, Junying and Gao, Anningzhe and Xie, Wenya and Wan, Xiang and Wang, Benyou},
  journal={arXiv preprint arXiv:2406.00606},
  year={2024}
}