verl: Volcano Engine Reinforcement Learning for LLMs

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

Data and tools for generating and inspecting OLMo pre-training data.

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

Efficient Triton Kernels for LLM Training

LLM training in simple, raw C/CUDA

distributed trainer for LLMs

Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

Add AgentVerse paper link

An Open-Ended Embodied Agent with Large Language Models

Efficient Training (including pre-training and fine-tuning) for Big Models

An IDE layer for Neovim with sane defaults. Completely free and community driven.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A well configured and structured Neovim.

Efficient, Low-Resource, Distributed transformer implementation based on BMTrain

Code for the NAACL 2022 long paper "DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings"

Must-read papers on prompt-based tuning for pre-trained language models.

for Data Science class on Coursera