Scaling Data-Constrained Language Models
-
Updated
Sep 22, 2024 - Jupyter Notebook
#
scaling-laws
Here are 17 public repositories matching this topic...
Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
deep-learning pytorch transfer-learning clip fine-tuning few-shot-learning pre-training zero-shot-retrieval zero-shot-classification scaling-laws laion openclip
-
Updated
Nov 29, 2023 - Jupyter Notebook
🔥🔥🔥 Latest Advances on Large Recommendation Models
data-science benchmark data-mining awesome survey recommendation-system recommendation user-behaviour behavior-modeling cross-domain-recommendation recommendation-datasets scaling-laws large-language-models llm-recommendation sequential-recomme
-
Updated
Dec 5, 2024
[NeurIPS'24 Spotlight] Observational Scaling Laws
-
Updated
Oct 2, 2024 - Jupyter Notebook
A toolkit for scaling law research ⚖
-
Updated
Mar 16, 2024 - Python
Dimensionless learning codes for our paper called "Data-driven discovery of dimensionless numbers and governing laws from scarce measurements".
machine-learning deep-learning manufacturing partial-differential-equations system-identification scientific-machine-learning physics-informed scaling-laws
-
Updated
Jun 5, 2024 - Jupyter Notebook
Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)
deep-learning pytorch medical-imaging imagenet chest-xray-images transfer-learning large-scale-learning supercomputing distributed-training fine-tuning few-shot-learning pre-training pre-trained-model mimic-cxr chest-x-ray14 padchest-dataset covidx-dataset big-transfer chexpert-dataset scaling-laws
-
Updated
May 29, 2022 - Jupyter Notebook
Official code for the paper, "Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretraining"
machine-learning reinforcement-learning deep-learning artificial-intelligence transformer atari few-shot scaling-laws world-model
-
Updated
Dec 1, 2024 - Python
[ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang
-
Updated
Jan 4, 2024 - Python
[NeurIPS 2023] Multi-fidelity hyperparameter optimization with deep power laws that achieves state-of-the-art results across diverse benchmarks.
benchmark machine-learning natural-language-processing computer-vision deep-learning tabular-data transformer hyperparameter-optimization mlp hyperparameter-tuning hpo power-laws neurips scaling-laws large-language-models llm neurips-2023
-
Updated
Nov 12, 2023 - Python
code for Scaling Laws for Language Transfer Learning
transformers pytorch openai transfer-learning language-model fine-tuning pre-trained-model pytorch-lightning huggingface-transformers scaling-laws
-
Updated
Apr 18, 2021 - Python
A method for calculating scaling laws for LLMs from publicly available models
-
Updated
Apr 22, 2024 - Python
First temporal graph foundation model dataset and benchmark
-
Updated
Nov 24, 2024 - Python
Code for CoNLL BabyLM workshop Mini Minds: Exploring Bebeshka and Zlata Baby Models
-
Updated
Oct 23, 2023 - Jupyter Notebook
🌹[ICML 2024] Selecting Large Language Model to Fine-tune via Rectified Scaling Law
-
Updated
Jul 1, 2024 - Python
Scaling laws web calculator to get a model's training compute flops, costs and energy utilization.
-
Updated
May 27, 2024 - JavaScript
[NeurIPS 2023] Multi-fidelity hyperparameter optimization with deep power laws that achieves state-of-the-art results across diverse benchmarks.
-
Updated
Oct 16, 2024 - Python
Improve this page
Add a description, image, and links to the scaling-laws topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the scaling-laws topic, visit your repo's landing page and select "manage topics."