Skip to content

Commit

Permalink
changes
Browse files Browse the repository at this point in the history
  • Loading branch information
porteratzo committed Oct 26, 2023
1 parent 3cacb71 commit 00a7d92
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions openfl-tutorials/Federated_PyTorch_LLM.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,14 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# Federated PyTorch TinyImageNet Tutorial"
"# Federated PyTorch LLM Tutorial"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"This notebook is an example of Transfer Learning \n",
"This notebook is an example of LLM fine-tuning\n",
"\n",
"Custom DataLoader is used with OpenFL Python API"
]
Expand Down Expand Up @@ -77,7 +77,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Now we are ready to define our dataset and model to perform federated learning on. The dataset should be composed of a numpy arrayWe start with a simple fully connected model that is trained on the MNIST dataset. "
"Now we are ready to define our dataset and model to perform federated learning on. The dataset should be composed of a numpy arrayWe start with a simple Roberta model that is trained on the glue mrpc dataset. "
]
},
{
Expand Down Expand Up @@ -458,7 +458,7 @@
"outputs": [],
"source": [
"#Run experiment, return trained FederatedModel\n",
"final_fl_model = fx.run_experiment(collaborators,{'aggregator.settings.rounds_to_train':1,\"tasks.train.kwargs.epochs\":10})"
"final_fl_model = fx.run_experiment(collaborators,{'aggregator.settings.rounds_to_train':10,\"tasks.train.kwargs.epochs\":2})"
]
},
{
Expand Down

0 comments on commit 00a7d92

Please sign in to comment.