Skip to content

Commit

Permalink
add dropout scaling note
Browse files Browse the repository at this point in the history
  • Loading branch information
rasbt committed Nov 6, 2024
1 parent 9ce0be3 commit 1183fd7
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion ch03/01_main-chapter-code/ch03.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -1485,7 +1485,8 @@
"id": "5a575458-a6da-4e54-8688-83e155f2de06",
"metadata": {},
"source": [
"- If we apply a dropout rate of 0.5 (50%), the non-dropped values will be scaled accordingly by a factor of 1/0.5 = 2."
"- If we apply a dropout rate of 0.5 (50%), the non-dropped values will be scaled accordingly by a factor of 1/0.5 = 2\n",
"- The scaling is calculated by the formula 1 / (1 - `dropout_rate`)"
]
},
{
Expand Down

0 comments on commit 1183fd7

Please sign in to comment.