diff --git a/CHANGELOG.md b/CHANGELOG.md
index 737d6be289a..b463be77c0b 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -7,8 +7,6 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## Unreleased
 
-Nothing so far!
-
 ### Added
 
 - Added a module `allennlp.nn.parallel` with a new base class, `DdpAccelerator`, which generalizes
@@ -30,6 +28,7 @@ Nothing so far!
 ### Fixed
 
 - Fixed a mispelling: the parameter `contructor_extras` in `Lazy()` is now correctly called `constructor_extras`.
+- Fixed broken links in `allennlp.nn.initializers` docs.
 
 ### Changed
 
diff --git a/allennlp/nn/initializers.py b/allennlp/nn/initializers.py
index 7d12dd9ba8a..b97dc562e36 100644
--- a/allennlp/nn/initializers.py
+++ b/allennlp/nn/initializers.py
@@ -7,21 +7,21 @@
 
 The available initialization functions are
 
-* ["normal"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.normal_)
-* ["uniform"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.uniform_)
-* ["constant"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.constant_)
-* ["eye"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.eye_)
-* ["dirac"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.dirac_)
-* ["xavier_uniform"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.xavier_uniform_)
-* ["xavier_normal"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.xavier_normal_)
-* ["kaiming_uniform"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.kaiming_uniform_)
-* ["kaiming_normal"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.kaiming_normal_)
-* ["orthogonal"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.orthogonal_)
-* ["sparse"](https://pytorch.org/docs/master/nn.html?highlight=orthogonal#torch.nn.init.sparse_)
+* ["normal"](https://pytorch.org/docs/master/nn.init.html?highlight=uniform#torch.nn.init.normal_)
+* ["uniform"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.uniform_)
+* ["constant"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.constant_)
+* ["eye"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.eye_)
+* ["dirac"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.dirac_)
+* ["xavier_uniform"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.xavier_uniform_)
+* ["xavier_normal"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.xavier_normal_)
+* ["kaiming_uniform"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.kaiming_uniform_)
+* ["kaiming_normal"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.kaiming_normal_)
+* ["orthogonal"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.orthogonal_)
+* ["sparse"](https://pytorch.org/docs/master/nn.init.html?highlight=orthogonal#torch.nn.init.sparse_)
 * ["block_orthogonal"](./initializers.md#block_orthogonal)
 * ["uniform_unit_scaling"](./initializers.md#uniform_unit_scaling)
-* ["pretrained"](./initializers.md#PretrainedModelInitializer)
-"""
+* ["pretrained"](./initializers.md#pretrainedmodelinitializer)
+"""  # noqa: E501
 import logging
 import re
 import math