Fix all existing type errors

[gjoseph92]

For #129, we'll have to first fix the handful of type errors that exist in the code. Note that some of them indicate actual (rare) bugs! # type: ignore is almost always not the right solution.