Re-enable debug extension tests on Windows

[elliette]

Debug extension tests have been disabled on Windows for 3 years. We should re-enable them to make sure we are testing the extension on Windows machines. See discussion in #1717, there are probably a handful of changes that will need to be made to get them to work.