Extensions: add integration testing for archive extraction #10733
Description
What would you like to be added?
We should add integration tests for our tar/zip file extraction.
There is a WIP pr for this out here #10260
Why is this needed?
We broke this both on windows and then separately on Linux previously leading up to the extensions launch. We need some good tests that run on windows and Linux to validate this behavior for both zip and tar files.