decompressor bzip2 support

[lezwon]

Fixes #309

Changes

• Added bzip2 support in decompressor
• Added Bz2FileLoader

[NivekT]

LGTM! Thanks for submitting this PR!

Just a few nit inline comments.

Also, can you add the new DataPipe to the serialization test?

Add (iterdp.Bz2FileLoader, None, (), {}), here (after BucketBatcher):

data/test/test_serialization.py

Lines 139 to 142 in 0cf73aa

	def test_serializable(self):
	picklable_datapipes: List = [
	(iterdp.BucketBatcher, IterableWrapper([0, 0, 0, 0, 0, 0, 0]), (5,), {}),
	(

And before Decompressor, add iterdp.Bz2FileLoader,:

data/test/test_serialization.py

Lines 258 to 259 in 0cf73aa

	dp_skip_comparison = {
	iterdp.Decompressor,

[facebook-github-bot]

@NivekT has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[NivekT]

Hi @lezwon, can you rebase this PR? This is because __init__.pyi has been removed by another PR, so I need a rebase before I can merge. Thanks!

[facebook-github-bot]

@NivekT has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[lezwon]

@NivekT I see some internal tests have failed. Can you help me out here so I can fix them?

[NivekT]

@NivekT I see some internal tests have failed. Can you help me out here so I can fix them?

Everything is fine. Thanks for double-checking.