[v0.4.0] Release Tracker

[ejguan]

🚀 The feature

We cut a release branch for the 0.4.0 release at the same time with PyTorch.

Cherry-pick (until 06/13/22)

We will keep cherry-picking all PRs landed to main branch until PyTorch 1.12.0 official released.
When you add PR against release branch, please link the landed PR from main branch.

RC-release can be found in https://download.pytorch.org/whl/test/cpu/torch_test.html

Motivation, pitch

Track issues for cherry-pick.

Alternatives

No response

Additional context

No response

[ejguan]

Here is the list of PR needs to be cherry-picked:

• GDriveReader: handle Virus Scan Warning using confirm=t #442
• update s3 test cases #464
• Fix TF Record test #471
• Add conda token for test channel #472
• Enable AWSSDK on Linux by statically linking OpenSSL and cURL #421
• Add Token for Conda RC Release #481
• Fix workspace path #486
• Update tutorial about placing sharding_filter #487
• Add list_file() functional API to FSSpecFileLister and IoPathFileLister #463
• Improve fsspec DataPipe to accept extra keyword arguments #495
• Add instructions about ImportError for portalocker #506
• Re-land Use PyTorch RC release on release branch (#510) #514
• [datapipe] Pass through kwargs to json.loads call in JsonParser #518
• Fix target folder for official release #521
• 0b2c604
• Add README for DataLoader2 #526
• Update documentation for S3 DataPipes #534
• Fix S3 documentation #542

[NivekT]

Here are the ones that I cherry-picked:

• Fixing tutorial with DataLoader #458
• Small fix to functional name and usage example #440
• [DataPipe] Adding a 's' to the functional names of open/list DataPipes #479
• Add support for hf datasets reader #490
• add utitlity to visualize datapipe graphs #330
• Improve graph visualization documentation #504
• Update examples and tutorial after automatic sharding has landed #505
• Update examples to avoid lambdas #524
• Small README update for DataLoader2 #541
• Update changed links in documentation #543

[ejguan]

Cherry-picking phase ends. We will only allow commits that contain critical fixes for the 0.4.0 release.

[ejguan]

Closing the issue since TorchData has finished 0.4.0 release.