Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support to traverse all python collection objects (#84079) #773

Closed
wants to merge 1 commit into from

Conversation

ejguan
Copy link
Contributor

@ejguan ejguan commented Sep 14, 2022

Summary:
Fixes #752

This PR makes traverse function supporting more collections data structures from Python. The getstate_hook will be invoked after custom __getstate__ function

X-link: pytorch/pytorch#84079

Differential Revision: D39357886

Pulled By: ejguan

@facebook-github-bot facebook-github-bot added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported labels Sep 14, 2022
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D39357886

ejguan added a commit to ejguan/data that referenced this pull request Sep 19, 2022
Summary:
Pull Request resolved: pytorch#773

Fixes pytorch#752

This PR makes `traverse` function supporting more collections data structures from Python. The `getstate_hook` will be invoked after custom `__getstate__` function

X-link: pytorch/pytorch#84079

Differential Revision: D39357886

Pulled By: ejguan

fbshipit-source-id: 61f8011a028306978185cc0aa1e78b2e7b166a12
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D39357886

ejguan added a commit to ejguan/data that referenced this pull request Sep 20, 2022
Summary:
Pull Request resolved: pytorch#773

Fixes pytorch#752

This PR makes `traverse` function supporting more collections data structures from Python. The `getstate_hook` will be invoked after custom `__getstate__` function

X-link: pytorch/pytorch#84079

Differential Revision: D39357886

Pulled By: ejguan

fbshipit-source-id: b4976d225d259607a9580c2fb9c7820a3fbe85dd
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D39357886

Summary:
Pull Request resolved: pytorch#773

Fixes pytorch#752

This PR makes `traverse` function supporting more collections data structures from Python. The `getstate_hook` will be invoked after custom `__getstate__` function

X-link: pytorch/pytorch#84079

Differential Revision: D39357886

Pulled By: ejguan

fbshipit-source-id: d4d1b961a933b42a27e5243c1be487c954be65a8
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D39357886

ejguan added a commit to ejguan/pytorch that referenced this pull request Sep 21, 2022
Summary:
X-link: pytorch/data#773

Fixes pytorch/data#752

This PR makes `traverse` function supporting more collections data structures from Python. The `getstate_hook` will be invoked after custom `__getstate__` function

Pull Request resolved: pytorch#84079

Differential Revision: D39357886

Pulled By: ejguan

fbshipit-source-id: 3c0629f7a355d2f7a67c7224a49b2b2721592778
@pmeier
Copy link
Contributor

pmeier commented Sep 23, 2022

This looks like a possible offender of the failures we are currently seeing in torchvision CI: https://github.com/pytorch/vision/actions/runs/3112529418/jobs/5046049095. @ejguan could you have a look?

@ejguan
Copy link
Contributor Author

ejguan commented Sep 23, 2022

@pmeier I am investigating the internal synchronization problem. The corresponding PR from PT Core has not been landed pytorch/pytorch#84079
The CI failure should be resolved when that PR is merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Traversal of datapipe graphs broken for pipelines containing SampleMultiplexerDataPipe
3 participants