Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question on HF support #35

Closed
fmana opened this issue Jul 15, 2016 · 2 comments
Closed

Question on HF support #35

fmana opened this issue Jul 15, 2016 · 2 comments

Comments

@fmana
Copy link

fmana commented Jul 15, 2016

Hi,

I included the Nickel library into my tool and I'm up and running.
Till now I used ncclAllReduce with float 32 bufferes and ncclSum reduction.
Is there an easy way to have the API working with float 32 buffers but transfer and adding
realized with HF16 floats? (sum even emulated on float 32 but transfer at HF 16)

Thanks,
franco
@nluehr
Copy link
Contributor

nluehr commented Aug 5, 2016

Hi Franco,

There is no easy mechanism to accomplish this in NCCL today. But it would be a useful feature.

-Nathan

@spotluri
Copy link
Collaborator

spotluri commented May 6, 2019

We do not intend to support this in NCCL as it could affect other applications (like HPC) that do not expect it. We believe, higher level application-specific frameworks like DL FW/Horovod would be a better place to do such a conversion.

@spotluri spotluri closed this as completed May 6, 2019
@himanshucodz55 himanshucodz55 mentioned this issue Jul 25, 2022
Open
@raninbowlalala raninbowlalala mentioned this issue Jul 4, 2023
Open
@acphile acphile mentioned this issue Sep 29, 2023
Open
minsii pushed a commit to minsii/nccl that referenced this issue Nov 8, 2023
@pavanbalaji @facebook-github-bot
Comment out warnings in env check (NVIDIA#35)
507dda3 
Summary:

The warnings in env check recursively call the debug initialization,
which again calls the env initialization.  This causes a deadlock.

Differential Revision: D51127118
minsii pushed a commit to minsii/nccl that referenced this issue Nov 13, 2023
@facebook-github-bot
Comment out warnings in env check (NVIDIA#35)
f79e184 
Summary:
Pull Request resolved: facebookresearch#35

The warnings in env check recursively call the debug initialization,
which again calls the env initialization.  This causes a deadlock.

Reviewed By: kingchc

Differential Revision: D51127118

fbshipit-source-id: 7605d3f58d3207cc36316cf291caff9f79863d4f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@nluehr @spotluri @fmana