Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump Xentropy Version #261

Merged
merged 10 commits into from
May 31, 2023
Merged

Bump Xentropy Version #261

merged 10 commits into from
May 31, 2023

Conversation

nik-mosaic
Copy link
Contributor

@nik-mosaic nik-mosaic commented May 31, 2023

v1.0.3 for Xentropy CUDA Lib (used for Fused CrossEntropy) should support H100s (sm_90), while v0.2.8 does not. This PR upgrades the default version of Xentropy.

@nik-mosaic nik-mosaic requested a review from vchiley May 31, 2023 17:53
@nik-mosaic nik-mosaic changed the title Bump Xentropy CUDA Lib Version Bump FlashAttention and Xentropy Version May 31, 2023
setup.py Outdated Show resolved Hide resolved
nik-mosaic and others added 3 commits May 31, 2023 11:20
Co-authored-by: Vitaliy Chiley <6439018+vchiley@users.noreply.github.com>
Co-authored-by: Vitaliy Chiley <6439018+vchiley@users.noreply.github.com>
Co-authored-by: Vitaliy Chiley <6439018+vchiley@users.noreply.github.com>
@nik-mosaic nik-mosaic changed the title Bump FlashAttention and Xentropy Version Bump Xentropy Version May 31, 2023
@nik-mosaic nik-mosaic requested a review from vchiley May 31, 2023 21:59
Copy link
Contributor

@vchiley vchiley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@nik-mosaic nik-mosaic merged commit 769ddf5 into main May 31, 2023
@nik-mosaic nik-mosaic deleted the nik/bump-xentropy branch May 31, 2023 22:04
bmosaicml pushed a commit that referenced this pull request Jun 6, 2023
bmosaicml pushed a commit that referenced this pull request Jun 8, 2023
---------

Co-authored-by: Vitaliy Chiley <6439018+vchiley@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants