Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP][Native WebGPU] Remove explicit split operator in GQA #23909

Draft
wants to merge 1 commit into
base: sajandhy/webpu-ep-gqa-rotary
Choose a base branch
from

Conversation

satyajandhyala
Copy link
Contributor

@satyajandhyala satyajandhyala commented Mar 6, 2025

Description

Remove explicit split operator in GQA

Motivation and Context

Removing the explicit split operator will help improve the performance.

@satyajandhyala satyajandhyala added the ep:WebGPU ort-web webgpu provider label Mar 6, 2025
@satyajandhyala satyajandhyala changed the title Remove explicit split operator in GQA [WIP][Native WebGPU] Remove explicit split operator in GQA Mar 6, 2025
@satyajandhyala satyajandhyala force-pushed the sajandhy/webpu-ep-gqa-rotary-remove-explicit-split branch from 6801527 to 7b6965b Compare March 6, 2025 07:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:WebGPU ort-web webgpu provider
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant