Skip to content
This repository was archived by the owner on Nov 27, 2024. It is now read-only.

Conversation

@saddam213
Copy link
Member

Latest OnnxRuntime includes System.Numerics.TensorPrimitives which has some Span based Tensor math operations

This PR will aim to move all possible CPU tensor math to use these new functions, mainly TensorHelper, Scheduler and Diffuser classes

@saddam213
Copy link
Member Author

saddam213 commented Dec 21, 2023

After TensorHelper update gained about 5-10% performance

LCM 6 Steps: 1280ms -> 880ms avg 100 images

@saddam213 saddam213 merged commit 98e5264 into master Dec 21, 2023
@saddam213 saddam213 deleted the CpuMath branch December 21, 2023 06:33
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant