Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

perf: add some static benchmarks #508

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

perf: add some static benchmarks #508

wants to merge 4 commits into from
+434 −0

Conversation

avik-pal
Copy link
Collaborator

@avik-pal avik-pal commented Jan 10, 2025 •
edited
Loading

KAN

CPU

Kind Fwd Vanilla Fwd Reactant Fwd Reactant SpeedUp Bwd Zygote Bwd Reactant Bwd Reactant SpeedUp
MLP 0.000504229 0.000517288 0.9747548754272283 0.001275736 0.00091808 1.389569536423841
KAN1 0.00637513 0.002134405 2.986841766206507 0.015504896 0.004843588 3.201117848999543
KAN2 0.005651889 0.001934863 2.9210796836778625 0.014421515 0.004603253 3.1328964538772905

GPU

Kind Fwd Vanilla Fwd Reactant Fwd Reactant SpeedUp Bwd Zygote Bwd Reactant Bwd Reactant SpeedUp
MLP 0.000161916 7.392e-5 2.190422077922078 0.000502497 8.827e-5 5.692726860768098
KAN1 0.00035248 8.2417e-5 4.276787555965396 0.001132969 0.000111215 10.187195971766398
KAN2 0.000260817 7.7983e-5 3.344536629778285 0.000888154 0.000103864 8.551124547485173

HNN (2nd Order AD)

CPU

Kind Fwd Vanilla Fwd Reactant Fwd Reactant SpeedUp Bwd Zygote Bwd Reactant Bwd Reactant SpeedUp
HNN 0.012209751 0.002101077 5.811186834180757 0.173089096 0.004597676 37.64708430955117

GPU

Kind Fwd Vanilla Fwd Reactant Fwd Reactant SpeedUp Bwd Zygote Bwd Reactant Bwd Reactant SpeedUp
HNN 0.000681027 8.4721e-5 8.038467440186022 0.003330234 0.00012123 27.470378619153674

@avik-pal avik-pal force-pushed the ap/perf_static branch 5 times, most recently from f0101da to 767bb9f Compare January 11, 2025 21:01
@avik-pal avik-pal force-pushed the ap/new_opts branch 3 times, most recently from 625ba8f to 5482315 Compare January 16, 2025 03:21
Base automatically changed from ap/new_opts to main January 16, 2025 04:50
An error occurred while trying to automatically change base from ap/new_opts to main January 16, 2025 04:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@avik-pal