Definition of FLOPs

[m-Just]

FLOPs = Floating-point operations.
FMAs = Floating-point multiplication-adds.
Based on the values you give, I think they should be FMAs instead of FLOPs, and the number of FLOPs is approximately 2 * FMAs. Could you please clarify? Thanks.

[albanie]

Hi @m-Just, that's correct, they are FMAs. It says this in the README, but it's not at the top. Perhaps I should move it up to make it easier to notice.

[m-Just]

Yeah, thanks for your confirmation! Great work~

[CMCDragonkai]

I wonder if you clarify that when NVIDIA publishes specs on their GPUs, are they talking about FLOPs or FMAs?