[benchmarks] Add inference-only roofline for float8

[drisspg]

Summary

  # Float8 tensorwise (default)
 python benchmarks/float8/float8_inference_roofline.py benchmarks/data/output.csv --recipe_name=tensorwise --do_benchmarks=False

  # Float8 rowwise  
 python benchmarks/float8/float8_inference_roofline.py benchmarks/data/output.csv --recipe_name=rowwise --do_benchmarks=False

  # MX format
 python benchmarks/float8/float8_inference_roofline.py benchmarks/data/output.csv --recipe_name=mxfp8 --do_benchmarks=False
  
  # Nvfp4
 python benchmarks/float8/float8_inference_roofline.py benchmarks/data/output.csv --recipe_name=nvfp4 --do_benchmarks=False
  

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/3167

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 2c7cd43 with merge base 596da93 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[vkuzo]

thoughts about putting it here instead? https://github.com/pytorch/ao/blob/main/benchmarks/float8/float8_inference_roofline.py

[drisspg]

whoops didnt see that one yeah I can move over

[vkuzo]

nice!