Add static quant to float8 #3252

Job	Run time
test (CPU 2.2.2, linux.4xlarge, torch==2.2.2 --index-url https://download.pytorch.org/whl/cpu "nu... / linux-job	4m 11s
test (CPU Nightly (Aug 29, 2024), linux.4xlarge, --pre torch==2.5.0.dev20240829+cpu --index-url h... / linux-job	7m 34s
test (CPU 2.3, linux.4xlarge, torch==2.3.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job	6m 9s
test (CPU 2.4, linux.4xlarge, torch==2.4.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job	7m 35s
test (CUDA 2.2.2, linux.g5.12xlarge.nvidia.gpu, torch==2.2.2 "numpy<2" , cuda, 12.1) / linux-job	15m 27s
test (CUDA 2.3, linux.g5.12xlarge.nvidia.gpu, torch==2.3.0, cuda, 12.1) / linux-job	23m 4s
test (CUDA 2.4, linux.g5.12xlarge.nvidia.gpu, torch==2.4.0, cuda, 12.1) / linux-job	30m 42s
test (CUDA Nightly (Aug 29, 2024), linux.g5.12xlarge.nvidia.gpu, --pre torch==2.5.0.dev20240829+c... / linux-job	45m 50s
	2h 20m 32s

Provide feedback