https://docs.pytorch.org/ao/stable/quantization_overview.html#basic-dtypes
torch.int1 to torch.int7 available in pytorch 2.6 and later torch.int1 到 torch.int7 在 pytorch 2.6 及更高版本中可用
i try pytorch 2.5.1+cuda 12.1 its not work, pytorch 2.6+12.4 is work