Skip to content

Commit

Permalink
Fix CI
Browse files Browse the repository at this point in the history
  • Loading branch information
yanbing-j committed Jul 28, 2024
1 parent b30667e commit 5f41c1e
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions test/test_ops.py
Original file line number Diff line number Diff line change
Expand Up @@ -271,6 +271,8 @@ def test_dequantize_tensor_core_tiled_layout_op(shape, inner_k_tiles, group_size
device = "cuda"

q = torch.randint(0, 16, shape, dtype=torch.int, device=device)
if TORCH_VERSION_AFTER_2_5:
q = (q[::, ::2] << 4 | q[::, 1::2]).to(torch.uint8)
packed_w = torch._convert_weight_to_int4pack(q, inner_k_tiles)
q_groups = k // group_size
scales = torch.randn(n, q_groups, dtype=torch.bfloat16, device=device)
Expand Down

0 comments on commit 5f41c1e

Please sign in to comment.