(temp workaround for Triton bug) (#306)

Triton's autotuner had a bug (fixed in triton-lang/triton@184fb53 ) that we happen to trigger - this PR is a temp. workaround before we patch/update Triton.
ROCm · Dec 5, 2024 · ccdb5b8 · ccdb5b8
1 parent 68fdfc2
commit ccdb5b8
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/vllm/attention/ops/triton_flash_attention.py b/vllm/attention/ops/triton_flash_attention.py
@@ -367,12 +367,12 @@ def attn_fwd(
     IS_CAUSAL: tl.constexpr,
     BLOCK_M: tl.constexpr,
     BLOCK_DMODEL: tl.constexpr,
+    USE_FP8: tl.constexpr,
     BLOCK_N: tl.constexpr,
     PRE_LOAD_V: tl.constexpr,
     BIAS_TYPE: tl.constexpr,
     ENABLE_DROPOUT: tl.constexpr,
     RETURN_ENCODED_SOFTMAX: tl.constexpr,
-    USE_FP8: tl.constexpr,
 ):
     start_m = tl.program_id(0)
     off_h_q = tl.program_id(1)