Skip to content

Commit

Permalink
Minor changes
Browse files Browse the repository at this point in the history
  • Loading branch information
MartinGleize committed Dec 31, 2024
1 parent 8d7d29d commit aa73146
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/model_executor/models/fairseq2_llama.py
Original file line number Diff line number Diff line change
Expand Up @@ -65,12 +65,12 @@ def load_weights(self, weights: Iterable[Tuple[str,
mapper=hf_to_vllm_mapper,
)

# This function is used to reshape the fairseq2 weight format
def reshape_fairseq2_weights(
self,
name: str,
loaded_weight: torch.Tensor,
) -> Tuple[str, torch.Tensor]:
"""Reshape fairseq2's K and Q weights."""

def permute(w: torch.Tensor, n_heads: int):
attn_in = self.config.head_dim * n_heads
Expand Down

0 comments on commit aa73146

Please sign in to comment.