Skip to content

Commit

Permalink
format
Browse files Browse the repository at this point in the history
  • Loading branch information
SageMoore committed Dec 6, 2024
1 parent 134ae2f commit f2a4623
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions vllm/compilation/fusion.py
Original file line number Diff line number Diff line change
Expand Up @@ -230,9 +230,9 @@ def process_matches(self, graph: torch.fx.Graph):
kwargs["epsilon"] = 1e-5 # Currently hard-coded in RMSNorm

fused_node = graph.call_function(
auto_functionalized, (
torch.ops._C.fused_add_rms_norm_static_fp8_quant.default,
),
auto_functionalized,
(torch.ops._C.fused_add_rms_norm_static_fp8_quant.default,
),
kwargs=kwargs)

graph.inserting_after(fused_node)
Expand Down

0 comments on commit f2a4623

Please sign in to comment.