Skip to content

[passes] Revise LlamaRMSNorm fusion#304

Draft
seockho-kim wants to merge 2 commits intoSamsung:mainfrom
seockho-kim:fuse_llama_rmsnorm
Draft

[passes] Revise LlamaRMSNorm fusion#304
seockho-kim wants to merge 2 commits intoSamsung:mainfrom
seockho-kim:fuse_llama_rmsnorm

Conversation

@seockho-kim
Copy link
Contributor

  • Instead of changing LlamaRMSNorm forward(), all LlamaRMSNorm instances are replaced with FusedLlamaRMSNorm.
  • Fused module mapping is added to manage the replacement.
  • Related files are moved to passes from operators.

TICO-DCO-1.0-Signed-off-by: Seockho Kim seockho.kim@samsung.com

- Instead of changing forward(), all LlamaRMSNorm instances are replaced with FusedLlamaRMSNorm..
- Fused module mapping is added to manage the replacement.
- It's moved to passes from operators.

TICO-DCO-1.0-Signed-off-by: Seockho Kim seockho.kim@samsung.com
This commit fixes format error.

TICO-DCO-1.0-Signed-off-by: Seockho Kim seockho.kim@samsung.com
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant