Skip to content

Do not mark replicated weights as tensor-model-parallel - #715

Open
wenchenvincent wants to merge 3 commits into
devfrom
fix/replicated-weight-gradnorm
Open

Do not mark replicated weights as tensor-model-parallel#715
wenchenvincent wants to merge 3 commits into
devfrom
fix/replicated-weight-gradnorm

Apply the same fix to LayerNormLinear and GroupedLinear

f0c9f0e
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar