We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
elif isinstance(module, nn.LayerNorm) or isinstance(module, RMSNorm): module.bias.data.zero_()
class RMSNorm(nn.Module): def init(self, hidden_size, eps=1e-5): super().init() self.weight = nn.Parameter(torch.ones(hidden_size)) self.eps = eps
文件中的RMSNorm类似乎并不包含bias这个参数,该行函数会导致使用transformers库加载模型时报错?请帮忙确认是代码的问题还是我的运行方式错误?
The text was updated successfully, but these errors were encountered:
No branches or pull requests
elif isinstance(module, nn.LayerNorm) or isinstance(module, RMSNorm):
module.bias.data.zero_()
class RMSNorm(nn.Module):
def init(self, hidden_size, eps=1e-5):
super().init()
self.weight = nn.Parameter(torch.ones(hidden_size))
self.eps = eps
文件中的RMSNorm类似乎并不包含bias这个参数,该行函数会导致使用transformers库加载模型时报错?请帮忙确认是代码的问题还是我的运行方式错误?
The text was updated successfully, but these errors were encountered: