Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

soundtorm checkpoint loading issue #9

Open
ehosseiniasl opened this issue Sep 5, 2024 · 0 comments
Open

soundtorm checkpoint loading issue #9

ehosseiniasl opened this issue Sep 5, 2024 · 0 comments

Comments

@ehosseiniasl
Copy link

ehosseiniasl commented Sep 5, 2024

Hi @ZhangXInFD
I get the following error loading the checkpoint

checkpoint SoundStorm_best_dev.pt

command:

from soundstorm_speechtokenizer import SoundStorm, ConformerWrapper
soundstorm.load('/home/ehosseiniasl/models/soundstorm_speechtokenizer/SoundStorm_best_dev.pt')
RuntimeError: Error(s) in loading state_dict for SoundStorm:
	Missing key(s) in state_dict: "net.conformer.layers.0.conv.net1.0.weight", "net.conformer.layers.0.conv.net1.0.bias", "net.conformer.layers.0.conv.net1.2.weight", "net.conformer.layers.0.conv.net1.2.bias", "net.conformer.layers.0.conv.ds_conv.conv.weight", "net.conformer.layers.0.conv.ds_conv.conv.bias", "net.conformer.layers.0.conv.net2.1.gamma", "net.conformer.layers.0.conv.net2.2.weight", "net.conformer.layers.0.conv.net2.2.bias", "net.conformer.layers.1.conv.net1.0.weight", "net.conformer.layers.1.conv.net1.0.bias", "net.conformer.layers.1.conv.net1.2.weight", "net.conformer.layers.1.conv.net1.2.bias", "net.conformer.layers.1.conv.ds_conv.conv.weight", "net.conformer.layers.1.conv.ds_conv.conv.bias", "net.conformer.layers.1.conv.net2.1.gamma", "net.conformer.layers.1.conv.net2.2.weight", "net.conformer.layers.1.conv.net2.2.bias", "net.conformer.layers.2.conv.net1.0.weight", "net.conformer.layers.2.conv.net1.0.bias", "net.conformer.layers.2.conv.net1.2.weight", "net.conformer.layers.2.conv.net1.2.bias", "net.conformer.layers.2.conv.ds_conv.conv.weight", "net.conformer.layers.2.conv.ds_conv.conv.bias", "net.conformer.layers.2.conv.net2.1.gamma", "net.conformer.layers.2.conv.net2.2.weight", "net.conformer.layers.2.conv.net2.2.bias", "net.conformer.layers.3.conv.net1.0.weight", "net.conformer.layers.3.conv.net1.0.bias", "net.conformer.layers.3.conv.net1.2.weight", "net.conformer.layers.3.conv.net1.2.bias", "net.conformer.layers.3.conv.ds_conv.conv.weight", "net.conformer.layers.3.conv.ds_conv.conv.bias", "net.conformer.layers.3.conv.net2.1.gamma", "net.conformer.layers.3.conv.net2.2.weight", "net.conformer.layers.3.conv.net2.2.bias", "net.conformer.layers.4.conv.net1.0.weight", "net.conformer.layers.4.conv.net1.0.bias", "net.conformer.layers.4.conv.net1.2.weight", "net.conformer.layers.4.conv.net1.2.bias", "net.conformer.layers.4.conv.ds_conv.conv.weight", "net.conformer.layers.4.conv.ds_conv.conv.bias", "net.conformer.layers.4.conv.net2.1.gamma", "net.conformer.layers.4.conv.net2.2.weight", "net.conformer.layers.4.conv.net2.2.bias", "net.conformer.layers.5.conv.net1.0.weight", "net.conformer.layers.5.conv.net1.0.bias", "net.conformer.layers.5.conv.net1.2.weight", "net.conformer.layers.5.conv.net1.2.bias", "net.conformer.layers.5.conv.ds_conv.conv.weight", "net.conformer.layers.5.conv.ds_conv.conv.bias", "net.conformer.layers.5.conv.net2.1.gamma", "net.conformer.layers.5.conv.net2.2.weight", "net.conformer.layers.5.conv.net2.2.bias", "net.conformer.layers.6.conv.net1.0.weight", "net.conformer.layers.6.conv.net1.0.bias", "net.conformer.layers.6.conv.net1.2.weight", "net.conformer.layers.6.conv.net1.2.bias", "net.conformer.layers.6.conv.ds_conv.conv.weight", "net.conformer.layers.6.conv.ds_conv.conv.bias", "net.conformer.layers.6.conv.net2.1.gamma", "net.conformer.layers.6.conv.net2.2.weight", "net.conformer.layers.6.conv.net2.2.bias", "net.conformer.layers.7.conv.net1.0.weight", "net.conformer.layers.7.conv.net1.0.bias", "net.conformer.layers.7.conv.net1.2.weight", "net.conformer.layers.7.conv.net1.2.bias", "net.conformer.layers.7.conv.ds_conv.conv.weight", "net.conformer.layers.7.conv.ds_conv.conv.bias", "net.conformer.layers.7.conv.net2.1.gamma", "net.conformer.layers.7.conv.net2.2.weight", "net.conformer.layers.7.conv.net2.2.bias", "net.conformer.layers.8.conv.net1.0.weight", "net.conformer.layers.8.conv.net1.0.bias", "net.conformer.layers.8.conv.net1.2.weight", "net.conformer.layers.8.conv.net1.2.bias", "net.conformer.layers.8.conv.ds_conv.conv.weight", "net.conformer.layers.8.conv.ds_conv.conv.bias", "net.conformer.layers.8.conv.net2.1.gamma", "net.conformer.layers.8.conv.net2.2.weight", "net.conformer.layers.8.conv.net2.2.bias", "net.conformer.layers.9.conv.net1.0.weight", "net.conformer.layers.9.conv.net1.0.bias", "net.conformer.layers.9.conv.net1.2.weight", "net.conformer.layers.9.conv.net1.2.bias", "net.conformer.layers.9.conv.ds_conv.conv.weight", "net.conformer.layers.9.conv.ds_conv.conv.bias", "net.conformer.layers.9.conv.net2.1.gamma", "net.conformer.layers.9.conv.net2.2.weight", "net.conformer.layers.9.conv.net2.2.bias", "net.conformer.layers.10.conv.net1.0.weight", "net.conformer.layers.10.conv.net1.0.bias", "net.conformer.layers.10.conv.net1.2.weight", "net.conformer.layers.10.conv.net1.2.bias", "net.conformer.layers.10.conv.ds_conv.conv.weight", "net.conformer.layers.10.conv.ds_conv.conv.bias", "net.conformer.layers.10.conv.net2.1.gamma", "net.conformer.layers.10.conv.net2.2.weight", "net.conformer.layers.10.conv.net2.2.bias", "net.conformer.layers.11.conv.net1.0.weight", "net.conformer.layers.11.conv.net1.0.bias", "net.conformer.layers.11.conv.net1.2.weight", "net.conformer.layers.11.conv.net1.2.bias", "net.conformer.layers.11.conv.ds_conv.conv.weight", "net.conformer.layers.11.conv.ds_conv.conv.bias", "net.conformer.layers.11.conv.net2.1.gamma", "net.conformer.layers.11.conv.net2.2.weight", "net.conformer.layers.11.conv.net2.2.bias". 
	Unexpected key(s) in state_dict: "net.conformer.layers.0.conv.net.0.weight", "net.conformer.layers.0.conv.net.0.bias", "net.conformer.layers.0.conv.net.2.weight", "net.conformer.layers.0.conv.net.2.bias", "net.conformer.layers.0.conv.net.4.conv.weight", "net.conformer.layers.0.conv.net.4.conv.bias", "net.conformer.layers.0.conv.net.6.gamma", "net.conformer.layers.0.conv.net.7.weight", "net.conformer.layers.0.conv.net.7.bias", "net.conformer.layers.1.conv.net.0.weight", "net.conformer.layers.1.conv.net.0.bias", "net.conformer.layers.1.conv.net.2.weight", "net.conformer.layers.1.conv.net.2.bias", "net.conformer.layers.1.conv.net.4.conv.weight", "net.conformer.layers.1.conv.net.4.conv.bias", "net.conformer.layers.1.conv.net.6.gamma", "net.conformer.layers.1.conv.net.7.weight", "net.conformer.layers.1.conv.net.7.bias", "net.conformer.layers.2.conv.net.0.weight", "net.conformer.layers.2.conv.net.0.bias", "net.conformer.layers.2.conv.net.2.weight", "net.conformer.layers.2.conv.net.2.bias", "net.conformer.layers.2.conv.net.4.conv.weight", "net.conformer.layers.2.conv.net.4.conv.bias", "net.conformer.layers.2.conv.net.6.gamma", "net.conformer.layers.2.conv.net.7.weight", "net.conformer.layers.2.conv.net.7.bias", "net.conformer.layers.3.conv.net.0.weight", "net.conformer.layers.3.conv.net.0.bias", "net.conformer.layers.3.conv.net.2.weight", "net.conformer.layers.3.conv.net.2.bias", "net.conformer.layers.3.conv.net.4.conv.weight", "net.conformer.layers.3.conv.net.4.conv.bias", "net.conformer.layers.3.conv.net.6.gamma", "net.conformer.layers.3.conv.net.7.weight", "net.conformer.layers.3.conv.net.7.bias", "net.conformer.layers.4.conv.net.0.weight", "net.conformer.layers.4.conv.net.0.bias", "net.conformer.layers.4.conv.net.2.weight", "net.conformer.layers.4.conv.net.2.bias", "net.conformer.layers.4.conv.net.4.conv.weight", "net.conformer.layers.4.conv.net.4.conv.bias", "net.conformer.layers.4.conv.net.6.gamma", "net.conformer.layers.4.conv.net.7.weight", "net.conformer.layers.4.conv.net.7.bias", "net.conformer.layers.5.conv.net.0.weight", "net.conformer.layers.5.conv.net.0.bias", "net.conformer.layers.5.conv.net.2.weight", "net.conformer.layers.5.conv.net.2.bias", "net.conformer.layers.5.conv.net.4.conv.weight", "net.conformer.layers.5.conv.net.4.conv.bias", "net.conformer.layers.5.conv.net.6.gamma", "net.conformer.layers.5.conv.net.7.weight", "net.conformer.layers.5.conv.net.7.bias", "net.conformer.layers.6.conv.net.0.weight", "net.conformer.layers.6.conv.net.0.bias", "net.conformer.layers.6.conv.net.2.weight", "net.conformer.layers.6.conv.net.2.bias", "net.conformer.layers.6.conv.net.4.conv.weight", "net.conformer.layers.6.conv.net.4.conv.bias", "net.conformer.layers.6.conv.net.6.gamma", "net.conformer.layers.6.conv.net.7.weight", "net.conformer.layers.6.conv.net.7.bias", "net.conformer.layers.7.conv.net.0.weight", "net.conformer.layers.7.conv.net.0.bias", "net.conformer.layers.7.conv.net.2.weight", "net.conformer.layers.7.conv.net.2.bias", "net.conformer.layers.7.conv.net.4.conv.weight", "net.conformer.layers.7.conv.net.4.conv.bias", "net.conformer.layers.7.conv.net.6.gamma", "net.conformer.layers.7.conv.net.7.weight", "net.conformer.layers.7.conv.net.7.bias", "net.conformer.layers.8.conv.net.0.weight", "net.conformer.layers.8.conv.net.0.bias", "net.conformer.layers.8.conv.net.2.weight", "net.conformer.layers.8.conv.net.2.bias", "net.conformer.layers.8.conv.net.4.conv.weight", "net.conformer.layers.8.conv.net.4.conv.bias", "net.conformer.layers.8.conv.net.6.gamma", "net.conformer.layers.8.conv.net.7.weight", "net.conformer.layers.8.conv.net.7.bias", "net.conformer.layers.9.conv.net.0.weight", "net.conformer.layers.9.conv.net.0.bias", "net.conformer.layers.9.conv.net.2.weight", "net.conformer.layers.9.conv.net.2.bias", "net.conformer.layers.9.conv.net.4.conv.weight", "net.conformer.layers.9.conv.net.4.conv.bias", "net.conformer.layers.9.conv.net.6.gamma", "net.conformer.layers.9.conv.net.7.weight", "net.conformer.layers.9.conv.net.7.bias", "net.conformer.layers.10.conv.net.0.weight", "net.conformer.layers.10.conv.net.0.bias", "net.conformer.layers.10.conv.net.2.weight", "net.conformer.layers.10.conv.net.2.bias", "net.conformer.layers.10.conv.net.4.conv.weight", "net.conformer.layers.10.conv.net.4.conv.bias", "net.conformer.layers.10.conv.net.6.gamma", "net.conformer.layers.10.conv.net.7.weight", "net.conformer.layers.10.conv.net.7.bias", "net.conformer.layers.11.conv.net.0.weight", "net.conformer.layers.11.conv.net.0.bias", "net.conformer.layers.11.conv.net.2.weight", "net.conformer.layers.11.conv.net.2.bias", "net.conformer.layers.11.conv.net.4.conv.weight", "net.conformer.layers.11.conv.net.4.conv.bias", "net.conformer.layers.11.conv.net.6.gamma", "net.conformer.layers.11.conv.net.7.weight", "net.conformer.layers.11.conv.net.7.bias". 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant