Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

error about vision tower #5

Open
zhouzihui2001 opened this issue Dec 28, 2024 · 0 comments
Open

error about vision tower #5

zhouzihui2001 opened this issue Dec 28, 2024 · 0 comments

Comments

@zhouzihui2001
Copy link

Hello! I find that the path of vision tower in the fineturn .sh file is:
export VIT_PATH=${CKPT}/vision_tower
However, there is no folder in the pretrained weight called 'vision_tower'. As a result, I downloaded the openai/clip-vit-large-patch14-336 and the weights of the vision tower you provided, and used it as VIT_PATH. When I am training, there is something wrong with the vision tower:
image
Could you please tell me how to use the weight of the vision tower and solve the problem? Thanks a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant