New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问我想将列表里没有的大模型转成bmodel,应该怎么做? #24

Open

xinyinan9527 opened this issue Jun 26, 2024 · 1 comment

xinyinan9527 commented Jun 26, 2024

我想将https://huggingface.co/fla-hub/rwkv6-1.6B-finch/tree/main
这个模型用的线性attention，我想将其转成bmodel，让其在边缘设备上跑，请问应该怎么做？

Collaborator

chuxiaoyi2023 commented Jul 3, 2024

这个模型一看就很困难ovo，如果你对huggingface和cpp和onnx熟悉的话可以自己试着迁移，我们这边排的话可能要很晚才会适配

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment