Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time taken to initialize model #216

Open
VanshBil opened this issue May 24, 2024 · 0 comments
Open

Time taken to initialize model #216

VanshBil opened this issue May 24, 2024 · 0 comments

Comments

@VanshBil
Copy link

VanshBil commented May 24, 2024

backend := gorgonnx.NewGraph()
model := onnx.NewModel(backend)
err = model.UnmarshalBinary(binaryData)

This is the way to initialize model but to make multiple predictions do I need to do these steps every time or is there a way to skip the UnmarshalBinary step as my model is of big size and this takes more than 5ms and doing this for every prediction is not possible and if I don't do this the model gives increasing output for each input

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant