Is there support for mamba-based models, or am I doing something wrong?

[zvxayr]

When using this model, using "+" behaves as if I did "+=". The data bleeds even when I did not store the state into a new variable as shown below.

Is there anything wrong with the code? Is there a correct model to use than LlamaCpp?

[riedgar-ms]

That looks like the right way to load the model. I take it you were expecting the second cell to come back with "What passage, that's the first thing you've said to me" (or something similar)?

[zvxayr]

Yes. I couldn't regenerate answers with mamba models. I would need to reinitialize the model if I wanted to clear the memory.

[riedgar-ms]

@Harsha-Nori @paulbkoch would this be due to the caching the models do internally?