RuntimeError: probability tensor contains either inf, nan or element < 0

[AI-Zebra]

I have fine tuned a llama 7b model and when I try to run the fine tuned model I get below error:

python generate/lora.py
16-true
Loading model ...
Time to load model: 8.74 seconds.
Traceback (most recent call last):
File "/home/azureuser/lit-llama/generate/lora.py", line 129, in
CLI(main)
File "/usr/local/lib/python3.10/dist-packages/jsonargparse/_cli.py", line 96, in CLI
return _run_component(components, cfg_init)
File "/usr/local/lib/python3.10/dist-packages/jsonargparse/_cli.py", line 181, in _run_component
return component(**cfg)
File "/home/azureuser/lit-llama/generate/lora.py", line 101, in main
output = generate(
File "/usr/local/lib/python3.10/dist-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/home/azureuser/lit-llama/generate.py", line 74, in generate
idx_next = torch.multinomial(probs, num_samples=1).to(dtype=dtype)
RuntimeError: probability tensor contains either inf, nan or element < 0