Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
xyyimian committed Aug 21, 2024
1 parent 5c66b97 commit 5ddc656
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions nexa/gguf/nexa_inference_text.py
Original file line number Diff line number Diff line change
Expand Up @@ -106,6 +106,7 @@ def _load_model(self):
try:
from nexa.gguf.llama.llama import Llama
self.model = Llama(
embedding=self.params.get("embedding", False),
model_path=self.downloaded_path,
verbose=self.profiling,
chat_format=self.chat_format,
Expand Down

0 comments on commit 5ddc656

Please sign in to comment.