Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Models used? #50

Open
matalab opened this issue Mar 20, 2024 · 3 comments
Open

Models used? #50

matalab opened this issue Mar 20, 2024 · 3 comments

Comments

@matalab
Copy link

matalab commented Mar 20, 2024

Is this library using the most recent Perplexity AI models? If not, how to define model(s) to be utilized?
Asking because I noticed that I get different result than when using Perplexity AI web chat...

@matalab
Copy link
Author

matalab commented Mar 20, 2024

How are models listed in def _c(self, prompt: str, model: str) of labs.py related to models listed on ?
Is it updated or needs to be updated with current models in Perplexity AI?

def _c(self, prompt: str, model: str) -> dict:
    assert self.finished, "already searching"
    assert model in [
        "mixtral-8x7b-instruct",
        "llava-7b-chat",
        "llama-2-70b-chat",
        "codellama-34b-instruct",
        "mistral-7b-instruct",
        "pplx-7b-chat",
        "pplx-70b-chat",
        "pplx-7b-online",
        "pplx-70b-online"
    ]
    self.finished = False
    self.history.append({"role": "user", "content": prompt, "priority": 0})
    self.ws.send("42[\"perplexity_playground\",{\"version\":\"2.1\",\"source\":\"default\",\"model\":\"" + model + "\",\"messages\":" + dumps(self.history) + "}]")

@matalab
Copy link
Author

matalab commented Mar 20, 2024

I have pruchased Pro subscription for Perplexity AI. Will this llibrary automatically utilize models available for Pro users or I need to specify it in python code?
If it is the latter, how to do it?

@matalab
Copy link
Author

matalab commented Mar 26, 2024

As a PRO Perplexity user I can choose AI models listed in the user account settings control panel, where I can choose between: "Default", "Experimental", "GPT-4 Turbo", "Claude 3 Sonnet", "Claude 3 Opus", "Mistral Large".
I have detected that "Claude 3 Opus" gives me best results.
Can you please clarify, is there any relation between what I choose in user account settings and what model will utilize this python library?
For example, for the official Perplexity API, it does not - there is no relation between user settings (and corresponding web app) and API models.
Is it the same for this library or not?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant