Add llama_cpp_runner.py for Llama CPP evaluation

[rishsriv]

We can now use llama-cpp and llama-cpp-python to run sql-eval.

To test with a q5 quant of sqlcoder-7b-2

python -W ignore main.py \
  -db postgres \
  -o "results/results.csv" \
  -g llama_cpp \
  -f "prompts/prompt.md" \
  -m ~/.defog/sqlcoder-7b-q5_k_m.gguf

Additionally, if you would like to always report your results to an upload_url, even if it's not explicitly provided, you can now set it in your environment variables as SQL_EVAL_UPLOAD_URL

[wongjingping]

Thanks for adding this capability to sql-eval! This would make running evaluations on different hardware more transparent and debuggable 👍🏼

[wongjingping]

nit: should this be llama_cpp_runner?

[rishsriv]

Ah, yes! Fixing!

[rishsriv]

Fixed, thanks for identifying this!