tutorial.md

Tutorial

Advanced Usage

LLMeBench offers support for advanced benchmarking use cases. Advanced usage examples can be found in this tutorial.

Updating an Asset

The simplest change to the framework is updating an existing asset, as demonstrated in this tutorial.

Extending LLMeBench

It is also possible to extend the framework by adding a new module for at least one of the following components:

• Dataset
• Task
• Model Provider
• Defining a new asset
  • Creating Few Shot Assets