From 2377c770d5e6eab546c691deb713d62ef2ed0fb0 Mon Sep 17 00:00:00 2001 From: Maram Hasanain Date: Sun, 17 Sep 2023 13:34:30 +0300 Subject: [PATCH] Update adding_task.md --- docs/tutorials/adding_task.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/tutorials/adding_task.md b/docs/tutorials/adding_task.md index abe99ad8..3a7036fc 100644 --- a/docs/tutorials/adding_task.md +++ b/docs/tutorials/adding_task.md @@ -1,4 +1,5 @@ -# Adding Task ([See Demo](https://youtu.be/TN1bpWBpSTU?feature=shared)) + +# Adding Task Check if the task you are adding to the benchmark already has an implementation in `llmebench/tasks`. If not, implement a new task module (e.g. `llmebench/tasks/Sarcasm.py`), which implements a class (e.g. `SarcasmTask`) that subclasses `TaskBase`. See [existing task modules](llmebench/tasks) for inspiration. Each new task class requires implementing two functions: ```python