Skip to content

Commit

Permalink
Update adding_task.md
Browse files Browse the repository at this point in the history
  • Loading branch information
MaramHasanain authored Sep 17, 2023
1 parent 0c44759 commit 2377c77
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion docs/tutorials/adding_task.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
# Adding Task ([See Demo](https://youtu.be/TN1bpWBpSTU?feature=shared))
<!---# Adding Task ([See Demo](https://youtu.be/TN1bpWBpSTU?feature=shared)) -->
# Adding Task
Check if the task you are adding to the benchmark already has an implementation in `llmebench/tasks`. If not, implement a new task module (e.g. `llmebench/tasks/Sarcasm.py`), which implements a class (e.g. `SarcasmTask`) that subclasses `TaskBase`. See [existing task modules](llmebench/tasks) for inspiration. Each new task class requires implementing two functions:

```python
Expand Down

0 comments on commit 2377c77

Please sign in to comment.