From 39af7a932d17184e1ade9bce5e48b275ffdb2c6d Mon Sep 17 00:00:00 2001 From: Ying Sheng Date: Sun, 26 Mar 2023 10:38:18 -0700 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 46a1e262..e1104720 100644 --- a/README.md +++ b/README.md @@ -71,7 +71,7 @@ You can run the examples in this paper, ['Can Foundation Models Wrangle Your Dat ## Performance Benchmark ### Generation Throughput (token/s) -The corresponding effective batch sizes are in parentheses. Please see [here](benchmark/batch_size_table.md) for more details. +The corresponding effective batch sizes and lowest offloading device are in parentheses. Please see [here](benchmark/batch_size_table.md) for more details. | System | OPT-6.7B | OPT-30B | OPT-175B | | ------ | -------- | ------- | -------- | | Hugging Face Accelerate | 25.12 (2 on GPU) | 0.62 (8 on CPU) | 0.01 (2 on disk) |