Skip to content

Commit

Permalink
update the experiment results of nextqa and refcoco
Browse files Browse the repository at this point in the history
  • Loading branch information
aria-hacker committed Oct 4, 2024
1 parent 3c13bea commit dbfe96e
Show file tree
Hide file tree
Showing 4 changed files with 2 additions and 2 deletions.
Binary file modified assets/nextqa_loss_full.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified assets/refcoco_loss_full.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion examples/nextqa/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ CUDA_VISIBLE_DEVICES=0 python examples/nextqa/evaluation.py \
The `Accuracy`:
| Aria | LoRA SFT | Full Params SFT |
|:-------------------------------------:|:-------------------------:|:-------:|
|78.14 | 80.80 | 81.42 |
|78.14 | 80.80 | 80.08 |

## Loss Curve
These are the loss curves of `LoRA SFT` and `Full Params SFT`:
Expand Down
2 changes: 1 addition & 1 deletion examples/refcoco/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ CUDA_VISIBLE_DEVICES=0 python examples/refcoco/evaluation.py \
The `Precision@1`:
| Aria | LoRA SFT | Full Params SFT |
|:-------------------------------------:|:-------------------------:|:-------:|
|2.27 | 88.68 | 88.85 |
|2.27 | 88.68 | 88.69 |

# Loss Curve
These are the loss curves of `LoRA Finetuning` (left) and `Full Params Finetuning` (right):
Expand Down

0 comments on commit dbfe96e

Please sign in to comment.