Skip to content

Commit

Permalink
Merge branch 'main' into llama_hub_examples
Browse files Browse the repository at this point in the history
  • Loading branch information
bclavie authored Jan 15, 2024
2 parents 9e5e31a + 9650201 commit 5433a44
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion ragatouille/RAGTrainer.py
Original file line number Diff line number Diff line change
Expand Up @@ -158,10 +158,11 @@ def train(
) -> str:
"""
Launch training or fine-tuning of a ColBERT model.
Parameters:
batch_size: int - Total batch size -- divice by n_usable_gpus for per-GPU batch size.
nbits: int - number of bits used for vector compression by the traiened model. 2 is usually ideal.
maxsteps: int - End training early afte maxsteps steps.
maxsteps: int - End training early after maxsteps steps.
use_ib_negatives: bool - Whether to use in-batch negatives to calculate loss or not.
learning_rate: float - ColBERT litterature usually has this performing best between 3e-6 - 2e-5 depending on data size
dim: int - Size of individual vector representations.
Expand Down

0 comments on commit 5433a44

Please sign in to comment.