Skip to content

Commit

Permalink
Fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
pomonam committed Jul 12, 2024
1 parent 4c099ba commit 28e682b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/openwebtext/compute_scores.py
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ def main():
dataloader_kwargs = DataLoaderKwargs(num_workers=4, collate_fn=default_data_collator, pin_memory=True)
analyzer.set_dataloader_kwargs(dataloader_kwargs)

scores_name = args.factor_strategy
scores_name = args.factors_name
rank = args.query_gradient_rank if args.query_gradient_rank != -1 else None
score_args = extreme_reduce_memory_score_arguments(
damping_factor=None, module_partitions=1, query_gradient_low_rank=rank, dtype=torch.bfloat16
Expand Down

0 comments on commit 28e682b

Please sign in to comment.