Skip to content

Commit

Permalink
fix bugs of prepend bos during eval and sample
Browse files Browse the repository at this point in the history
  • Loading branch information
SmallMelon-L committed Jul 6, 2024
1 parent a794078 commit 08d9ad8
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions src/lm_saes/evals.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,8 @@ def run_evals(
):
### Evals
eval_tokens = activation_store.next_tokens(cfg.act_store.dataset.store_batch_size)

assert eval_tokens is not None, "Activation store is empty"

# Get Reconstruction Score
losses_df = recons_loss_batched(
Expand Down

0 comments on commit 08d9ad8

Please sign in to comment.