Skip to content

Commit

Permalink
Update cache.jl
Browse files Browse the repository at this point in the history
  • Loading branch information
AntonOresten authored Dec 4, 2024
1 parent 1f44b58 commit 8109ef0
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion src/cache.jl
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,6 @@ clear!(cache::KVCache) = config!(cache, seq_length=0)

function update!(cache::KVCache, start_pos::Int, xk::AbstractArray, xv::AbstractArray)
if iszero(seq_length(cache))
println("fuck")
return xk, xv
else
seqlen = size(xk, 2)
Expand Down

0 comments on commit 8109ef0

Please sign in to comment.