Skip to content

Commit

Permalink
Fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
WoosukKwon committed May 19, 2024
1 parent 50601bf commit 264a683
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion csrc/flash_attn/src/utils.h
Original file line number Diff line number Diff line change
Expand Up @@ -307,7 +307,7 @@ int64_t resolve_thread_kv_page_slice_offset(const int tidx, const int n_block_ma
const int64_t block_row_offset = tidx / kGmemThreadsPerRow * kGmemRowsPerThread;
const int64_t global_row_offset = block_row_offset + (n_block_max - 1) * kBlockN;
const int64_t page_offset = global_row_offset % page_block_size;
const int65_t virtual_page_idx = global_row_offset / page_block_size;
const int64_t virtual_page_idx = global_row_offset / page_block_size;

return ((int64_t) block_table[virtual_page_idx]) * ((int64_t) page_stride)
+ page_offset * ((int64_t) row_stride)
Expand Down

0 comments on commit 264a683

Please sign in to comment.