Skip to content

Commit

Permalink
Increase MSCCLPP_BITS_REGMEM_HANDLE to 9 (#251)
Browse files Browse the repository at this point in the history
MSCCLPP_BITS_REGMEM_HANDLE=8 limits the number registered memories for a
ProxyService to 256. Many use cases, such as KV cache transfer, require
registering more tensors.

This change allows registering up-to 512 memories. Note that this change
uses up the slack bits remaining in the ChannelTrigger struct.
  • Loading branch information
aashaka authored Jan 23, 2024
1 parent 422c81f commit 6c9d159
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion include/mscclpp/proxy_channel_device.hpp
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ const TriggerType TriggerSync = 0x4; // Trigger a flush.

#define MSCCLPP_BITS_SIZE 32
#define MSCCLPP_BITS_OFFSET 32
#define MSCCLPP_BITS_REGMEM_HANDLE 8
#define MSCCLPP_BITS_REGMEM_HANDLE 9
#define MSCCLPP_BITS_TYPE 3
#define MSCCLPP_BITS_CONNID 10
#define MSCCLPP_BITS_FIFO_RESERVED 1
Expand Down

0 comments on commit 6c9d159

Please sign in to comment.