Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Increase MSCCLPP_BITS_REGMEM_HANDLE to 9 (#251)
MSCCLPP_BITS_REGMEM_HANDLE=8 limits the number registered memories for a ProxyService to 256. Many use cases, such as KV cache transfer, require registering more tensors. This change allows registering up-to 512 memories. Note that this change uses up the slack bits remaining in the ChannelTrigger struct.
- Loading branch information