[Feature Request]. Support Reward Model

[liziniu]

Hi,
May I know whether the framework can support to quantize reward models like Qwen/Qwen2.5-Math-RM-72B and Llama-3.1-Nemotron-70B-Reward-HF? These models are usually used at inference stage but requires extensive GPU memory. Thus quantization is valuable.