k must have shape (batch_size, seqlen_k, num_heads_k, head_size_og)

[rainsoulsrx]

When I set --infer_sr_scale 1, there is an error, but when set infer_sr_scale=2, run correct, why?

[rainsoulsrx]

and in the code, collect_attention is set False, the following set is not taking effect."You can change the "inference_type"(line 27 in generate_sr_big_cli.sh) to "ar"(parallel size=1), "ar2"(parallel size = block_batch(line 28)) or "full"(generate the entire image in one forward)."

[yzy-thu]

collect_attention is a debug parameter, irrelevant to inference. Why you need infer_sr_scale==1? I haven't tested this.

[Dorniwang]

yeah, it doesn't work, when i specify the inference_type=ar2 manually, it will give this error