Address review comments in dmlc/xgboost#11046 #14

Job	Run time
Build CI containers (xgb-ci.clang_tidy)	2m 46s
Build CI containers (xgb-ci.cpu)	10m 37s
Build CI containers (xgb-ci.gpu)	8m 26s
Build CI containers (xgb-ci.gpu_build_r_rockylinux8)	4m 53s
Build CI containers (xgb-ci.gpu_build_rockylinux8)	10m 45s
Build CI containers (xgb-ci.gpu_build_rockylinux8_dev_ver)	10m 50s
Build CI containers (xgb-ci.jvm)	3m 7s
Build CI containers (xgb-ci.jvm_gpu_build)	5m 43s
Build CI containers (xgb-ci.manylinux_2_28_x86_64)	39s
Build CI containers (xgb-ci.manylinux2014_x86_64)	2m 15s
Build CI containers (xgb-ci.aarch64)	8m 53s
Build CI containers (xgb-ci.manylinux2014_aarch64)	1m 11s
	1h 10m 5s

Provide feedback