improve gh actions (#3283) #5283

Job	Run time
determine-arm64-runner	1s
Build source distribution	25s
Build wheels for cp311-manylinux_x86_64	5m 33s
Build wheels for cp311-manylinux_x86_64	5m 35s
Build wheels for cp311-macosx_x86_64	5m 22s
Build wheels for cp311-macosx_arm64	3m 13s
Build wheels for cp311-win_amd64	4m 55s
Build wheels for cp310-manylinux_aarch64	4m 14s
build_pypi_index	21s
build_docker (12)	16m 1s
build_docker (_cu11, 11)	13m 19s
upload_pypi	0s
deploy_pypi_index	7s
Pass testing build wheels	2s
	59m 8s

Provide feedback