pt: support multitask finetune #6485

Job	Run time
Build source distribution	17s
determine-arm64-runner	1s
Build wheels for cp311-manylinux_x86_64	6m 19s
Build wheels for cp311-manylinux_x86_64	6m 3s
Build wheels for cp311-macosx_x86_64	5m 55s
Build wheels for cp311-macosx_arm64	3m 26s
Build wheels for cp311-win_amd64	7m 34s
Build wheels for cp310-manylinux_aarch64	5m 30s
build_pypi_index	7s
build_docker (12)	3m 45s
build_docker (_cu11, 11)	3m 52s
upload_pypi	0s
deploy_pypi_index	0s
Pass testing build wheels	1s
	42m 50s

Provide feedback