feat(pt): consistent fine-tuning with init-model #7955

Job	Run time
Test Python (1, 3.8)	11m 32s
Test Python (1, 3.11)	11m 23s
Test Python (2, 3.8)	10m 9s
Test Python (2, 3.11)	8m 44s
Test Python (3, 3.8)	9m 39s
Test Python (3, 3.11)	9m 55s
Test Python (4, 3.8)	11m 3s
Test Python (4, 3.11)	10m 16s
Test Python (5, 3.8)	10m 5s
Test Python (5, 3.11)	9m 38s
Test Python (6, 3.8)	9m 44s
Test Python (6, 3.11)	9m 43s
Combine and update integration test durations (3.8)	4s
Combine and update integration test durations (3.11)	4s
Pass testing Python	1s
	2h 2m 0s

Provide feedback