test: re-work test strategy for integration tests #16422

Job	Run time
Prepare CI Run	4s
Unit Tests (lifecycle-operator, lifecycle-operator/)	54s
Store tag of the built images	3s
Unit Tests (metrics-operator, metrics-operator/)	53s
Unit Tests (scheduler, scheduler/)	30s
Unit Tests (certificate-operator, keptn-cert-manager/)	28s
Build Docker Image (lifecycle-operator, lifecycle-operator/)	2m 15s
Build Docker Image (metrics-operator, metrics-operator/)	3m 11s
Build Docker Image (scheduler, scheduler/)	2m 40s
Build Docker Image (deno-runtime, runtimes/deno-runtime/)	22s
Build Docker Image (python-runtime, runtimes/python-runtime/)	52s
Build Docker Image (certificate-operator, keptn-cert-manager/)	2m 21s
Component Tests / Component Tests	2m 23s
Publish helm chart changes to charts repo	0s
Integration Tests Lifecycle / Run Chainsaw Tests	9m 22s
Integration Tests Metrics / Run Chainsaw Tests	3m 58s
End to End Tests / Run E2E Tests (lifecycle-operator, lifecycle-operator/)	1m 57s
End to End Tests / Run E2E Tests (scheduler, scheduler/)	2m 55s
Integration Tests Allowed Namespaces / Run Chainsaw Tests	3m 20s
Integration Tests Cert Manager / Run Chainsaw Tests	2m 24s
Load Tests / Run load Tests	6m 36s
Integration Tests (gates_off, cert_manager_io_off) / Run Chainsaw Tests	13m 42s
Integration Tests (gates_off, cert_manager_io_on) / Run Chainsaw Tests	14m 9s
Integration Tests (gates_on, cert_manager_io_off) / Run Chainsaw Tests	15m 2s
	1h 30m 21s

Provide feedback