test: re-work test strategy for integration tests #16360

Job	Run time
Prepare CI Run	6s
Build Docker Image (lifecycle-operator, lifecycle-operator/)	2m 13s
Store tag of the built images	2s
Build Docker Image (metrics-operator, metrics-operator/)	3m 16s
Unit Tests (lifecycle-operator, lifecycle-operator/)	6m 9s
Build Docker Image (scheduler, scheduler/)	2m 42s
Unit Tests (metrics-operator, metrics-operator/)	3m 52s
Build Docker Image (deno-runtime, runtimes/deno-runtime/)	16s
Unit Tests (scheduler, scheduler/)	2m 43s
Build Docker Image (python-runtime, runtimes/python-runtime/)	1m 11s
Unit Tests (certificate-operator, keptn-cert-manager/)	1m 56s
Build Docker Image (certificate-operator, keptn-cert-manager/)	2m 6s
Component Tests / Component Tests	3m 44s
Publish helm chart changes to charts repo	0s
End to End Tests / Run E2E Tests (lifecycle-operator, lifecycle-operator/)	1m 22s
End to End Tests / Run E2E Tests (scheduler, scheduler/)	1m 5s
Integration Tests Cert Manager / Run Chainsaw Tests	8m 20s
Integration Tests Allowed Namespaces / Run Chainsaw Tests	2m 23s
Integration Tests Lifecycle / Run Chainsaw Tests	10m 11s
Load Tests / Run load Tests	1m 19s
Integration Tests (gates_off, cert_manager_io_off) / Run Chainsaw Tests	1m 49s
Integration Tests (gates_off, cert_manager_io_on) / Run Chainsaw Tests	1m 33s
Integration Tests (gates_on, cert_manager_io_off) / Run Chainsaw Tests	1m 52s
Integration Tests Metrics (cert_manager_io_off) / Run Chainsaw Tests	1m 50s
Integration Tests Metrics (cert_manager_io_on) / Run Chainsaw Tests	1m 27s
	1h 3m 27s

Provide feedback