test: re-work test strategy for integration tests #16361

Job	Run time
Prepare CI Run	3s
Build Docker Image (lifecycle-operator, lifecycle-operator/)	2m 30s
Store tag of the built images	4s
Build Docker Image (metrics-operator, metrics-operator/)	3m 10s
Unit Tests (lifecycle-operator, lifecycle-operator/)	5m 11s
Build Docker Image (scheduler, scheduler/)	2m 42s
Unit Tests (metrics-operator, metrics-operator/)	51s
Unit Tests (scheduler, scheduler/)	27s
Build Docker Image (deno-runtime, runtimes/deno-runtime/)	19s
Unit Tests (certificate-operator, keptn-cert-manager/)	25s
Build Docker Image (python-runtime, runtimes/python-runtime/)	16s
Build Docker Image (certificate-operator, keptn-cert-manager/)	2m 2s
Component Tests / Component Tests	2m 23s
Publish helm chart changes to charts repo	0s
Integration Tests Allowed Namespaces / Run Chainsaw Tests	2m 41s
Integration Tests Cert Manager / Run Chainsaw Tests	8m 11s
End to End Tests / Run E2E Tests (lifecycle-operator, lifecycle-operator/)	1m 32s
Integration Tests Lifecycle / Run Chainsaw Tests	10m 19s
End to End Tests / Run E2E Tests (scheduler, scheduler/)	1m 17s
Load Tests / Run load Tests	1m 16s
Integration Tests (gates_off, cert_manager_io_off) / Run Chainsaw Tests	2m 3s
Integration Tests (gates_off, cert_manager_io_on) / Run Chainsaw Tests	2m 7s
Integration Tests (gates_on, cert_manager_io_off) / Run Chainsaw Tests	2m 18s
Integration Tests Metrics (cert_manager_io_off) / Run Chainsaw Tests	4m 14s
Integration Tests Metrics (cert_manager_io_on) / Run Chainsaw Tests	4m 30s
	1h 0m 51s

Provide feedback