✨Computational backend: refactoring of dv-2 computational scheduler (Part 2)

[sanderegg]

What do these changes do?

• requires 🎨Computation backend: refactor director-v2 internal computational scheduler to be less resource heavy #6696
  This PR removes:
• all in process data kept concerning the computational runs (now only checks from the comp_runs table),
• --> fixes cancellation of task when multiple replicas of the dv-2 are running
• --> fixes potential issue where metadata could be lost if multiple dv-2 are running

NOTE: all replicas might still schedule the same pipelines which is inefficient, this will be the subject of PR part 3

Related issue/s

How to test

Dev-ops checklist

• No ENV changes or I properly updated ENV (read the instruction)

[codecov]

Codecov Report

Attention: Patch coverage is 92.45283% with 4 lines in your changes missing coverage. Please review.

Project coverage is 88.64%. Comparing base (9915ebd) to head (13af039).
Report is 1 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #6711      +/-   ##
==========================================
+ Coverage   87.74%   88.64%   +0.90%     
==========================================
  Files        1570     1271     -299     
  Lines       63326    54555    -8771     
  Branches     2119      897    -1222     
==========================================
- Hits        55564    48360    -7204     
+ Misses       7435     6061    -1374     
+ Partials      327      134     -193     

Flag	Coverage Δ
integrationtests	64.86% <82.69%> (-0.02%)	⬇️
unittests	86.29% <92.45%> (+0.59%)	⬆️

Components	Coverage Δ
api	∅ <ø> (∅)
pkg_aws_library	∅ <ø> (∅)
pkg_dask_task_models_library	∅ <ø> (∅)
pkg_models_library	92.01% <100.00%> (ø)
pkg_notifications_library	∅ <ø> (∅)
pkg_postgres_database	∅ <ø> (∅)
pkg_service_integration	71.44% <ø> (ø)
pkg_service_library	∅ <ø> (∅)
pkg_settings_library	∅ <ø> (∅)
pkg_simcore_sdk	85.27% <ø> (ø)
agent	96.98% <ø> (ø)
api_server	89.88% <ø> (ø)
autoscaling	95.22% <ø> (ø)
catalog	89.42% <ø> (ø)
clusters_keeper	98.72% <ø> (ø)
dask_sidecar	91.32% <ø> (ø)
datcore_adapter	94.05% <ø> (ø)
director	58.38% <ø> (-0.05%)	⬇️
director_v2	90.81% <92.30%> (-0.05%)	⬇️
dynamic_scheduler	96.59% <ø> (ø)
dynamic_sidecar	89.78% <ø> (ø)
efs_guardian	90.01% <ø> (ø)
invitations	93.51% <ø> (ø)
osparc_gateway_server	85.15% <ø> (ø)
payments	92.87% <ø> (ø)
resource_usage_tracker	90.65% <ø> (-0.15%)	⬇️
storage	89.76% <ø> (ø)
webclient	∅ <ø> (∅)
webserver	88.71% <ø> (-0.02%)	⬇️

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9915ebd...13af039. Read the comment docs.

[matusdrobuliak66]

👍

[pcrespov]

thx. left some comments

[pcrespov]

Somehow comments did not make it in my last review ...here they are

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud