🎨 Add prometheus metrics for logstreaming

[bisgaard-itis]

What do these changes do?

• Introduce prometheus metrics which record the number of log messages currently held by the LogDistributor inside the api server. After setting up a Grafana dashboard for visualizing these we will have a view similar to the RabbitMQ GUI for the logs held in memory by the API-server. This should help debug the issues we have encountered with the logstreaming.

Related issue/s

• fixes Add prometheus metrics to api server for logstreaming endpoint #5591
• Investigate logstreaming with > 200 isolve jobs osparc-issues#1254

How to test

Dev-ops checklist

• No ENV changes or I properly updated ENV (read the instruction)

[mrnicegyu11]

just some questions :--) please ping me if they are answered thanks a lot

[GitHK]

looks good please use tenacity in place of the wheel loop

[codecov]

Codecov Report

Attention: Patch coverage is 96.82540% with 2 lines in your changes are missing coverage. Please review.

Project coverage is 65.8%. Comparing base (cafbf96) to head (a30c3a3).
Report is 76 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff            @@
##           master   #5594      +/-   ##
=========================================
- Coverage    84.5%   65.8%   -18.7%     
=========================================
  Files          10     627     +617     
  Lines         214   30619   +30405     
  Branches       25     204     +179     
=========================================
+ Hits          181   20174   +19993     
- Misses         23   10393   +10370     
- Partials       10      52      +42     

Flag	Coverage Δ
integrationtests	64.0% <ø> (?)
unittests	84.9% <96.8%> (+0.4%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files	Coverage Δ
...ore_service_api_server/api/errors/custom_errors.py	76.1% <100.0%> (ø)
...src/simcore_service_api_server/core/application.py	98.7% <100.0%> (ø)
...er/src/simcore_service_api_server/core/settings.py	90.2% <100.0%> (ø)
...mcore_service_api_server/services/log_streaming.py	91.1% <100.0%> (ø)
...re_service_api_server/api/dependencies/rabbitmq.py	88.0% <90.9%> (ø)
...ice_api_server/core/_prometheus_instrumentation.py	97.2% <97.2%> (ø)

... and 631 files with indirect coverage changes

[matusdrobuliak66]

Thanks! :)

[sanderegg]

thanks!

[sonarqubecloud]

Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud