🏗️ Maintenance/week07 (#2148)

* update api/tests reqs * update tests/pulic-api reqs * update tests/service-integration reqs * update tests/s3wrapper reqs * update api-server test reqs * update catalog test reqs * update director2 test reqs * update sidecar test reqs * update storage test reqs * update test-env reqs * updates models-library reqs * updates service-lib reqs * UPdates reqs simcore-sdk * adds constraint introduced by coveralls via requests * upgrades postgres-database reqs * upgrades format webserver reqs * upgrades format storage reqs * Updates reqs format in sidecar * Upgrades reqs format for director-v2 * Upgrades reqs format for catalog * upgrades reqs in tests/e2e * Upgrade reqs in swarm-deploy * Split swarm-deploy reqs in small reqs files * Adds vulnerability to contraints Second pass with updated constraints on all tests+tool requirements * updated format reqs in director and fixes dependencies * upgrades cryptopgrahy package * upgrades pip to ~21.0.1
ITISFoundation · Feb 15, 2021 · 18eecee · 18eecee
1 parent f2c5991
commit 18eecee
Show file tree

Hide file tree

Showing 86 changed files with 5,666 additions and 1,786 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,112 +1,3 @@
 # Changelog
 
-<!--
-FIXME: Compare shows single commit. SEE https://github.com/ITISFoundation/osparc-simcore/issues/1726
--->
-
-## [Unreleased]
-
-<!--------------------------------------------------------->
-<!-- ## [0.0.26] - 2020-08-??  TODO: use link and fill entries below -->
-
-### Added
-
-- Started this *human-readable* CHANGELOG
-- ``migration`` service that discovers postgres service and upgrades main database [#1714](https://github.com/ITISFoundation/osparc-simcore/pull/1714)
-- Every group can register official classifiers for studies and services. Diplayed as a tree in UI [#1670](https://github.com/ITISFoundation/osparc-simcore/pull/1670), [#1719](https://github.com/ITISFoundation/osparc-simcore/pull/1719) , [#1722](https://github.com/ITISFoundation/osparc-simcore/pull/1722)
-- GC tests are run in isolation with a template database [#1724](https://github.com/ITISFoundation/osparc-simcore/pull/1724)
-- Added models_library python package that contains all basic pydantic models for use in simcore [#1856](https://github.com/ITISFoundation/osparc-simcore/pull/1856)
-
-### Changed
-
-- Speedup testing by splitting webserver [#1711](https://github.com/ITISFoundation/osparc-simcore/pull/1711)
-- Refactored garbage collector and added tests [#1724](https://github.com/ITISFoundation/osparc-simcore/pull/1724)
-- Logs are now displayed during testing [#1724](https://github.com/ITISFoundation/osparc-simcore/pull/1724)
-
-<!-- ### Deprecated -->
-<!-- ### Removed    -->
-<!-- ### Fixed      -->
-<!-- ### Security   -->
-
-<!--------------------------------------------------------->
-## [0.0.25] - 2020-08-04
-
-### Added
-- add traefik endpoint to api-gateway [#1555](https://github.com/ITISFoundation/osparc-simcore/pull/1555)
-- Shared project concurrency (frontend) [#1591](https://github.com/ITISFoundation/osparc-simcore/pull/1591)
-- Homogenize studies and services [#1569](https://github.com/ITISFoundation/osparc-simcore/pull/1569)
-- UI Fine grained access - project locking and notification
-- Adds support for GPU scheduling of computational services [#1553](https://github.com/ITISFoundation/osparc-simcore/pull/1553)
-
-### Changed
-- UI/UX improvements [#1657](https://github.com/ITISFoundation/osparc-simcore/pull/1657)
-- Improving storage performance [#1659](https://github.com/ITISFoundation/osparc-simcore/pull/1659)
-- Theming [#1656](https://github.com/ITISFoundation/osparc-simcore/pull/1656)
-- Reduce cardinality of metrics [#1593](https://github.com/ITISFoundation/osparc-simcore/pull/1593)
-
-### Fixed
-- Platform stability: [#1645](https://github.com/ITISFoundation/osparc-simcore/pull/1645)
-- Fix, improves and re-activate e2e CI testing [#1594](https://github.com/ITISFoundation/osparc-simcore/pull/1594), [#1620](https://github.com/ITISFoundation/osparc-simcore/pull/1620), [#1631](https://github.com/ITISFoundation/osparc-simcore/pull/1631), [#1600](https://github.com/ITISFoundation/osparc-simcore/pull/1600)
-- Fixes defaults [#1640](https://github.com/ITISFoundation/osparc-simcore/pull/1640)
-- Upgrade storage service [#1585](https://github.com/ITISFoundation/osparc-simcore/pull/1585), [#1586](https://github.com/ITISFoundation/osparc-simcore/pull/1586)
-- UPgrade catalog service [#1582](https://github.com/ITISFoundation/osparc-simcore/pull/1582)
-- Fixes on publish studies handling [#1632](https://github.com/ITISFoundation/osparc-simcore/pull/1632)
-- Invalidate cache before starting a study [#1602](https://github.com/ITISFoundation/osparc-simcore/pull/1602)
-- Some enhancements and bug fixes [#1608](https://github.com/ITISFoundation/osparc-simcore/pull/1608)
-- filter studies by name before deleting them [#1629](https://github.com/ITISFoundation/osparc-simcore/pull/1629)
-- Bugfix/apiserver does not need sslheaders [#1564](https://github.com/ITISFoundation/osparc-simcore/pull/1564)
-- fix testing if node has gpu support [#1604](https://github.com/ITISFoundation/osparc-simcore/pull/1604)
-- /study fails 500 [#1570](https://github.com/ITISFoundation/osparc-simcore/pull/1570), [#1572](https://github.com/ITISFoundation/osparc-simcore/pull/1572)
-- fix codecov reports [#1568](https://github.com/ITISFoundation/osparc-simcore/pull/1568)
-
-### Security
-- Bump yarl from 1.4.2 to 1.5.1 in /packages/postgres-database [#1665](https://github.com/ITISFoundation/osparc-simcore/pull/1665)
-- Bump ujson from 3.0.0 to 3.1.0 in /packages/service-library [#1664](https://github.com/ITISFoundation/osparc-simcore/pull/1664)
-- Bump pytest-docker from 0.7.2 to 0.8.0 in /packages/service-library [#1647](https://github.com/ITISFoundation/osparc-simcore/pull/1647)
-- Bump aiozipkin from 0.6.0 to 0.7.0 in /packages/service-library [#1642](https://github.com/ITISFoundation/osparc-simcore/pull/1642)
-- Bump lodash from 4.17.15 to 4.17.19 [#1639](https://github.com/ITISFoundation/osparc-simcore/pull/1639)
-- Maintenance/upgrades test tools [#1628](https://github.com/ITISFoundation/osparc-simcore/pull/1628)
-- Bugfix/concurent opening projects [#1598](https://github.com/ITISFoundation/osparc-simcore/pull/1598)
-- Bugfix/allow reading groups anonymous user [#1615](https://github.com/ITISFoundation/osparc-simcore/pull/1615)
-- Bump docker from 4.2.1 to 4.2.2 in /packages/postgres-database [#1605](https://github.com/ITISFoundation/osparc-simcore/pull/1605)
-- Bump faker from 4.1.0 to 4.1.1 in /packages/postgres-database [#1573](https://github.com/ITISFoundation/osparc-simcore/pull/1573)
-- Maintenance/upgrades and tooling [#1546](https://github.com/ITISFoundation/osparc-simcore/pull/1546)
-
-
----
-All notable changes to this service will be documented in this file. The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and the release numbers follow [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
-
-
-<!-- Add links below this line ------------------------------------>
-
-[Unreleased]:https://github.com/ITISFoundation/osparc-simcore/compare/v0.0.25...HEAD
-[0.0.25]:https://github.com/ITISFoundation/osparc-simcore/compare/v0.0.24...v0.0.25
-[0.0.24]:https://github.com/ITISFoundation/osparc-simcore/compare/v0.0.22...v0.0.24
-<!-- 0.0.23 was deleted !-->
-[0.0.22]:https://github.com/ITISFoundation/osparc-simcore/compare/v0.0.21...v0.0.22
-[0.0.21]:https://github.com/ITISFoundation/osparc-simcore/compare/v0.0.20...v0.0.21
-[0.0.20]:https://github.com/ITISFoundation/osparc-simcore/compare/v0.0.19...v0.0.20
-[0.0.19]:https://github.com/ITISFoundation/osparc-simcore/releases/tag/v0.0.19
-
-
-<!-- HOW TO WRITE  THIS CHANGELOG
-
-- Guiding Principles
-  - Changelogs are for humans, not machines.
-  - There should be an entry for every single version.
-  - The same types of changes should be grouped.
-  - Versions and sections should be linkable.
-  - The latest version comes first.
-  - The release date of each version is displayed.
-  - Mention whether you follow Semantic Versioning.
-
-- Types of changes
-  - ADDED for new features.
-  - CHANGED for changes in existing functionality.
-  - DEPRECATED for soon-to-be removed features.
-  - REMOVED for now removed features.
-  - FIXED for any bug fixes.
-  - SECURITY in case of vulnerabilities.
-
-SEE https://keepachangelog.com/en/1.0.0/
--->
+To see all changelogs, please open [Release Notes](https://github.com/ITISFoundation/osparc-simcore/releases) directly in github website.
diff --git a/api/tests/requirements.txt b/api/tests/requirements.txt
@@ -4,43 +4,117 @@
 #
 #    pip-compile --output-file=requirements.txt requirements.in
 #
-aiohttp==3.7.3            # via -r requirements.in, pytest-aiohttp
-async-timeout==3.0.1      # via aiohttp
-attrs==20.3.0             # via aiohttp, jsonschema, openapi-core, pytest
-chardet==3.0.4            # via aiohttp
-coverage==5.3             # via -r requirements.in, pytest-cov
-idna-ssl==1.1.0           # via aiohttp
-idna==2.10                # via idna-ssl, yarl
-importlib-metadata==3.1.1  # via jsonschema, pluggy, pytest
-iniconfig==1.1.1          # via pytest
-isodate==0.6.0            # via openapi-core, openapi-schema-validator
-jsonschema==3.2.0         # via openapi-schema-validator, openapi-spec-validator
-lazy-object-proxy==1.5.2  # via openapi-core
-more-itertools==8.6.0     # via openapi-core
-multidict==5.1.0          # via aiohttp, yarl
-openapi-core==0.13.4      # via -r requirements.in
-openapi-schema-validator==0.1.1  # via openapi-core
-openapi-spec-validator==0.2.9  # via openapi-core
-packaging==20.7           # via pytest, pytest-sugar
-parse==1.18.0             # via openapi-core
-pluggy==0.13.1            # via pytest
-py==1.9.0                 # via pytest
-pyparsing==2.4.7          # via packaging
-pyrsistent==0.17.3        # via jsonschema
-pytest-aiohttp==0.3.0     # via -r requirements.in
-pytest-cov==2.10.1        # via -r requirements.in
-pytest-instafail==0.4.2   # via -r requirements.in
-pytest-sugar==0.9.4       # via -r requirements.in
-pytest==6.1.2             # via -r requirements.in, pytest-aiohttp, pytest-cov, pytest-instafail, pytest-sugar
-pyyaml==5.3.1             # via -c ../../requirements/constraints.txt, openapi-spec-validator
-six==1.15.0               # via isodate, jsonschema, openapi-core, openapi-schema-validator, openapi-spec-validator
-strict-rfc3339==0.7       # via openapi-schema-validator
-termcolor==1.1.0          # via pytest-sugar
-toml==0.10.2              # via pytest
-typing-extensions==3.7.4.3  # via aiohttp, yarl
-werkzeug==1.0.1           # via openapi-core
-yarl==1.6.3               # via aiohttp
-zipp==3.4.0               # via importlib-metadata
+aiohttp==3.7.3
+    # via
+    #   -r requirements.in
+    #   pytest-aiohttp
+async-timeout==3.0.1
+    # via aiohttp
+attrs==20.3.0
+    # via
+    #   aiohttp
+    #   jsonschema
+    #   openapi-core
+    #   pytest
+chardet==3.0.4
+    # via aiohttp
+coverage==5.4
+    # via
+    #   -r requirements.in
+    #   pytest-cov
+idna-ssl==1.1.0
+    # via aiohttp
+idna==2.10
+    # via
+    #   -c ../../requirements/constraints.txt
+    #   idna-ssl
+    #   yarl
+importlib-metadata==3.4.0
+    # via
+    #   jsonschema
+    #   pluggy
+    #   pytest
+iniconfig==1.1.1
+    # via pytest
+isodate==0.6.0
+    # via
+    #   openapi-core
+    #   openapi-schema-validator
+jsonschema==3.2.0
+    # via
+    #   openapi-schema-validator
+    #   openapi-spec-validator
+lazy-object-proxy==1.5.2
+    # via openapi-core
+more-itertools==8.7.0
+    # via openapi-core
+multidict==5.1.0
+    # via
+    #   aiohttp
+    #   yarl
+openapi-core==0.13.6
+    # via -r requirements.in
+openapi-schema-validator==0.1.1
+    # via openapi-core
+openapi-spec-validator==0.2.9
+    # via openapi-core
+packaging==20.9
+    # via
+    #   pytest
+    #   pytest-sugar
+parse==1.19.0
+    # via openapi-core
+pluggy==0.13.1
+    # via pytest
+py==1.10.0
+    # via pytest
+pyparsing==2.4.7
+    # via packaging
+pyrsistent==0.17.3
+    # via jsonschema
+pytest-aiohttp==0.3.0
+    # via -r requirements.in
+pytest-cov==2.11.1
+    # via -r requirements.in
+pytest-instafail==0.4.2
+    # via -r requirements.in
+pytest-sugar==0.9.4
+    # via -r requirements.in
+pytest==6.2.2
+    # via
+    #   -r requirements.in
+    #   pytest-aiohttp
+    #   pytest-cov
+    #   pytest-instafail
+    #   pytest-sugar
+pyyaml==5.4.1
+    # via
+    #   -c ../../requirements/constraints.txt
+    #   openapi-spec-validator
+six==1.15.0
+    # via
+    #   isodate
+    #   jsonschema
+    #   openapi-core
+    #   openapi-schema-validator
+    #   openapi-spec-validator
+strict-rfc3339==0.7
+    # via openapi-schema-validator
+termcolor==1.1.0
+    # via pytest-sugar
+toml==0.10.2
+    # via pytest
+typing-extensions==3.7.4.3
+    # via
+    #   aiohttp
+    #   importlib-metadata
+    #   yarl
+werkzeug==1.0.1
+    # via openapi-core
+yarl==1.6.3
+    # via aiohttp
+zipp==3.4.0
+    # via importlib-metadata
 
 # The following packages are considered to be unsafe in a requirements file:
 # setuptools
diff --git a/ci/helpers/ensure_python_pip.bash b/ci/helpers/ensure_python_pip.bash
@@ -11,7 +11,7 @@ set -o pipefail  # don't hide errors within pipes
 IFS=$'\n\t'
 
 # Pin pip version to a compatible release https://www.python.org/dev/peps/pep-0440/#compatible-release
-PIP_VERSION=20.2.2
+PIP_VERSION=21.0.1
 
 echo "INFO:" "$(python --version)" "@" "$(command -v python)"
 

diff --git a/packages/models-library/requirements/_base.txt b/packages/models-library/requirements/_base.txt
@@ -4,8 +4,15 @@
 #
 #    pip-compile --output-file=requirements/_base.txt requirements/_base.in
 #
-dataclasses==0.8          # via pydantic
-dnspython==2.0.0          # via email-validator
-email-validator==1.1.2    # via pydantic
-idna==2.10                # via email-validator
-pydantic[email]==1.7.3    # via -r requirements/_base.in
+dataclasses==0.8
+    # via pydantic
+dnspython==2.1.0
+    # via email-validator
+email-validator==1.1.2
+    # via pydantic
+idna==2.10
+    # via
+    #   -c requirements/../../../requirements/constraints.txt
+    #   email-validator
+pydantic[email]==1.7.3
+    # via -r requirements/_base.in