Updating outdated ansible role and molecule

[askb]

I'm trying to update the ansible roles and molecule on the repo [1.]
The dependencies are updated through updates to tox.ini here [2.] returns a error: subprocess-exited-with-error.

molecule: install_deps> python -I -m pip install 'ansible-lint~=4.2.0' 'ansible~=2.9.6' 'detox~=0.18' docker 'molecule[docker]' 'molecule~=3.0.8' 'pytest~=5.4.0' yamllint
00:02:10.223   error: subprocess-exited-with-error
00:02:10.223   
00:02:10.223   × Getting requirements to build wheel did not run successfully.
00:02:10.223   │ exit code: 1
00:02:10.223   ╰─> [48 lines of output]
00:02:10.223       running egg_info
00:02:10.223       writing lib3/PyYAML.egg-info/PKG-INFO
00:02:10.223       writing dependency_links to lib3/PyYAML.egg-info/dependency_links.txt
00:02:10.223       writing top-level names to lib3/PyYAML.egg-info/top_level.txt
00:02:10.223       Traceback (most recent call last):
00:02:10.223         File "/w/workspace/lf-infra-ansible-roles-tox-verify-any/.tox/molecule/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
00:02:10.223           main()
00:02:10.223         File "/w/workspace/lf-infra-ansible-roles-tox-verify-any/.tox/molecule/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
00:02:10.223           json_out['return_val'] = hook(**hook_input['kwargs'])
00:02:10.223         File "/w/workspace/lf-infra-ansible-roles-tox-verify-any/.tox/molecule/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
00:02:10.223           return hook(config_settings)
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 325, in get_requires_for_build_wheel
00:02:10.223           return self._get_build_requires(config_settings, requirements=['wheel'])
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 295, in _get_build_requires
00:02:10.223           self.run_setup()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 311, in run_setup
00:02:10.223           exec(code, locals())
00:02:10.223         File "<string>", line 271, in <module>
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/__init__.py", line 103, in setup
00:02:10.223           return distutils.core.setup(**attrs)
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 185, in setup
00:02:10.223           return run_commands(dist)
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
00:02:10.223           dist.run_commands()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
00:02:10.223           self.run_command(cmd)
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/dist.py", line 963, in run_command
00:02:10.223           super().run_command(command)
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
00:02:10.223           cmd_obj.run()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 321, in run
00:02:10.223           self.find_sources()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 329, in find_sources
00:02:10.223           mm.run()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 551, in run
00:02:10.223           self.add_defaults()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 589, in add_defaults
00:02:10.223           sdist.add_defaults(self)
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/command/sdist.py", line 112, in add_defaults
00:02:10.223           super().add_defaults()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/sdist.py", line 251, in add_defaults
00:02:10.223           self._add_defaults_ext()
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/sdist.py", line 336, in _add_defaults_ext
00:02:10.223           self.filelist.extend(build_ext.get_source_files())
00:02:10.223         File "<string>", line 201, in get_source_files
00:02:10.223         File "/tmp/pip-build-env-tpfpj7o4/overlay/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 107, in __getattr__
00:02:10.223           raise AttributeError(attr)
00:02:10.223       AttributeError: cython_sources
00:02:10.223       [end of output]
00:02:10.223   
00:02:10.223   note: This error originates from a subprocess, and is likely not a problem with pip.
00:02:10.223 error: subprocess-exited-with-error
00:02:10.223 
00:02:10.223 × Getting requirements to build wheel did not run successfully.
00:02:10.223 │ exit code: 1
00:02:10.223 ╰─> See above for output.
00:02:10.223 
00:02:10.223 note: This error originates from a subprocess, and is likely not a problem with pip.
00:02:10.224 Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
00:02:10.224 Collecting ansible-lint~=4.2.0
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ansible-lint/4.2.0/ansible_lint-4.2.0-py2.py3-none-any.whl (57 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.2/57.2 kB 7.6 MB/s eta 0:00:00
00:02:10.224 Collecting ansible~=2.9.6
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ansible/2.9.27/ansible-2.9.27.tar.gz (14.8 MB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.8/14.8 MB 47.7 MB/s eta 0:00:00
00:02:10.224   Preparing metadata (setup.py): started
00:02:10.224   Preparing metadata (setup.py): finished with status 'done'
00:02:10.224 Collecting detox~=0.18
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/detox/0.19/detox-0.19-py2.py3-none-any.whl (8.4 kB)
00:02:10.224 Collecting docker
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker/7.0.0/docker-7.0.0-py3-none-any.whl (147 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.6/147.6 kB 8.8 MB/s eta 0:00:00
00:02:10.224 Collecting molecule~=3.0.8
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/molecule/3.0.8/molecule-3.0.8-py3-none-any.whl (279 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 279.5/279.5 kB 17.1 MB/s eta 0:00:00
00:02:10.224 Collecting pytest~=5.4.0
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pytest/5.4.3/pytest-5.4.3-py3-none-any.whl (248 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 248.1/248.1 kB 4.4 MB/s eta 0:00:00
00:02:10.224 Collecting yamllint
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/yamllint/1.33.0/yamllint-1.33.0-py3-none-any.whl (65 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.4/65.4 kB 7.3 MB/s eta 0:00:00
00:02:10.224 Collecting pyyaml (from ansible-lint~=4.2.0)
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyyaml/6.0.1/PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
00:02:10.224 Collecting six (from ansible-lint~=4.2.0)
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB)
00:02:10.224 Collecting ruamel.yaml<1,>=0.15.37 (from ansible-lint~=4.2.0)
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/ruamel-yaml/0.18.5/ruamel.yaml-0.18.5-py3-none-any.whl (116 kB)
00:02:10.224 Collecting jinja2 (from ansible~=2.9.6)
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jinja2/3.1.2/Jinja2-3.1.2-py3-none-any.whl (133 kB)
00:02:10.224 Collecting cryptography (from ansible~=2.9.6)
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/41.0.7/cryptography-41.0.7-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.4 MB)
00:02:10.224 Collecting tox<3.7,>=3.5 (from detox~=0.18)
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/tox/3.6.1/tox-3.6.1-py2.py3-none-any.whl (54 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.0/54.0 kB 5.6 MB/s eta 0:00:00
00:02:10.224 Collecting py>=1.4.27 (from detox~=0.18)
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/py/1.11.0/py-1.11.0-py2.py3-none-any.whl (98 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.7/98.7 kB 11.7 MB/s eta 0:00:00
00:02:10.224 Collecting eventlet>=0.15.0 (from detox~=0.18)
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/eventlet/0.33.3/eventlet-0.33.3-py2.py3-none-any.whl (226 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 226.8/226.8 kB 14.4 MB/s eta 0:00:00
00:02:10.224 Collecting packaging>=14.0 (from docker)
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/packaging/23.2/packaging-23.2-py3-none-any.whl (53 kB)
00:02:10.224 Collecting requests>=2.26.0 (from docker)
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB)
00:02:10.224 Collecting urllib3>=1.26.0 (from docker)
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.1.0/urllib3-2.1.0-py3-none-any.whl (104 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 12.7 MB/s eta 0:00:00
00:02:10.224 Collecting cerberus>=1.3.1 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/cerberus/1.3.5/Cerberus-1.3.5-py3-none-any.whl (30 kB)
00:02:10.224 Collecting click>=7.0 (from molecule[docker])
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.7/click-8.1.7-py3-none-any.whl (97 kB)
00:02:10.224 Collecting click-completion>=0.5.1 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/click-completion/0.5.2/click-completion-0.5.2.tar.gz (10 kB)
00:02:10.224   Preparing metadata (setup.py): started
00:02:10.224   Preparing metadata (setup.py): finished with status 'done'
00:02:10.224 Collecting click-help-colors>=0.6 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/click-help-colors/0.9.4/click_help_colors-0.9.4-py3-none-any.whl (6.4 kB)
00:02:10.224 Collecting colorama>=0.3.9 (from molecule[docker])
00:02:10.224   Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/colorama/0.4.6/colorama-0.4.6-py2.py3-none-any.whl (25 kB)
00:02:10.224 Collecting cookiecutter!=1.7.1,>=1.6.0 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/cookiecutter/2.5.0/cookiecutter-2.5.0-py3-none-any.whl (39 kB)
00:02:10.224 Collecting python-gilt<2,>=1.2.1 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/python-gilt/1.2.3/python_gilt-1.2.3-py2.py3-none-any.whl (22 kB)
00:02:10.224 Collecting paramiko<3,>=2.5.0 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/2.12.0/paramiko-2.12.0-py2.py3-none-any.whl (213 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 213.1/213.1 kB 19.0 MB/s eta 0:00:00
00:02:10.224 Collecting pexpect<5,>=4.6.0 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pexpect/4.9.0/pexpect-4.9.0-py2.py3-none-any.whl (63 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.8/63.8 kB 8.2 MB/s eta 0:00:00
00:02:10.224 Collecting pluggy<1.0,>=0.7.1 (from molecule[docker])
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pluggy/0.13.1/pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
00:02:10.224 Collecting pyyaml (from ansible-lint~=4.2.0)
00:02:10.224   Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyyaml/5.4.1/PyYAML-5.4.1.tar.gz (175 kB)
00:02:10.224      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 175.1/175.1 kB 14.6 MB/s eta 0:00:00
00:02:10.224   Installing build dependencies: started
00:02:10.224   Installing build dependencies: finished with status 'done'
00:02:10.224   Getting requirements to build wheel: started
00:02:10.224   Getting requirements to build wheel: finished with status 'error'
00:02:10.224 molecule: exit 1 (19.26 seconds) /w/workspace/lf-infra-ansible-roles-tox-verify-any> python -I -m pip install 'ansible-lint~=4.2.0' 'ansible~=2.9.6' 'detox~=0.18' docker 'molecule[docker]' 'molecule~=3.0.8' 'pytest~=5.4.0' yamllint pid=3011
00:02:10.376 molecule: FAIL ✖ in 19.88 seconds
00:02:10.376 pre-commit: install_deps> python -I -m pip install pre-commit
00:02:13.616 pre-commit: freeze> python -m pip freeze --all
00:02:13.977 pre-commit: cfgv==3.4.0,distlib==0.3.8,filelock==3.13.1,identify==2.5.33,nodeenv==1.8.0,pip==23.3.1,platformdirs==4.1.0,pre-commit==3.6.0,PyYAML==6.0.1,setuptools==69.0.2,virtualenv==20.25.0,wheel==0.42.0
00:02:13.983 pre-commit: commands[0]> pre-commit run --all-files --show-diff-on-failure
00:02:14.143 [INFO] Initializing environment for https://github.com/pre-commit/pre-commit-hooks.
00:02:14.697 [INFO] Initializing environment for https://github.com/jorisroovers/gitlint.
00:02:15.688 [INFO] Initializing environment for https://github.com/jorisroovers/gitlint:./gitlint-core[trusted-deps].
00:02:16.702 [INFO] Installing environment for https://github.com/pre-commit/pre-commit-hooks.
00:02:16.703 [INFO] Once installed this environment will be reused.
00:02:16.703 [INFO] This may take a few minutes...
00:02:20.177 trim trailing whitespace.................................................Passed
00:02:20.219 pre-commit: commands[1]> /bin/sh -c 'if ! git config --get user.name > /dev/null; then git config --global --add user.name "CI"; touch .git/REMOVE_USERNAME; fi'
00:02:20.227 pre-commit: commands[2]> /bin/sh -c 'if ! git config --get user.email > /dev/null; then git config --global --add user.email "[email protected]"; touch .git/REMOVE_USEREMAIL; fi'
00:02:20.236 pre-commit: commands[3]> /bin/sh -c 'if [ -f .git/COMMIT_EDITMSG ]; then cp .git/COMMIT_EDITMSG .git/COMMIT_MSGTOX; else git log HEAD -n1 | tail -n +5 | cut -c 5- > .git/COMMIT_MSGTOX; fi'
00:02:20.242 pre-commit: commands[4]> pre-commit run gitlint --hook-stage commit-msg --commit-msg-filename .git/COMMIT_MSGTOX
00:02:20.395 [INFO] Installing environment for https://github.com/jorisroovers/gitlint.
00:02:20.396 [INFO] Once installed this environment will be reused.
00:02:20.396 [INFO] This may take a few minutes...
00:02:24.655 gitlint..................................................................Passed
00:02:24.656 pre-commit: commands[5]> /bin/sh -c 'rm -f .git/COMMIT_MSGTOX'
00:02:24.656 pre-commit: commands[6]> /bin/sh -c 'if [ -f .git/REMOVE_USERNAME ]; then git config --global --unset user.name; rm -f .git/REMOVE_USERNAME; fi'
00:02:24.657 pre-commit: commands[7]> /bin/sh -c 'if [ -f .git/REMOVE_USEREMAIL ]; then git config --global --unset user.email; rm -f .git/REMOVE_USEREMAIL; fi'

Please suggest how to resolve these molecule build errors.

[1.] https://github.com/lfit/ansible-roles-docker-install
[2.] https://gerrit.linuxfoundation.org/infra/c/ansible/roles/docker-install/+/70522
[3.] https://jenkins.opendaylight.org/releng/job/lf-infra-ansible-roles-tox-verify-any/762/console

[cavcrosby]

I believe the error you are seeing could be due to the version of pyyaml being installed. When I updated tox.ini and tested tox with either yaml/pyyaml#724 (comment) or yaml/pyyaml#724 (comment), this did not reproduce the issue you're encountering. This seems to all be stemming from yaml/pyyaml#601.