Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The Dask Runner Tests job is flaky #30528

Closed
github-actions bot opened this issue Mar 5, 2024 · 5 comments · Fixed by #33172
Closed

The Dask Runner Tests job is flaky #30528

github-actions bot opened this issue Mar 5, 2024 · 5 comments · Fixed by #33172

Comments

@github-actions
Copy link
Contributor

github-actions bot commented Mar 5, 2024

The Dask Runner Tests is failing over 50% of the time
Please visit https://github.com/apache/beam/actions/workflows/dask_runner_tests.yml?query=is%3Afailure+branch%3Amaster to see the logs.

@liferoad
Copy link
Collaborator

This never works. Move this to P4.

@github-actions github-actions bot added this to the 2.59.0 Release milestone Aug 20, 2024
@github-actions github-actions bot reopened this Aug 23, 2024
Copy link
Contributor Author

Reopening since the workflow is still flaky

@damccorm damccorm removed this from the 2.59.0 Release milestone Aug 23, 2024
@liferoad
Copy link
Collaborator

>     results = [v.value for v in tagged_receivers.values]
E     TypeError: 'builtin_function_or_method' object is not iterable

target\.tox\py310-win-dask\lib\site-packages\apache_beam\runners\dask\transform_evaluator.py:175: TypeError

@liferoad
Copy link
Collaborator

py3.9:

Collecting distributed>=2024.4.2
  Using cached distributed-20[24](https://github.com/apache/beam/actions/runs/11907937848/job/33182463841#step:7:25).8.0-py3-none-any.whl.metadata (3.4 kB)
Collecting dask>=2024.4.2
  Using cached dask-2024.8.0-py3-none-any.whl.metadata (3.8 kB)

but py 3.10

Collecting distributed>=2024.4.2
  Using cached distributed-20[24](https://github.com/apache/beam/actions/runs/11907937848/job/33182464057#step:7:25).11.2-py3-none-any.whl.metadata (3.3 kB)
Collecting dask>=2024.4.2
  Using cached dask-2024.11.2-py3-none-any.whl.metadata (3.7 kB)

this needs

Collecting cloudpickle>=3.0.0 (from distributed>=2024.4.2)

but beam needs

apache-beam 2.62.0.dev0 requires cloudpickle~=2.2.1, but you have cloudpickle 3.1.0 which is incompatible.

@liferoad
Copy link
Collaborator

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants