Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OSError: [Errno 28] No space left on device #31

Open
17780537256 opened this issue Aug 24, 2022 · 0 comments
Open

OSError: [Errno 28] No space left on device #31

17780537256 opened this issue Aug 24, 2022 · 0 comments

Comments

@17780537256
Copy link

17780537256 commented Aug 24, 2022

I'm running into out of storage issues while training (the "PPO" algorithm) as follows:

2022-08-24 11:57:32,014 WARNING worker.py:1404 -- Traceback (most recent call last):
File "python/ray/_raylet.pyx", line 896, in ray._raylet.spill_objects_handler
File "python/ray/_raylet.pyx", line 899, in ray._raylet.spill_objects_handler
File "/home/xxx/anaconda3/envs/mujoco_env/lib/python3.7/site-packages/ray/external_storage.py", line 662, in spill_objects
return _external_storage.spill_objects(object_refs, owner_addresses)
File "/home/xxx/anaconda3/envs/mujoco_env/lib/python3.7/site-packages/ray/external_storage.py", line 303, in spill_objects
return self._write_multiple_objects(f, object_refs, owner_addresses, url)
File "/home/xxx/anaconda3/envs/mujoco_env/lib/python3.7/site-packages/ray/external_storage.py", line 151, in _write_multiple_objects
written_bytes = f.write(payload)
OSError: [Errno 28] No space left on device
An unexpected internal error occurred while the IO worker was spilling objects: [Errno 28] No space left on device

Approximately how much space is required for the "apex" project to train. thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant