Update documentation in AbstractDataset
to show proper creation of a custom pytorch dataset
#255
Labels
documentation
Improvements or additions to documentation
Most importantly we need to update the
__getitem__
, since we cannot return arbitrary pytrees intorch.utils.data.Dataset
s.However, this will also involve thinking about how to load things so that we do not make unnecessary array copies. Taking the
RelionDataset
for example, some questions are__getitem__
? This would give us the control to make sure conversion is copy-free, on either GPU or CPU (see https://jax.readthedocs.io/en/latest/jax.dlpack.html)is_cpu_array
boolean in theRelionDataset
to force JAX arrays to be read on the CPU? We definitely do not want to move to the GPU and back to the CPU unnecessarily.The text was updated successfully, but these errors were encountered: