You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, a lot of functionality for the different Reader and Writer is based on <File> and thus quite restricted.
Rework the Reader and Writer structs for all modules to be more generic, e.g. require Read + Seek etc.
This would enable clients to be more dynamic in input and output data. For example, one could use an S3-based reference genome and ATGlib would only read the required sections, not have to download the full reference genome. It would also allow streaming from/to S3. (use https://crates.io/crates/s3reader)
The text was updated successfully, but these errors were encountered:
anergictcell
changed the title
More dynamic Reader and Writer
Code Improvement: More dynamic Reader and Writer
Sep 22, 2022
FastaReader can now use any Read + Seek implementer as an internal reader. The old version only allowed File based readers, but now clients can use more abstract readers, e.g. via HTTP or directly from an S3 bucket using S3Reader.
Relates to #7
Currently, a lot of functionality for the different Reader and Writer is based on
<File>
and thus quite restricted.Rework the Reader and Writer structs for all modules to be more generic, e.g. require
Read + Seek
etc.This would enable clients to be more dynamic in input and output data. For example, one could use an S3-based reference genome and
ATGlib
would only read the required sections, not have to download the full reference genome. It would also allow streaming from/to S3. (use https://crates.io/crates/s3reader)The text was updated successfully, but these errors were encountered: