Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Separate data storage #19

Merged
merged 15 commits into from
Jul 2, 2024
Merged

Separate data storage #19

merged 15 commits into from
Jul 2, 2024

Conversation

antiguru
Copy link
Owner

@antiguru antiguru commented Feb 26, 2024

Abstractions and implementations to separate region behavior from allocation patterns. This PR introduces a Storage trait that allows to abstract allocations and hide them behind a common interface. Implementations need to accept items using a PushStorage trait (which is semantically equivalent to Timely's PushInto trait, but cannot be used due to the dependency graph), and items can be extracted using Index implementations. The OffsetContainer is an extension to Storage specialized to storing usize values.

The API is based on how flat container uses its storage, but little work has been put into making it a nice API -- it needs to support various specific types, and due to the lack of specialization, we need to have different functions to enable efficient copying.

@antiguru antiguru force-pushed the storage branch 2 times, most recently from d5460fd to 5fc0e05 Compare May 31, 2024 20:59
@antiguru antiguru force-pushed the storage branch 6 times, most recently from 30a2d61 to 7cf69a6 Compare June 27, 2024 15:29
@antiguru antiguru changed the title Slice storage Separate data storage Jul 2, 2024
@antiguru antiguru marked this pull request as ready for review July 2, 2024 01:45
antiguru added 11 commits July 1, 2024 21:47
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
antiguru added 3 commits July 2, 2024 13:04
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
Signed-off-by: Moritz Hoffmann <[email protected]>
@antiguru antiguru merged commit bc4b8e9 into main Jul 2, 2024
8 checks passed
@antiguru antiguru deleted the storage branch July 2, 2024 17:20
@github-actions github-actions bot mentioned this pull request Jul 2, 2024
@antiguru
Copy link
Owner Author

antiguru commented Jul 2, 2024

728e96e (#19) contains some ideas that we could resurrect if we want to. Specifically, it contains a Doubling storage container, which doesn't reallocate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant