Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor the process of index files maintaining for upload-bin #3744

Open
AliceInHunterland opened this issue Dec 11, 2024 · 3 comments
Open
Labels
blocked Can't be done because of something cli Command line interface enhancement Improving existing functionality I3 Minimal impact S3 Minimally significant U4 Nothing urgent

Comments

@AliceInHunterland
Copy link
Contributor

Is your feature request related to a problem? Please describe.

Currently:

For a given block sequence, only one type of index file is supported. If new index 
files are needed (different `index-file-size` or `index-attribute`), the entire 
block sequence must be uploaded from the beginning.

Describe the solution you'd like

Be able to create index files with different index-attribute or index-file-size based on the already uploaded block sequence.

Describe alternatives you've considered

Leave it as is.

@AliceInHunterland AliceInHunterland added feature Completely new functionality I2 Regular impact U4 Nothing urgent enhancement Improving existing functionality cli Command line interface S3 Minimally significant labels Dec 11, 2024
@roman-khimov roman-khimov added I3 Minimal impact and removed feature Completely new functionality I2 Regular impact labels Dec 11, 2024
@roman-khimov
Copy link
Member

I think reupload is not a big problem in this scenario, these parameters are not changed often and ideally we want to avoid index files at all.

@AnnaShaleva
Copy link
Member

AnnaShaleva commented Dec 11, 2024

See also #3735 (comment), I agree that in future we need to remove index files support. So the task is either to remove index files at all, or implement the solution described in Describe the solution you'd like section. Depends on #3707 and #3645.

@AnnaShaleva AnnaShaleva changed the title upload-bin can have several types of index files in the container Refactor the process of index files maintaining for upload-bin Dec 11, 2024
@AliceInHunterland
Copy link
Contributor Author

As for

ideally we want to avoid index files at all.

#3735 (comment) - we are about to make the uploaded block calculation based on index files.
We can move to the no-index file scenario only after nspcc-dev/neofs-node#2990

@AnnaShaleva AnnaShaleva added the blocked Can't be done because of something label Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocked Can't be done because of something cli Command line interface enhancement Improving existing functionality I3 Minimal impact S3 Minimally significant U4 Nothing urgent
Projects
None yet
Development

No branches or pull requests

3 participants