Add ability to scrub from last scrubbed txg #16301
Open
+246
−29
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
from
68edb6e
to
42d967f
Compare
allanjude
reviewed
Jul 11, 2024
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
from
42d967f
to
8d59c2c
Compare
|
I noticed a $ sudo ./zpool scrub tank && sleep 1 && sudo ./zpool scrub -p tank
$ sudo ./zpool status
pool: tank
state: ONLINE
scan: scrub paused since Tue Aug 27 16:02:26 2024
scrub started on Tue Aug 27 16:02:25 2024
14.7G / 14.7G scanned, 3.22G / 14.7G issued
0B repaired, 21.95% done
config:
NAME STATE READ WRITE CKSUM
tank ONLINE 0 0 0
vdb ONLINE 0 0 0
errors: No known data errors
$ sudo ./zpool scrub -C tank
cannot scrub tank: delegated administration is disabled on pool
$ echo $?
1
$ sudo ./zpool status
pool: tank
state: ONLINE
scan: scrub repaired 0B in 00:00:14 with 0 errors on Tue Aug 27 16:02:39 2024
config:
NAME STATE READ WRITE CKSUM
tank ONLINE 0 0 0
vdb ONLINE 0 0 0
errors: No known data errorsIt returns an error code, but then the scrub seems to complete successfully. Any thoughts? |
|
@tonyhutter This is after the applied patch, but without it, it works fine? |
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
from
8d59c2c
to
cc72197
Compare
|
I have added another feature just to scrub "recent data". |
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
from
cc72197
to
4823cc2
Compare
amotin
reviewed
Sep 6, 2024
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
2 times, most recently
from
2a34659
to
d9c7d38
Compare
|
@oshogbo Would you rebase and resolve the test failures? |
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
from
d9c7d38
to
f108d90
Compare
|
@amotin Yes, let my try to fix that. |
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
from
f108d90
to
b08bd76
Compare
amotin
reviewed
Nov 7, 2024
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
3 times, most recently
from
e5635df
to
77f2265
Compare
amotin
approved these changes
Nov 15, 2024
allanjude
approved these changes
Nov 15, 2024
behlendorf
reviewed
Nov 15, 2024
oshogbo
force-pushed
the
zfs_scrub_last_scrubbed_txg
branch
from
77f2265
to
0e0cd2a
Compare
|
@behlendorf @allanjude @amotin Thank you for the review. |
Sponsored-By: Wasabi Technology, Inc. Sponsored-By: Klara Inc. Signed-off-by: Mariusz Zaborski <[email protected]>
The `last_scrubbed_txg` property indicates the transaction group (TXG) up to which the most recent scrub operation has checked and repaired the dataset. This provides administrators with insight into the data integrity status of their pool at a specific point in time. Sponsored-By: Wasabi Technology, Inc. Sponsored-By: Klara Inc. Signed-off-by: Mariusz Zaborski <[email protected]>
behlendorf
approved these changes
Nov 19, 2024
|
@oshogbo it looks like this change unexpectedly breaks ztest. I've resubmitted the ztest CI build multiple times now and haven't been able to get a clean pass. Can you take a look at the CI logs from the failures: https://github.com/openzfs/zfs/actions/runs/11891031862?pr=16301 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation and Context
Sometimes it is useful to only scrub a particular range of txg. Some users might want to scrub only new data because they would like to know if the new write wasn't corrupted. This PR adds possiblity scrub only newly flushed data.
Description
Users who would like to scrub only new data, a new zpool property was introduced, that stores last scrubbed txg, so users can run scrub only from the last saved point.
We use a scn_max_txg and scn_min_txg which are already built into scrub, to accomplish that.
How Has This Been Tested?
Via test cases.
Types of changes
Checklist:
Signed-off-by.