Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove atomic dir action in fileStatus and listStatus from store class #123

Merged
merged 89 commits into from
Jul 1, 2024

Conversation

saxenapranav
Copy link
Collaborator

Followup of #117 to comment #117 (comment)

saxenapranav and others added 21 commits June 13, 2024 00:22
#120

* change exception type; other review comments;

* comments wip

* sync checks review wip

* reviews comments at higher level taken

* atomic method abstraction to client

* Permissions not to have public constructor

* added javadocs

small fix : sync should return

fix + lease can be sync and async.

test fix3

fix2

fix1

* javadocs
deserialization needs empty constructor

concurrency control to get availableSize

no manual json parsing in renameAtomicity
@saxenapranav
Copy link
Collaborator Author


:::: AGGREGATED TEST RESULT ::::

============================================================
NonHNS-SharedKey

[WARNING] Tests run: 146, Failures: 0, Errors: 0, Skipped: 11
[WARNING] Tests run: 685, Failures: 0, Errors: 0, Skipped: 278
[WARNING] Tests run: 414, Failures: 0, Errors: 0, Skipped: 39

Time taken: 7 mins 5 secs.
azureuser@pranav-ind-vm:~/AbfsHadoop/hadoop-tools/hadoop-azure$ git log
commit fd85f5c (HEAD -> renameDelete, origin/renameDelete)
Author: Pranav Saxena [email protected]
Date: Mon Jul 1 09:47:46 2024 +0530

Remove atomic dir action in fileStatus and listStatus from store class. (#122)

https://github.com/ABFSDriver/AbfsHadoop/pull/122
fs.azure.abfs.account.name pranavsaxenaxxxx.blob.core.windows.net fs.contract.test.fs.abfs abfs://[email protected]

try {
return objectMapper.writeValueAsString(renamePendingJsonFormat);
} catch (JsonProcessingException e) {
throw new AbfsDriverException(e);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Is this new exception type needed ?

@saxenapranav saxenapranav merged commit ff0b962 into wasbDepCodeReview Jul 1, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants