Code

Rename Delete on Blob endpoint.#117

Code

Merged

saxenapranav merged 86 commits intowasbDepCodeReviewABFSDriver/AbfsHadoop:wasbDepCodeReviewfrom renameDeleteABFSDriver/AbfsHadoop:renameDeleteCopy head branch name to clipboardJun 26, 2024

+3,771-106

Commits

Commits on May 6, 2024

• RenameHandler + DfsRenameHandler

  saxenapranav

  committed
  c036404

  Copy full SHA for c036404

Commits on May 7, 2024

• pathinformation; shorten prechecks for dfs case

  saxenapranav

  committed
  ea2bef1

  Copy full SHA for ea2bef1

• prechecks for blob handler

  saxenapranav

  committed
  870361b

  Copy full SHA for 870361b

• deleteHandler

  saxenapranav

  committed
  c2bacc3

  Copy full SHA for c2bacc3

• new config: fs.azure.blob.implicit.check.enabled

  saxenapranav

  committed
  0005ca9

  Copy full SHA for 0005ca9

• Merge branch 'implicitConfg' into renameDelete

  saxenapranav

  committed
  c3372af

  Copy full SHA for c3372af

• Merge branch 'azureBlobClient' into renameDelete

  saxenapranav

  committed
  75edc7b

  Copy full SHA for 75edc7b

Commits on May 8, 2024

• ListActionTaker

  saxenapranav

  committed
  f17b0b7

  Copy full SHA for f17b0b7

• delete code done

  saxenapranav

  committed
  eb642bc

  Copy full SHA for eb642bc

• wip

  saxenapranav

  committed
  798e23e

  Copy full SHA for 798e23e

Commits on May 9, 2024

• copy progress

  saxenapranav

  committed
  8282cc4

  Copy full SHA for 8282cc4

• copy Blob impl

  saxenapranav

  committed
  fe41cca

  Copy full SHA for fe41cca

• renameAtomicity

  saxenapranav

  committed
  0ad1214

  Copy full SHA for 0ad1214

• listStatus and getPathStatus to do renameAtomic

  saxenapranav

  committed
  4d48fe8

  Copy full SHA for 4d48fe8

Commits on May 10, 2024

• test fixture

  saxenapranav

  committed
  0b9b032

  Copy full SHA for 0b9b032

Commits on May 13, 2024

• Merge branch 'azureBlobClient' into renameDelete

  saxenapranav

  committed
  4ffef8f

  Copy full SHA for 4ffef8f

• createPath, getBlobProperty in blob for meanwhile; to be removed later

  saxenapranav

  committed
  d5acd2f

  Copy full SHA for d5acd2f

Commits on May 14, 2024

• Merge branch 'azureBlobClient' into renameDelete

  saxenapranav

  committed
  710ca79

  Copy full SHA for 710ca79

• no renameHandler abstract class; have blobRenameHandler from the blobClient

  saxenapranav

  committed
  df84b40

  Copy full SHA for df84b40

• deleteHandler

  saxenapranav

  committed
  2c67654

  Copy full SHA for 2c67654

• rename and delete internal method

  saxenapranav

  committed
  e030dc7

  Copy full SHA for e030dc7

• remove unnecessary class

  saxenapranav

  committed
  bab4bb8

  Copy full SHA for bab4bb8

• createCallback and readCallback in store

  saxenapranav

  committed
  0fc7ca8

  Copy full SHA for 0fc7ca8

• Revert "new config: fs.azure.blob.implicit.check.enabled"

  Show description for ceb2dc7
  saxenapranav

  committed
  ceb2dc7

  Copy full SHA for ceb2dc7

Commits on May 15, 2024

• important changes for renameatomicity

  saxenapranav

  committed
  5661eb2

  Copy full SHA for 5661eb2

• abfsbloblease in renamehandler

  saxenapranav

  committed
  1b3ee3f

  Copy full SHA for 1b3ee3f

• client forwards; tests additions;

  saxenapranav

  committed
  97b6b03

  Copy full SHA for 97b6b03

• all current delete tests: good.

  saxenapranav

  committed
  ca6feac

  Copy full SHA for ca6feac

• rename required changes to make test run

  saxenapranav

  committed
  f96afce

  Copy full SHA for f96afce

Commits on May 16, 2024

• call pathStatus on nonRoot path; is src path is not there, throw IOException from BlobRenaameHandler

  saxenapranav

  committed
  ce181de

  Copy full SHA for ce181de

• checkParentDestination metadata test refactor

  saxenapranav

  committed
  2fc652e

  Copy full SHA for 2fc652e

• producer / consumer logic braught in.

  saxenapranav

  committed
  71f8405

  Copy full SHA for 71f8405

• added new test for implicit / producer-consumer; src changes

  saxenapranav

  committed
  a865e34

  Copy full SHA for a865e34

Commits on May 17, 2024

• Assert that delete operation failure should stop List producer.

  saxenapranav

  committed
  32add3b

  Copy full SHA for 32add3b

• etag check before starting rename

  saxenapranav

  committed
  52c1822

  Copy full SHA for 52c1822

Commits on May 20, 2024

• tests for liststatus and getPathStatus recovery

  saxenapranav

  committed
  9359ae0

  Copy full SHA for 9359ae0

• tests wip

  saxenapranav

  committed
  e8b48f1

  Copy full SHA for e8b48f1

• resue same method

  saxenapranav

  committed
  ed6ecdc

  Copy full SHA for ed6ecdc

Commits on May 21, 2024

• Merge branch 'azureBlobClient' into renameDelete

  saxenapranav

  committed
  7d574a5

  Copy full SHA for 7d574a5

• blob copy idempotency check in src; added tests

  saxenapranav

  committed
  896204d

  Copy full SHA for 896204d

• tests complete

  saxenapranav

  committed
  6115a08

  Copy full SHA for 6115a08

• Merge branch 'azureBlobClient' into renameDelete

  saxenapranav

  committed
  328e097

  Copy full SHA for 328e097

• new delete tests + contract working fine

  saxenapranav

  committed
  ab31f75

  Copy full SHA for ab31f75

Commits on May 22, 2024

• all tests working

  saxenapranav

  committed
  e446e75

  Copy full SHA for e446e75

• tracing context of final blob operation to have op count for rename/delete

  saxenapranav

  committed
  a2cc587

  Copy full SHA for a2cc587

• test fixes

  saxenapranav

  committed
  0f6db9d

  Copy full SHA for 0f6db9d

• asf license on new src files

  saxenapranav

  committed
  d22b99c

  Copy full SHA for d22b99c

Commits on May 27, 2024

• leaseTimerTask class

  saxenapranav

  committed
  27cd964

  Copy full SHA for 27cd964

• pr refactors

  saxenapranav

  committed
  5adb6f0

  Copy full SHA for 5adb6f0

• pr refactors

  saxenapranav

  committed
  4d995a3

  Copy full SHA for 4d995a3

• test fixed

  saxenapranav

  committed
  a50dab1

  Copy full SHA for a50dab1

• fix test

  saxenapranav

  committed
  91fb94a

  Copy full SHA for 91fb94a

Commits on May 28, 2024

• remove unwanted code for test

  saxenapranav

  committed
  747a51d

  Copy full SHA for 747a51d

• callbacks to have tracingContext

  saxenapranav

  committed
  20155f3

  Copy full SHA for 20155f3

• correction

  saxenapranav

  committed
  07dfbdb

  Copy full SHA for 07dfbdb

• added javadocs

  saxenapranav

  committed
  8756887

  Copy full SHA for 8756887

• remove unwanted code

  saxenapranav

  committed
  3ec178b

  Copy full SHA for 3ec178b

• preRename to happen only on directory rename

  saxenapranav

  committed
  7fda902

  Copy full SHA for 7fda902

Commits on Jun 5, 2024

• changes for new integeration

  saxenapranav

  committed
  21d0e4f

  Copy full SHA for 21d0e4f

• fix for unicode test

  saxenapranav

  committed
  29c3c41

  Copy full SHA for 29c3c41

• integ issue resovled

  saxenapranav

  committed
  e134292

  Copy full SHA for e134292

Commits on Jun 10, 2024

• Merge branch 'wasbDeprecation_Dev' into renameDelete

  saxenapranav

  committed
  2e4fb2d

  Copy full SHA for 2e4fb2d

• assumption in testProducerStopOnRenameFailure

  saxenapranav

  committed
  aa9866b

  Copy full SHA for aa9866b

Commits on Jun 12, 2024

• queue public ops should be synced; minor refactors. (#114)

  Show description for c7099db
  saxenapranav

  committed
  c7099db

  Copy full SHA for c7099db

Commits on Jun 13, 2024

• correction of test of testDeleteIdempotencyTriggerHttp404 -> not to run on blob endpoint

  saxenapranav

  committed
  d0cb5b9

  Copy full SHA for d0cb5b9

• Merge branch 'azureBlobClient' into renameDelete

  saxenapranav

  committed
  a961ab1

  Copy full SHA for a961ab1

• remove pathUtils

  saxenapranav

  committed
  2792325

  Copy full SHA for 2792325

• take action on renamePending json from client abstract method

  saxenapranav

  committed
  182967e

  Copy full SHA for 182967e

• getClient to get mocking correct in the test

  Show description for a705138
  saxenapranav

  committed
  a705138

  Copy full SHA for a705138

• to return BLOB_PATH_NOT_FOUND is already added in the azureBlobClient branch.

  saxenapranav

  committed
  736b32a

  Copy full SHA for 736b32a

Commits on Jun 14, 2024

• review comments

  saxenapranav

  committed
  652c15b

  Copy full SHA for 652c15b

Commits on Jun 17, 2024

• removed callbacks; test fixes;

  saxenapranav

  committed
  5303166

  Copy full SHA for 5303166

• added asf and javadocs on RenameAtomicityTestUtils

  saxenapranav

  committed
  ec869ee

  Copy full SHA for ec869ee

• remove overwrite overload

  saxenapranav

  committed
  6f26b81

  Copy full SHA for 6f26b81

Commits on Jun 18, 2024

• javadocs

  saxenapranav

  committed
  8c5af2e

  Copy full SHA for 8c5af2e

• Merge branch 'azureBlobClient' into renameDelete

  saxenapranav

  committed
  ebde8d9

  Copy full SHA for ebde8d9

Commits on Jun 21, 2024

• Rename delete review comments. (#120)

  Show description for 61da75d
  saxenapranav

  authored
  61da75d

  Copy full SHA for 61da75d

• Merge branch 'wasbDepCodeReview' into renameDelete

  saxenapranav

  authored
  5f92b37

  Copy full SHA for 5f92b37

Commits on Jun 24, 2024

• consume JsonProcessingException if json string is invalid

  Show description for 8cb4c6f
  saxenapranav

  committed
  8cb4c6f

  Copy full SHA for 8cb4c6f

• Merge branch 'renameDelete' of github.com:ABFSDriver/AbfsHadoop into renameDelete

  saxenapranav

  committed
  dd6f5dc

  Copy full SHA for dd6f5dc

• import checks

  saxenapranav

  committed
  5afeaef

  Copy full SHA for 5afeaef

• remove casting from ListActionTaker for client, it s going to be AbfsBlobClient always. No casting required

  saxenapranav

  committed
  e816e96

  Copy full SHA for e816e96

Commits on Jun 25, 2024

• nits refactors;

  saxenapranav

  committed
  7b53575

  Copy full SHA for 7b53575

• Merge branch 'wasbDepCodeReview' into renameDelete

  saxenapranav

  committed
  d6de0c4

  Copy full SHA for d6de0c4

• refactors

  saxenapranav

  committed
  603caea

  Copy full SHA for 603caea

• release the lease when the rename is not fully successful

  saxenapranav

  committed
  52bcd11

  Copy full SHA for 52bcd11