Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

copy error when used with HuaweiOBS #2834

Closed
2 of 3 tasks
haoze15236 opened this issue Oct 15, 2024 · 3 comments
Closed
2 of 3 tasks

copy error when used with HuaweiOBS #2834

haoze15236 opened this issue Oct 15, 2024 · 3 comments
Assignees
Labels
response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days.

Comments

@haoze15236
Copy link

Acknowledgements

Describe the bug

I'm facing NoSuchKey error when I use HuaweiOBS provider
image

Regression Issue

  • Select this option if this issue appears to be a regression.

Expected Behavior

I hope the copy can be successful when i use HuaweiOBS

Current Behavior

After consulting Huawei OBS technical personnel, they concluded that the query parameter cannot be added during put upload, but x-id can be added during rclone copy. Only GCS requests will remove this parameter.

Reproduction Steps

rclone copy /root/aa posix:haozebucket/

Possible Solution

Is the x-id parameter mandatory? Can a configuration be provided to control whether the X-ID is carried?

Additional Information/Context

No response

AWS Go SDK V2 Module Versions Used

rclone v1.68.1

  • os/version: euleros 2.0 (64 bit)
  • os/kernel: 3.10.0-327.62.59.83.h108.x86_64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.23.1
  • go/linking: static
  • go/tags: none

Compiler and Version used

go version go1.21.6 windows/amd64

Operating System and version

centos 8.1

@haoze15236 haoze15236 added bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Oct 15, 2024
@bhavya2109sharma bhavya2109sharma self-assigned this Oct 15, 2024
@bhavya2109sharma
Copy link
Contributor

Hello @haoze15236,

Thanks for reaching out.
Could you please provide a code example that reproduces the issue you're facing? Also, can you provide more details/context about the issue for better understanding.

Thanks,
Bhavya

@bhavya2109sharma bhavya2109sharma added response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. and removed bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Oct 15, 2024
@RanVaknin
Copy link
Contributor

Hi @haoze15236 ,

Is the x-id parameter mandatory? Can a configuration be provided to control whether the X-ID is carried?

x-id was added as a parameter to disambiguate calls to S3, and the actual AWS S3 server supports it.

The AWS SDK only guarantees support for AWS products. We do not support HuaweiOBS / digital ocean spaces /Minio and any other S3 clones. You'll have to reach out to Huawei for them to add support for it or implement a middleware the removes this from the request before its being sent to the server.

Thanks,
Ran~

@RanVaknin RanVaknin closed this as not planned Won't fix, can't repro, duplicate, stale Oct 15, 2024
Copy link

This issue is now closed. Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days.
Projects
None yet
Development

No branches or pull requests

3 participants