Project

General

Profile

Feature #34264

Add support for configuring a custom S3 endpoint

Added by Bill O'Hanlon about 1 year ago. Updated 10 months ago.

Status:
Done
Priority:
No priority
Assignee:
Vladimir Vinogradenko
Category:
Middleware
Target version:
Estimated time:
Severity:
Med High
Reason for Closing:
Reason for Blocked:
Need verification
Needs QA:
No
Needs Doc:
No
Needs Merging:
No
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:

Description

.....but in 11.1U6. (See https://redmine.ixsystems.com/issues/27794 )

Customer wants to do a POC in near term. William tells me that the already-done work for 27794 can be ported back to 11.1U2 from 11.2 easily.


Related issues

Related to FreeNAS - Feature #27794: Add support for configuring a custom S3 endpointDone
Has duplicate FreeNAS - Feature #27359: Ability to Cloud-Sync to another S3/Minio TargetClosed
Blocks FreeNAS - Feature #34915: Backport S3 v2 signatures to masterDone

Associated revisions

Revision 05917e5f (diff)
Added by Vladimir Vinogradenko about 1 year ago

feat(backup.s3): Allow skipping region autodetect, allow enabling v2 signatures

Ticket: #34264

History

#1 Updated by William Grzybowski about 1 year ago

  • Category changed from OS to Middleware
  • Assignee changed from William Grzybowski to Vladimir Vinogradenko

Vladimir, can you please backport that commit to stable?

#2 Updated by Vladimir Vinogradenko about 1 year ago

  • Status changed from Unscreened to Blocked
  • Reason for Blocked set to On hold

On hold until TrueNAS 11.1-U5 comes out

PR: https://github.com/freenas/freenas/pull/1315

#3 Updated by Dru Lavigne about 1 year ago

  • Related to Feature #27794: Add support for configuring a custom S3 endpoint added

#4 Updated by Bill O'Hanlon about 1 year ago

Customer says they had to use 3 specific settings in their s3cmd config to get this to work from their Ubuntu test bed:

host_base = s3.hicloud.net.tw
host_bucket = %(bucket)s.s3.hicloud.net.tw
signature_v2 = True

That third one, signature_v2, might be a problem. My reading of git commit d685d273 doesn't seem to show a knob like that. Am I correct?

#5 Updated by Vladimir Vinogradenko about 1 year ago

Bill, you are right, there is no way to do signature_v2 with our UI right now (rclone does support it). And there is also no way to configure S3 endpoints that does not support regions.

#6 Updated by Vladimir Vinogradenko about 1 year ago

Bill, supporting this agreed with William, I am proceeding.

#7 Updated by Bill O'Hanlon about 1 year ago

Excellent, thank you.

#8 Updated by Vladimir Vinogradenko about 1 year ago

  • Reason for Blocked changed from On hold to Need verification

Done.

I am unsure if all of this would work for this client correctly because his cloud is proprietary. We definitely should make a special build of FN just for him so he could test it before we release it.

Two additional checkboxes appeared in Cloud Credentials dialog: "No regions" and "Use v2 signatures". Both should be checked.

#9 Updated by Dru Lavigne about 1 year ago

  • Status changed from Blocked to In Progress

#11 Updated by Vladimir Vinogradenko about 1 year ago

  • Status changed from In Progress to Ready for Testing

#12 Updated by Vladimir Vinogradenko about 1 year ago

#13 Updated by Vladimir Vinogradenko about 1 year ago

#14 Updated by Vladimir Vinogradenko about 1 year ago

  • Has duplicate Feature #27359: Ability to Cloud-Sync to another S3/Minio Target added

#16 Updated by Bonnie Follweiler 11 months ago

23900

Test Passes in FreeNAS-11.1-U6-INTERNAL1

#17 Updated by Dru Lavigne 10 months ago

  • Status changed from Passed Testing to Done
  • Needs Doc changed from Yes to No
  • Needs Merging changed from Yes to No

Also available in: Atom PDF