Skip to content

Commit eb3082a

Browse files
ncwncw
committed
s3: add Linode provider
1 parent 77ea22a commit eb3082a

File tree

4 files changed

+182
-4
lines changed

4 files changed

+182
-4
lines changed

‎README.md

+1
Original file line numberDiff line numberDiff line change
@@ -53,6 +53,7 @@ Rclone *("rsync for cloud storage")* is a command-line program to sync files and
5353
* Koofr [:page_facing_up:](https://rclone.org/koofr/)
5454
* Leviia Object Storage [:page_facing_up:](https://rclone.org/s3/#leviia)
5555
* Liara Object Storage [:page_facing_up:](https://rclone.org/s3/#liara-object-storage)
56+
* Linode Object Storage [:page_facing_up:](https://rclone.org/s3/#linode)
5657
* Mail.ru Cloud [:page_facing_up:](https://rclone.org/mailru/)
5758
* Memset Memstore [:page_facing_up:](https://rclone.org/swift/)
5859
* Mega [:page_facing_up:](https://rclone.org/mega/)

‎backend/s3/s3.go

+44-3
Original file line numberDiff line numberDiff line change
@@ -121,6 +121,9 @@ var providerOption = fs.Option{
121121
}, {
122122
Value: "Liara",
123123
Help: "Liara Object Storage",
124+
}, {
125+
Value: "Linode",
126+
Help: "Linode Object Storage",
124127
}, {
125128
Value: "Minio",
126129
Help: "Minio Object Storage",
@@ -516,7 +519,7 @@ func init() {
516519
}, {
517520
Name: "region",
518521
Help: "Region to connect to.\n\nLeave blank if you are using an S3 clone and you don't have a region.",
519-
Provider: "!AWS,Alibaba,ArvanCloud,ChinaMobile,Cloudflare,IONOS,Petabox,Liara,Qiniu,RackCorp,Scaleway,Storj,Synology,TencentCOS,HuaweiOBS,IDrive",
522+
Provider: "!AWS,Alibaba,ArvanCloud,ChinaMobile,Cloudflare,IONOS,Petabox,Liara,Linode,Qiniu,RackCorp,Scaleway,Storj,Synology,TencentCOS,HuaweiOBS,IDrive",
520523
Examples: []fs.OptionExample{{
521524
Value: "",
522525
Help: "Use this if unsure.\nWill use v4 signatures and an empty region.",
@@ -883,6 +886,42 @@ func init() {
883886
Value: "storage.iran.liara.space",
884887
Help: "The default endpoint\nIran",
885888
}},
889+
}, {
890+
// Linode endpoints: https://www.linode.com/docs/products/storage/object-storage/guides/urls/#cluster-url-s3-endpoint
891+
Name: "endpoint",
892+
Help: "Endpoint for Linode Object Storage API.",
893+
Provider: "Linode",
894+
Examples: []fs.OptionExample{{
895+
Value: "us-southeast-1.linodeobjects.com",
896+
Help: "Atlanta, GA (USA), us-southeast-1",
897+
}, {
898+
Value: "us-ord-1.linodeobjects.com",
899+
Help: "Chicago, IL (USA), us-ord-1",
900+
}, {
901+
Value: "eu-central-1.linodeobjects.com",
902+
Help: "Frankfurt (Germany), eu-central-1",
903+
}, {
904+
Value: "it-mil-1.linodeobjects.com",
905+
Help: "Milan (Italy), it-mil-1",
906+
}, {
907+
Value: "us-east-1.linodeobjects.com",
908+
Help: "Newark, NJ (USA), us-east-1",
909+
}, {
910+
Value: "fr-par-1.linodeobjects.com",
911+
Help: "Paris (France), fr-par-1",
912+
}, {
913+
Value: "us-sea-1.linodeobjects.com",
914+
Help: "Seattle, WA (USA), us-sea-1",
915+
}, {
916+
Value: "ap-south-1.linodeobjects.com",
917+
Help: "Singapore ap-south-1",
918+
}, {
919+
Value: "se-sto-1.linodeobjects.com",
920+
Help: "Stockholm (Sweden), se-sto-1",
921+
}, {
922+
Value: "us-iad-1.linodeobjects.com",
923+
Help: "Washington, DC, (USA), us-iad-1",
924+
}},
886925
}, {
887926
// oss endpoints: https://help.aliyun.com/document_detail/31837.html
888927
Name: "endpoint",
@@ -1235,7 +1274,7 @@ func init() {
12351274
}, {
12361275
Name: "endpoint",
12371276
Help: "Endpoint for S3 API.\n\nRequired when using an S3 clone.",
1238-
Provider: "!AWS,ArvanCloud,IBMCOS,IDrive,IONOS,TencentCOS,HuaweiOBS,Alibaba,ChinaMobile,GCS,Liara,Scaleway,StackPath,Storj,Synology,RackCorp,Qiniu,Petabox",
1277+
Provider: "!AWS,ArvanCloud,IBMCOS,IDrive,IONOS,TencentCOS,HuaweiOBS,Alibaba,ChinaMobile,GCS,Liara,Linode,Scaleway,StackPath,Storj,Synology,RackCorp,Qiniu,Petabox",
12391278
Examples: []fs.OptionExample{{
12401279
Value: "objects-us-east-1.dream.io",
12411280
Help: "Dream Objects endpoint",
@@ -1723,7 +1762,7 @@ func init() {
17231762
}, {
17241763
Name: "location_constraint",
17251764
Help: "Location constraint - must be set to match the Region.\n\nLeave blank if not sure. Used when creating buckets only.",
1726-
Provider: "!AWS,Alibaba,ArvanCloud,HuaweiOBS,ChinaMobile,Cloudflare,IBMCOS,IDrive,IONOS,Leviia,Liara,Qiniu,RackCorp,Scaleway,StackPath,Storj,TencentCOS,Petabox",
1765+
Provider: "!AWS,Alibaba,ArvanCloud,HuaweiOBS,ChinaMobile,Cloudflare,IBMCOS,IDrive,IONOS,Leviia,Liara,Linode,Qiniu,RackCorp,Scaleway,StackPath,Storj,TencentCOS,Petabox",
17271766
}, {
17281767
Name: "acl",
17291768
Help: `Canned ACL used when creating buckets and storing or copying objects.
@@ -3015,6 +3054,8 @@ func setQuirks(opt *Options) {
30153054
virtualHostStyle = false
30163055
urlEncodeListings = false
30173056
useMultipartEtag = false
3057+
case "Linode":
3058+
// No quirks
30183059
case "LyveCloud":
30193060
useMultipartEtag = false // LyveCloud seems to calculate multipart Etags differently from AWS
30203061
case "Minio":

‎docs/content/_index.md

+1
Original file line numberDiff line numberDiff line change
@@ -138,6 +138,7 @@ WebDAV or S3, that work out of the box.)
138138
{{< provider name="Koofr" home="https://koofr.eu/" config="/koofr/" >}}
139139
{{< provider name="Leviia Object Storage" home="https://www.leviia.com/object-storage" config="/s3/#leviia" >}}
140140
{{< provider name="Liara Object Storage" home="https://liara.ir/landing/object-storage" config="/s3/#liara-object-storage" >}}
141+
{{< provider name="Linode Object Storage" home="https://www.linode.com/products/object-storage/" config="/s3/#linode" >}}
141142
{{< provider name="Mail.ru Cloud" home="https://cloud.mail.ru/" config="/mailru/" >}}
142143
{{< provider name="Memset Memstore" home="https://www.memset.com/cloud/storage/" config="/swift/" >}}
143144
{{< provider name="Mega" home="https://mega.nz/" config="/mega/" >}}

‎docs/content/s3.md

+136-1
Original file line numberDiff line numberDiff line change
@@ -22,8 +22,9 @@ The S3 backend can be used with a number of different providers:
2222
{{< provider name="IBM COS S3" home="http://www.ibm.com/cloud/object-storage" config="/s3/#ibm-cos-s3" >}}
2323
{{< provider name="IDrive e2" home="https://www.idrive.com/e2/?refer=rclone" config="/s3/#idrive-e2" >}}
2424
{{< provider name="IONOS Cloud" home="https://cloud.ionos.com/storage/object-storage" config="/s3/#ionos" >}}
25-
{{< provider name="Leviia Object Storage" home="https://www.leviia.com/object-storage/" config="/s3/#leviia" >}}
25+
{{< provider name="Leviia Object Storage" home="https://www.leviia.com/object-storage/" config="/s3/#leviia" >}}
2626
{{< provider name="Liara Object Storage" home="https://liara.ir/landing/object-storage" config="/s3/#liara-cloud" >}}
27+
{{< provider name="Linode Object Storage" home="https://www.linode.com/products/object-storage/" config="/s3/#linode" >}}
2728
{{< provider name="Minio" home="https://www.minio.io/" config="/s3/#minio" >}}
2829
{{< provider name="Petabox" home="https://petabox.io/" config="/s3/#petabox" >}}
2930
{{< provider name="Qiniu Cloud Object Storage (Kodo)" home="https://www.qiniu.com/en/products/kodo" config="/s3/#qiniu" >}}
@@ -5403,6 +5404,7 @@ Name Type
54035404
==== ====
54045405
leviia s3
54055406
```
5407+
54065408
### Liara {#liara-cloud}
54075409

54085410
Here is an example of making a [Liara Object Storage](https://liara.ir/landing/object-storage)
@@ -5504,6 +5506,139 @@ server_side_encryption =
55045506
storage_class =
55055507
```
55065508

5509+
### Linode {#linode}
5510+
5511+
Here is an example of making a [Linode Object Storage](https://www.linode.com/products/object-storage/)
5512+
configuration. First run:
5513+
5514+
rclone config
5515+
5516+
This will guide you through an interactive setup process.
5517+
5518+
```
5519+
No remotes found, make a new one?
5520+
n) New remote
5521+
s) Set configuration password
5522+
q) Quit config
5523+
n/s/q> n
5524+
5525+
Enter name for new remote.
5526+
name> linode
5527+
5528+
Option Storage.
5529+
Type of storage to configure.
5530+
Choose a number from below, or type in your own value.
5531+
[snip]
5532+
X / Amazon S3 Compliant Storage Providers including AWS, ...Linode, ...and others
5533+
\ (s3)
5534+
[snip]
5535+
Storage> s3
5536+
5537+
Option provider.
5538+
Choose your S3 provider.
5539+
Choose a number from below, or type in your own value.
5540+
Press Enter to leave empty.
5541+
[snip]
5542+
XX / Linode Object Storage
5543+
\ (Linode)
5544+
[snip]
5545+
provider> Linode
5546+
5547+
Option env_auth.
5548+
Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
5549+
Only applies if access_key_id and secret_access_key is blank.
5550+
Choose a number from below, or type in your own boolean value (true or false).
5551+
Press Enter for the default (false).
5552+
1 / Enter AWS credentials in the next step.
5553+
\ (false)
5554+
2 / Get AWS credentials from the environment (env vars or IAM).
5555+
\ (true)
5556+
env_auth>
5557+
5558+
Option access_key_id.
5559+
AWS Access Key ID.
5560+
Leave blank for anonymous access or runtime credentials.
5561+
Enter a value. Press Enter to leave empty.
5562+
access_key_id> ACCESS_KEY
5563+
5564+
Option secret_access_key.
5565+
AWS Secret Access Key (password).
5566+
Leave blank for anonymous access or runtime credentials.
5567+
Enter a value. Press Enter to leave empty.
5568+
secret_access_key> SECRET_ACCESS_KEY
5569+
5570+
Option endpoint.
5571+
Endpoint for Linode Object Storage API.
5572+
Choose a number from below, or type in your own value.
5573+
Press Enter to leave empty.
5574+
1 / Atlanta, GA (USA), us-southeast-1
5575+
\ (us-southeast-1.linodeobjects.com)
5576+
2 / Chicago, IL (USA), us-ord-1
5577+
\ (us-ord-1.linodeobjects.com)
5578+
3 / Frankfurt (Germany), eu-central-1
5579+
\ (eu-central-1.linodeobjects.com)
5580+
4 / Milan (Italy), it-mil-1
5581+
\ (it-mil-1.linodeobjects.com)
5582+
5 / Newark, NJ (USA), us-east-1
5583+
\ (us-east-1.linodeobjects.com)
5584+
6 / Paris (France), fr-par-1
5585+
\ (fr-par-1.linodeobjects.com)
5586+
7 / Seattle, WA (USA), us-sea-1
5587+
\ (us-sea-1.linodeobjects.com)
5588+
8 / Singapore ap-south-1
5589+
\ (ap-south-1.linodeobjects.com)
5590+
9 / Stockholm (Sweden), se-sto-1
5591+
\ (se-sto-1.linodeobjects.com)
5592+
10 / Washington, DC, (USA), us-iad-1
5593+
\ (us-iad-1.linodeobjects.com)
5594+
endpoint> 3
5595+
5596+
Option acl.
5597+
Canned ACL used when creating buckets and storing or copying objects.
5598+
This ACL is used for creating objects and if bucket_acl isn't set, for creating buckets too.
5599+
For more info visit https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview.html#canned-acl
5600+
Note that this ACL is applied when server-side copying objects as S3
5601+
doesn't copy the ACL from the source but rather writes a fresh one.
5602+
If the acl is an empty string then no X-Amz-Acl: header is added and
5603+
the default (private) will be used.
5604+
Choose a number from below, or type in your own value.
5605+
Press Enter to leave empty.
5606+
/ Owner gets FULL_CONTROL.
5607+
1 | No one else has access rights (default).
5608+
\ (private)
5609+
[snip]
5610+
acl>
5611+
5612+
Edit advanced config?
5613+
y) Yes
5614+
n) No (default)
5615+
y/n> n
5616+
5617+
Configuration complete.
5618+
Options:
5619+
- type: s3
5620+
- provider: Linode
5621+
- access_key_id: ACCESS_KEY
5622+
- secret_access_key: SECRET_ACCESS_KEY
5623+
- endpoint: eu-central-1.linodeobjects.com
5624+
Keep this "linode" remote?
5625+
y) Yes this is OK (default)
5626+
e) Edit this remote
5627+
d) Delete this remote
5628+
y/e/d> y
5629+
```
5630+
5631+
This will leave the config file looking like this.
5632+
5633+
```
5634+
[linode]
5635+
type = s3
5636+
provider = Linode
5637+
access_key_id = ACCESS_KEY
5638+
secret_access_key = SECRET_ACCESS_KEY
5639+
endpoint = eu-central-1.linodeobjects.com
5640+
```
5641+
55075642
### ArvanCloud {#arvan-cloud}
55085643

55095644
[ArvanCloud](https://www.arvancloud.com/en/products/cloud-storage) ArvanCloud Object Storage goes beyond the limited traditional file storage.

0 commit comments

Comments
 (0)