gridscale Quick Guide: S3 Compatible Object Storage
With the gridscale S3-compatible object storage, there are a few things to consider. So that everything works, I’ll show you here how you can best manage your Object Storage.
The left menu in your gridscale panel takes you to the Object Storage area.
Here you manage access keys for access to your cloud object storage and your buckets. It is possible to manage buckets directly via the interface, all necessary basic functions are available in the interface. These functions are sufficient and are suitable for the administration of templates and buckets with small extent.
However, for maximum flexibility and for large buckets, we recommend that you use an S3 tool. Cyberduck (Mac, Windows) and S3cmd (Linux, Mac) are tools with which I made good experiences. In the following sections I will briefly introduce you to both tools and show you how to establish a connection to the gridscale object storage.
In general, the gridscale Object Storage is compatible with all common S3 tools and applications that allow you an S3 connection.
The following parameters:
gridscale endpoint gos3.io + Key and Secret
are always needed for this.
Cyberduck is a Libre Server & Cloud Storage Browser with graphical user interface and easy to use interface. Cyberduck is available for Mac and Windows, you can download it from https://cyberduck.io/. Cyberduck is very well suited for easy management of your object storage.
Making a new connection is pretty easy. Open Cyberduck and click on “Open Connection”. In the window for the new connection, select Amazon S3, add the endpoint “gos3.io” under Server and transfer your Access Key + Secret.
After connecting you can comfortably browse through your buckets. You can upload / download files, synchronize paths, browse buckets and much more. Cyberduck offers many features and good usability, just explore the program a bit and you’ll find your way around quickly. New features are introduced in Blog.
s3cmd is a free command-line tool without graphical user interface and available for Linux and Mac. s3cmd requires Python 2.6 or later for installation, in version 2.x it is also compatible with Python 3.x.
s3cmd can be installed via RPM Package, PIP and Homebrew installed.
If you already have Homebrew installed, this is probably the quickest way to install it.
brew install s3cmd
At this point I will show you how to configure s3cmd to connect to the object storage.
After the installation you can use the command
create a new default configuration.
In case you want to create multiple configurations, you can also write the config file to a separate file.
s3cmd --configure --config=gos3cfg
The above command creates a config file named gos3cfg.
After executing one of the two commands, s3cmd interactively asks you for some setting parameters.
At this point, specify the following parameters to make the connection to the gridscale object storage work:
Access Key: Your Key
Secret Key: Your Secret
Default Region: GER
S3 Endpoint: gos3.io
DNS-style bucket+hostname:port … %(bucket)s.gos.io
For all other points you can simply confirm the default settings with Enter.
Then just confirm “Save settings?” with y.
s3cmd offers you many possibilities with its wide range of functions.
examples for all commands are displayed:
Commands: Make bucket s3cmd mb s3://BUCKET Remove bucket s3cmd rb s3://BUCKET List objects or buckets s3cmd ls [s3://BUCKET[/PREFIX]] List all object in all buckets s3cmd la Put file into bucket s3cmd put FILE [FILE...] s3://BUCKET[/PREFIX] Get file from bucket s3cmd get s3://BUCKET/OBJECT LOCAL_FILE Delete file from bucket s3cmd del s3://BUCKET/OBJECT Delete file from bucket (alias for del) s3cmd rm s3://BUCKET/OBJECT Restore file from Glacier storage s3cmd restore s3://BUCKET/OBJECT Synchronize a directory tree to S3 (checks files freshness using size and md5 checksum, unless overridden by options, see below) s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR Disk usage by buckets s3cmd du [s3://BUCKET[/PREFIX]] Get various information about Buckets or Files s3cmd info s3://BUCKET[/OBJECT] Copy object s3cmd cp s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2] Modify object metadata s3cmd modify s3://BUCKET1/OBJECT Move object s3cmd mv s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2] Modify Access control list for Bucket or Files s3cmd setacl s3://BUCKET[/OBJECT] Modify Bucket Policy s3cmd setpolicy FILE s3://BUCKET Delete Bucket Policy s3cmd delpolicy s3://BUCKET Modify Bucket CORS s3cmd setcors FILE s3://BUCKET Delete Bucket CORS s3cmd delcors s3://BUCKET Modify Bucket Requester Pays policy s3cmd payer s3://BUCKET Show multipart uploads s3cmd multipart s3://BUCKET [Id] Abort a multipart upload s3cmd abortmp s3://BUCKET/OBJECT Id List parts of a multipart upload s3cmd listmp s3://BUCKET/OBJECT Id Enable/disable bucket access logging s3cmd accesslog s3://BUCKET Sign arbitrary string using the secret key s3cmd sign STRING-TO-SIGN Sign an S3 URL to provide limited public access with expiry s3cmd signurl s3://BUCKET/OBJECT <expiry_epoch|+expiry_offset> Fix invalid file names in a bucket s3cmd fixbucket s3://BUCKET[/PREFIX] Create Website from bucket s3cmd ws-create s3://BUCKET Delete Website s3cmd ws-delete s3://BUCKET Info about Website s3cmd ws-info s3://BUCKET Set or delete expiration rule for the bucket s3cmd expire s3://BUCKET Upload a lifecycle policy for the bucket s3cmd setlifecycle FILE s3://BUCKET Get a lifecycle policy for the bucket s3cmd getlifecycle s3://BUCKET Remove a lifecycle policy for the bucket s3cmd dellifecycle s3://BUCKET List CloudFront distribution points s3cmd cflist Display CloudFront distribution point parameters s3cmd cfinfo [cf://DIST_ID] Create CloudFront distribution point s3cmd cfcreate s3://BUCKET Delete CloudFront distribution point s3cmd cfdelete cf://DIST_ID Change CloudFront distribution point parameters s3cmd cfmodify cf://DIST_ID Display CloudFront invalidation request(s) status s3cmd cfinvalinfo cf://DIST_ID[/INVAL_ID]
With the gridscale S3-compatible object storage, there are a few things to consider. So that everything works, I’ll show you here how you can best manage your Object Storage. The left menu in your gridscale panel takes you to the Object Storage area. Here you manage access keys for access to your cloud object storage […]
Thank you for your feedback!
We will get back to you as soon as the article is finished.