Backblaze Rclone



Rclone is mature, open source software originally inspired by rsync and written in Go. The friendly support community are familiar with varied use cases. Official Ubuntu, Debian, Fedora, Brew and Chocolatey repos. For the latest version downloading from rclone.org is recommended. Rclone is widely used on Linux, Windows and Mac. Rclone 'rsync for cloud storage' is a powerful command line tool to copy and sync files to and from local disk, SFTP servers, and many cloud storage providers. Rclone's Backblaze B2 page has many examples of configuration and options. Supports Fireball. Rclone ('rsync for cloud storage') is a command line program to sync files and directories to and from different cloud storage providers. Storage providers. 1Fichier šŸ“„ Alibaba Cloud (Aliyun) Object Storage System (OSS) šŸ“„ Amazon Drive šŸ“„ Amazon S3 šŸ“„ Backblaze B2 šŸ“„ Box šŸ“„ Ceph šŸ“„ Citrix ShareFile šŸ“„ DigitalOcean Spaces. The Backblaze Personal Backup client was started in January of 2007 as a ā€˜Cā€™ and C source tree that compiled on Windows, Macintosh, and Linux (originally CentOS but later when we standardized on Debian for the server side we now compile the client on Debian). Rclone config reconnect. Re-authenticates user with remote. This reconnects remote: passed in to the cloud storage system. To disconnect the remote use 'rclone config disconnect'. This normally means going through the interactive oauth flow again. Rclone config reconnect remote: flags Options-h, -help help for reconnect.

  1. Rclone Backblaze Unraid
  2. Rclone S3

What is the problem you are having with rclone?

B2 cloud storage

Mounting Backblaze B2 and copying files to it
Mount seems to work but copying files fails

What is your rclone version (output from rclone version)

Backblaze

rclone v1.53.1

  • os/arch: windows/amd64
  • go version: go1.15

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Rclone

Windows 10 x64

Which cloud storage system are you using? (eg Google Drive)

Backblaze B2

Rclone

The command you were trying to run (eg rclone copy /tmp remote:tmp)

The rclone config contents with secrets removed.

A log from the command with the -vv flag

...gist.github.com/UsefulVid/9f35dcc41bf71796d3f0a9e45e6297ea

edit:

Looks like to be solved with:
rclone.exe mount --vfs-cache-mode writes Backblaze Y: -o volname=local

edit2:
Still does not work
I used
rclone.exe mount --vfs-cache-mode writes Backblaze:usefulviddemo1 Y: -o volname=local
But I can not delete files:

Even with
rclone.exe mount --vfs-cache-mode full Backblaze:usefulviddemo1 Y: -o volname=local

it looks like it works but no files arrive at my bucket.

  • Tasks

Create B2 remote

  • Where 'Key ID' is account.
  • Where 'Application key' is key.
  • Using b2 as the remote name and used in all task examples (e.g. as b2:).

All done, confirm settings:

Tasks

List buckets

Synchronize local files to bucket

Will perform the following:

  • Push all files from /path/to/local/source to target bucket BUCKET_NAME.
  • Files found in target bucket not in source will be deleted.
  • Files considered identical if file size and modification date match.
  • Progress displayed to terminal, output sent to /path/to/rclone.log.
  • Using --fast-list to action rclone to pull all current target bucket files in a single/minimal number of API calls. Based on the number of target bucket files to consider this may have positive/negative execution time/cost benefit.
  • Use --transfers to control number of parallel file transfers to target bucket, tune based on available upstream bandwidth.

Synchronize local files to bucket - checksum

  • Identical to Synchronize local files to bucket, but using --checksum flag means files considered identical if file size and SHA-1 match.
  • A more thorough synchronization, but will take longer to execute as rclone must calculate SHA-1 checksums for every source file - B2 keeps a SHA-1 checksum for every target bucket file, so no additional overhead there.
Backblaze

Rclone Backblaze Unraid

Verify local files against bucket

Will perform the following:

  • Verify all files at /path/to/local/source against target bucket BUCKET_NAME.
  • Files considered identical if file size and SHA-1 match.
  • To speed up the check, provide the --size-only flag, which will consider files identical if only file sizes match.
  • Progress displayed to terminal, output sent to /path/to/rclone.log.
  • Using --fast-list to action rclone to pull all current target bucket files in a single/minimal number of API calls. Based on the number of target bucket files to consider this may have positive/negative execution time/cost benefit.

Rclone S3

Reference