what did you like more about rclone than Cryptomator?

I wanted to leave Dropbox and ran across it. I liked the number of supported backends under one tool. I use it to access things beyond Backblaze like gdrive, SharePoint, OneDrive, Proton Drive. Well documented config file format. I was able to manage the config with Nix due to this.

Is it suitable for sync, or is it more for backups

It works great for one way sync. Bisync I never got working well enough to trust it. Bisync is nice for 3-way merges (two devices modifying files on the same cloud drive). Dropbox, gdrive, OneDrive win here. I’ve learned to live without it.

I’m ideally looking for near-ish to real-time sync for contacts, notes, files, and pictures

On a computer the fuse mounted volumes are near live. Cahce locally in a VFS. Anything else you’d have to script probably. There is rclone-watch but can’t say I’ve tested it

With Round Sync you can browse with live refresh when you move between directories, but syncing would be on a schedule. Looks like a 15m interval is the fastest frequency.

Are there any frontends for Linux you’d recommend, or do you script out the functionality you’re looking to implement?

I mostly just mount on login with the VFS cache. Use my normal file browser. One command per mount. Its rare (practically never) that I need to work on something without internet, so I don’t deal with trying to script syncs. I tried in the early days of playing with it, but fuse mounts ended up meeting my needs.

No GUI that I use outside of my normal file browser. The only thing I need to use the CLI for is cleaning up soft deleted files and old versions (Backblaze specific thing).

It might not have the functionality you are looking for as far as app integrations, but my progression was Dropbox -> Cryptomator over Dropbox -> rclone over Backblaze B2.

You can nest a “crypt” remote (end-to-end encryption with your own private key) over tons of cloud providers. You can mount it like a drive in Linux.

Round Sync is an Android client that can schedule cronlike backups. Pretty much set it and forget it on my phone. I delete things on my phone when I need space and every couple years go cleanup what’s in B2.

Dropbox was better priced at max capacity when I used it ($120/yr for 2TB?). My Backblaze bill started at $1/mo and is like $4/mo now. Its been a couple years since I cleaned things out and could probably cut that in half.

Same. None of that self-hosted cloud storage is going to save you from data loss in the event of a fire or theft unless you plan for offsite.

I just use rclone with Backblaze B2, end-to-end encrypted with my own private key, and call it a day.

I have a mirrored BYOD setup for my media server but its all stuff I can download again. Its just an onsite cache with a little redundancy against a failed drive.

They responded on reddit and walked some of it back as an “oversight”: https://www.reddit.com/r/Bitwarden/comments/1tdvnh7/comment/olznwcv/. Allegedly, I’m too lazy to verify.

https://github.com/newhinton/Round-Sync - Android rclone port.

Its done on a schedule but I backup once a day to backblaze b2 using my own keys for full e2ee by wrapping the b2 remote with a crypto remote. Been set it and forget it for about 3 years. Supports many other cloud or self hosted remotes.

Its not in any store last I checked. I use https://github.com/ImranR98/Obtainium to manage installing and updating.

Something like https://graphite.com/ to create stacked PRs that are reviewable probably would have helped. Can be replicated with local LLMs or remote AI providers with locally configured agentic workflows. Never used graphite personally, but I’ve seen some open source maintainers use it to split up large PRs.

I ended up just building a box after looking for the perfect NAS and finding it didn’t exist. The software is usually just crap or the hardware is underwhelming. Got a Node 804 case to slap in plenty of HDD space. Running NixOS so I’m in control of the software. In retrospect I wish I had gotten a rackmount type case. Tossed in an Arc GPU for better transcoding shortly after the initial setup.

I haven’t tested in Windows, but this is my setup Linux to Linux using rclone which the docs say works with Windows.

Server

• LUKS
• LVM
• Volgroup with a mishmash of drives in a mirror configuration
• Cache volume with SSD
• BTRFS /w Snapshots (or ZFS or any other snapshotting FS)
• (optional) Rclone local “remote” with Crypt if you want runtime encryption at rest and the ability to decrypt files on the server. You can skip this and do client side only if you don’t want the decryption key on the server.
• SFTP (or any other self-hosted protocol from https://rclone.org/docs/)

Client

• Rclone Config /w SFTP (or chosen protocol)
• (optional) Rclone Config /w Crypt
• Rclone mount with VFS.

I use this setup for my local files and a similar setup to my Backblaze B2 off site backups.

The VFS implementation has been pretty good. You can also manually sync. Their bisync I don’t fully trust though.

I can access everything through android using https://github.com/newhinton/Round-Sync. Not great for photos though as thumbnails weren’t loading without pulling the whole file last I tested a year ago.

One method depends on your storage provider. Rsync may have incremental snapshots, but I haven’t looked because my storage provider has it.

Sometimes a separate tool like rsnapshot (but probably not rsnapshot itself as I dont think its hard links interact well with rsync) might be used to manage snapshots locally that are then rsynced.

On to storage providers or back ends. I use B2 Backblaze configured to never delete. When a file changes it uploads the new version and renames the old version with a timestamp and hides it. Rsync has tools to recover the old file versions or delete any history. Again, it only uploads the changed files so its not full snapshots.

Yes. You compose a crypted vault over your storage vault. I pay about $1/mo for B2 Backblaze. Around 150G last I checked.

Important stuff (about 150G) is synced to all my machines and a b2 Backblaze bucket.

I have a rented seed box for those low seeder torrents.

The stuff I can download again is only on a mirrored lvm pool with an lvmcache. I don’t have any redundancy for my monerod data which is on an nvme.

I’m moving towards an immutable OS with 30 days of snapshots. While not the main reason, it does push one to practicing better sync habits.

I believe you will see OOM errors in journalctl. Also considered a systemd service or something to restart the process?

Glad you figured it out though!

I use EteSync to sync my contacts. It can do calendars also and has a self-hosted option. Personally I just use Proton for my calendar at the moment.

I haven’t tested any desktop syncing with EteSync, but maybe it will work for you.

I use DavMail to proxy an Exchange account so I don’t have to install Outlook on my phone.

Can try installing Avahi on the RPi (may come on the default image). It will advertise .local over mDNS / DNS-SD. I believe Avahi will advertise on link local if there is no default route to the internet.

Your system may automatically resolve the domain if its able to pickup the mDNS records to SSH in. Been a couple years since I’ve done it, so I could be forgetting a nuanced detail, but I vaguely remember just ‘plug and play’ if internet for the RPi wasn’t required.

My NAS is an mATX mobo with an i5, 64G RAM, 8 disk drives, 3 nvme drives, and an ARC GPU for video transcoding.

Disk drives are all mirrored. One nvme runs NixOS which is easy enough to redeploy if the drive dies. One nvme is cache on top of the disk drives. Last nvme I use for temp fast storage like Jellyfin transcoding.

Its more of a combo NAS/server as I run most self hosted apps on it (tor node, monero node, jellyfin, *arr stack, etc).

Not sure what your environment is. I can tell you what I do in linux/android.

I use backblaze b2 for my cloud storage.

I use rclone to create two encrypted “remotes”: one on my local file system and one for b2. Rclone supports a bunch of cloud providers, so you don’t have to use b2.

I mount the encrypted local file system and use whatever app (e.g., paperless) to access the files like it was any other directory.

When I’m done I unmount it and sync it with the b2 encrypted remote.

I use Round Sync on android which is rclone with a mobile GUI to access the same files. Also works great for backing up my phone.

For docker access to the mount point, either run the docker daemon as your current user, enable root access to rclone’s fuse mounts, or my preferred is to remount (with root access) a scoped directory for that docker container using something like bindfs.

Just be aware if using the vfs-cache (needed for seek or append), that cache is stored decrypted in your home folder. I’ve been meaning to look into locking it down with apparmor or something.

Round Sync with whatever remote (backend provider) you want supported by the underlying library rclone. They have self hosted remote options like FTP or something. If you want off site and privacy, create a crypted remote pointed to your off site backend remote. It acts as a wrapper to do end-to-end encryption.

Round Sync isn’t in any app store, so I’d set a watcher for releases on Github. You can setup scheduled backups or restores in Round Sync to keep things moving between your phone and backend remote as a relatively set it and forget it for one way syncing.

It has some nuances with bidirectional syncing that can result in data loss if not careful. With your workflow, I recommend something like a daily copy job from your phone to the server. This never deletes files. When you curate your photos via a tool on the backend remote (only do this when all photos on your phone are on the backup server), then you can do a manual sync from the backend remote to your phone to match the two exactly.

Copy just copies or updates to newer versions from target 1 to target 2.

Sync does the same but also deletes any files on target 2 that are not on target 1. Very easy to delete files if not careful in planning out your workflow. Test first.

I use Backblaze B2 for my off site remote which only hides and doesn’t delete files with the default settings. You can manage those with the rclone CLI application on a desktop to later cleanup hidden files or set them to delete after X days or something in the b2 life cycle settings on the Backblaze website.

Its no Google Photos or Dropbox, but it works well enough for me without giving up privacy. It also decouples the syncing from curating of photos giving some additional freedom for a custom workflow.

I personally just have a daily copy job on my phone from my phone to a crypted b2 remote and a cron on my self hosted server to copy from b2 to my self hosted server. Once a year I might clean things up from my server, do a manual sync to b2, then another to my phone. Sometime later I’ll go clean up the hidden (deleted) files in b2.

That said, I care more about backups than bidirectional syncing, so your milage may vary with this solution for your use case.

Depending on the country, those laws may be different. Here is a story of a guy who ran a TOR exit node in Australia who would have been protected as a company (law was later changed).

https://lowendbox.com/blog/man-found-guilty-of-child-porn-because-he-ran-a-tor-exit-node-the-story-of-william-weber/

Set myservice.example.com to an internal address like 10.10.100.x. Those addresses are not routable on the public internet. They can only be reached from a local network which the VPN tunnels you into.

If your VPN also supplies DNS to clients, can also add a private zone if its supported so nobody can resolve that internal address except those clients.

Tried Agent DVR. It works, and I’ll probably borrow the libraries they suggest for alert monitoring, but the scrubbing performance wasn’t that great.

In my research modern fast scrubbing uses spritesheets. AgentDVR just felt like overkill for capturing raw video and rotating video files if I’m going yo craft my own viewer. I can do that with gstreamer easy enough.