Lessons from migrating a large library of files to Digital Ocean Spaces

For one of the older clients we recently did a data migration of all their files. The files originally lived alongside the Laravel application on a Digital Ocean Droplet. This was fine for a while but after years the library had grown to 90 gigs so it was time to move them to a separate location.

We opted to go with Digital Ocean spaces, which I personally had no prior expierence with. Here are some things I learned along the way.

Rclone

Woops ... permissions were private by default

https://stackoverflow.com/questions/52697745/how-to-change-all-the-folder-files-permission-private-into-public-in-digital-oce

https://docs.digitalocean.com/products/spaces/reference/s3cmd/