encrypted_backups_to_the_cloud

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
encrypted_backups_to_the_cloud [13.08.2017 14:57] – [the script] Pascal Suterencrypted_backups_to_the_cloud [15.08.2017 08:44] (current) – [the script] Pascal Suter
Line 78: Line 78:
 #!/bin/bash  #!/bin/bash 
  
-# (c) 2017 Pascal Suter, Version 1.0+# (c) 2017 Pascal Suter, Version 0.10 Beta
 # this script creates an enecrypted offsite backup of a locally kept backup.  # this script creates an enecrypted offsite backup of a locally kept backup. 
 # ideally suited to work with rubi (http://www.0x1b.ch/misc/hacks/rubi) # ideally suited to work with rubi (http://www.0x1b.ch/misc/hacks/rubi)
Line 99: Line 99:
     echo "$1" | mail -s "offsiteBackup failed" "$RECIPIENTS"     echo "$1" | mail -s "offsiteBackup failed" "$RECIPIENTS"
     exit 1     exit 1
 +}
 +
 +function success {
 +    ( echo "the offsite backup was successfully updated to backup version $LATEST"
 +    echo "here are the last lines of the rsync process:"
 +    tail -n 3 /tmp/offsiteBackup.log ) | mail -s "offsiteBackup successfully updated" "$RECIPIENTS"
 +    umount $PLAINMOUNT 2>/dev/null
 +    exit 0
 } }
  
Line 134: Line 142:
  
 # rsync to offsite location # rsync to offsite location
-rsync -AaHvXx $RSYNCOPTS "$CRYPTED/" "$TARGET" +rsync -AaHvXx --delete $RSYNCOPTS "$CRYPTED/" "$TARGET" 2>&1 
-if [ $? -gt 0 ]; then +res=$? 
-    fail "there was a problem with the offsite backup, check /tmp/offsiteBackup.log on the server"+if [ $res -gt 0 ]; then 
 +    if [ $res -eq 24 ]; then  
 +        #some files vanished during the backup, that's not a failure of the backup, so send the success message  
 +        success 
 +    else  
 +        fail "there was a problem with the offsite backup, check /tmp/offsiteBackup.log on the server" 
 +    fi
 else  else 
-    ( echo "the offsite backup was successfully updated to backup version $LATEST" +    success
-    echo "here are the last lines of the rsync process:" +
-    tail -n 3 /tmp/offsiteBackup.log ) | mail -s "offsiteBackup successfully updated" "$RECIPIENTS"+
 fi fi
 </code> </code>
 +=== Known Issues ===
 +For some reason gocryptfs seems to generate some files (two in my case) like '' gocryptfs.longname.*.name'' that are there when rsync scans the directory but vanish before rsync can sync them. this leads to rsync complaining about vanished files. when i mount the backup with gocryptfs (forward) and then compare the unencrypted backup with the original through rsync --dry-run i find a single file to be missing in my encrypted backup. It has a very long filename: ''xxxx/xxxx/vlc-shares/public/images/fsthumbs/thumbs/MjovVFYvQWxhcm0gZnVyIENvYnJhIDExIC0gRGllIEF1dG9iYWhucG9saXplaSAtIFNlYXNvbiAxLTEyL0NvYnJhIDExIFN0YWZmZWwgMDEvQ29icmEgMTEgUzAxIEUwMDYgKERlciBBbHRlIHVuZCBkZXIgSnVuZ2UpLmF2aQ==.jpg''. the script accepts exit code 24 (vanished files) as successful ending of rsync for now until I have time to further investigate and either file a bug at gocryptfs or work around it somehow. 
 +
 +===== Restoring Files =====
 +to restore files you could use ''sshfs'' for example to mount the remote directory via ssh on your local server...
 +  sshfs user@remote.server:/offsiteDirectory /mnt/offsiteBackup
 +and now use gocryptfs to uncrypt the contents and restore some files: 
 +  gocryptfs /mnt/offsiteBackup /mnt/uncrypted 
 +now you should see all your files in /mnt/uncrypted
 +
 +unmount both mounts once you are done. 
  • encrypted_backups_to_the_cloud.1502629061.txt.gz
  • Last modified: 13.08.2017 14:57
  • by Pascal Suter