Backup script crashing server and using most of RAM

[coblck]

Hi quick question i wrote a script to enable me to start backing up my most valuable data but ran into a few problems, 

 

#!/bin/sh

rsync -av --delete /mnt/user/Pictures /mnt/disks/Backups_Ext

 

Backup when well but when finished has used 75% of my memory and it pegged my cpu at 100% for about 3mins and when i tried to start my VM  it wouldnt as not enough memory , also made my system very unstable to the point unusable so had reboot. Thankfully everything back to normal but was wondering  if can i manually flush/empty the memory? 

Edited March 9, 2021 by coblck

[Cpt. Chaz]

Hi @coblck, can you advise on how much ram your system running rsync has? also, what is the file format for the external hd? sometimes using the -a tag for rsync between different file formats can cause problems. so i'm wondering if using -r and -t, and maybe some other options would help solve the problem of using -a. 

 

there could be a few different things to try here

[coblck]

Hi @Cpt. Chaz yeah my system is using 16gb of Ram, also the ext HD is formatted with NTFS

[Cpt. Chaz]

Good deal.

 

The -delete option uses extra memory. Let’s eliminate the variables one at a time. Just for the sake of troubleshooting, remove that option and try running again. Also, add -P and -h. Those will make the output a little easier to read for you. 

[coblck]

OK will try later when home night-shift in (UK). The folder I was trying to backup does contain quite a few small files. Will try what you suggest. Thanks

[Cpt. Chaz]

Sounds good