Hack The Sec-Leading Resource Of Linux Tutorial: rsync

Rsync-Automatic Backup Script

<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-size: x-large;"><b><u>Rsync-Backup Script</u></b></span><br />
<div style="background-color: white; text-align: justify;">
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">rsync is a widely-used utility to keep copies of a file on two computer systems the same. It is commonly found on Unix-like systems and functions as both a file synchronization and file transfer program. The rsync algorithm, a type of delta encoding, is used to minimize network usage. Zlib may be used for additional compression, and <a href="http://www.hackthesec.co.in/search/label/SSH">SSH </a>or stunnel can be used for data security.</span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifikxORTcCWGEKUMGs1B6qcE1FGZYXx-mprnhY8QwnPw9dNKSTaGTZZPm_lirxHa8AENfuM2DO4WARHmwYpEE7R1Od8Eax49M_8FbrwO6iCOKtZ3y7Fjy213cJsCYpHW5hV-h17xVcTzx-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifikxORTcCWGEKUMGs1B6qcE1FGZYXx-mprnhY8QwnPw9dNKSTaGTZZPm_lirxHa8AENfuM2DO4WARHmwYpEE7R1Od8Eax49M_8FbrwO6iCOKtZ3y7Fjy213cJsCYpHW5hV-h17xVcTzx-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" /></a></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Rsync is typically used to synchronize files and directories between two different systems. For example, if the command rsync local-file user@remote-host:remote-file is run, rsync will use SSH to connect as user to remote-host. Once connected, it will invoke the remote host's rsync and then the two programs will determine what parts of the file need to be transferred over the connection.</span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Rsync can also operate in a daemon mode, serving files in the native rsync protocol (using the "<a href="http://www.hackthesec.co.in/search/label/rsync">rsync</a>://" syntax).</span></span></div>
</div>
<div style="text-align: center;">
<span style="font-size: x-large;"><b><u><a href="http://hackthesec.byethost22.com/rsync-backup.sh">DOWNLOAD HERE</a></u></b></span></div>
</div>

Rsync-Automatic Backup Script

Rsync-Backup Script rsync is a widely-used utility to keep copies of a file on two computer systems the same. It is commonly found on Un...

How To Create An Off-Site Backup Of Your Site With Rsync On Centos 6

<div dir="ltr" style="text-align: left;" trbidi="on">
<h1 class="content-title" style="background-color: white; font-family: proxima-nova, sans-serif; line-height: 1.2; margin: 0px 0px 10px; padding: 0px;">
<span style="color: #660000; font-size: large;"><u>Backup Of Your Site With Rsync On Centos 6</u></span></h1>
<div style="text-align: justify;">
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">There are two ways to do backup: incremental and full backups. A full backup copies all the data, while the snapshot only handles the changes since the last update.</span></span></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjP9lXyRenQunM7aWiKUiXHl0FBxPohZxc_B_trNi76iWAL_-5AaQajlHiEon2jz7pqgqVrG_BEny7WyNf_DJ6xdzNTUqJtnfByFL4haI9FhU-wwDRDuHMVw4QNmbsRbk2qXLPWumdjmnj-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjP9lXyRenQunM7aWiKUiXHl0FBxPohZxc_B_trNi76iWAL_-5AaQajlHiEon2jz7pqgqVrG_BEny7WyNf_DJ6xdzNTUqJtnfByFL4haI9FhU-wwDRDuHMVw4QNmbsRbk2qXLPWumdjmnj-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" /></a></div>
<div style="text-align: justify;">
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div>
<div style="text-align: justify;">
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; line-height: 26px;">
<b><u><span style="font-size: large;">Full Backup</span></u></b></div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Full backup typically does the following:</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
<ul>
<li>Make an archive of all the files in a folder</li>
<li>Copy the resulting archive to a remote server.</li>
</ul>
</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
As noted, our data will reside in /var/www/wordpress directory. We will designate a backup folder location.</div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;">mkdir -p /backup/wordpress</span></pre>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The above command will create a /backup directory, and a /backup/wordpress directory, if they do not exist. To create a full snapshot of our data, we use the linux tool called tar.</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: justify;">
<span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/wordpress/initial_backup.tar.gz </span></span><span style="background-color: transparent; color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/wordpress</span></div>
</pre>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Tar will create a gzip archive in a file initial_backup.tar.gz. We could add a v flag (so we get tar -czvf) if we want a verbose output (list of filenames). We name the file initial_backup.tar.gz so that we know that this is an initial backup, it is archived with tar and iz is zipped in a gzip format. Tar will use whatever arguments we provide as a source, in our case it will backup /var/www/wordpress directory. We could pass two or more arguments, whether they be files or folders: ie.</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: justify;">
<span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="line-height: 15.6px; text-align: left;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/cms_systems_backup.tar.gz /var/www/wordpress </span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/drupal /var/www/joomla</span></div>
</pre>
</div>
<div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
The last command would backup all of our installed cms systems.</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Now, for our future backups, we may want to add a date when the backup was taken:</div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: left;">
<span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="line-height: 15.6px; text-align: left;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/wordpress/wordpress-`date '+%m%d%y'`.tar.gz </span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/wordpress</span></div>
</pre>
</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
</div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Lets' see what we have now:</span></span></div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ls -l /backup/wordpress/
<div style="text-align: left;">
<span style="background-color: transparent;">-rw-r--r-- 1 root root 4995743 Mar 4 12:16 initial_backup.tar.gz</span></div>
total 9760
<div style="text-align: left;">
<span style="background-color: transparent;">-rw-r--r-- 1 root root 4995743 Mar 4 12:25 wordpress-041713.tar.gz</span></div>
</span></span></pre>
</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now, to schedule this daily, we need to create a crontab entry. Crontab is a linux task scheduler: we tell it when to do something and what task to actually do. Anyway, we open up the crontab editor:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now we need to tell cron to backup, say, every day at 3.30am, when there is hopefully not a lot of traffic. We will also tell it to email us any findings. We put this content into crontab:</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">MAILTO=email@example.com
30 3 * * * /bin/tar -czf /backup/wordpress/wordpress-`date +\%m\%d\%y`.tar.gz /var/www/wordpress</pre>
</div>
<div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We save the file with CTRL-X and confirm with Y and Enter. The above command will tell linux to repeat our command every day at 3:30. We also told cron to email us with the results. </span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Copy the Backups to Another Remote Server</u></b></span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">To copy the backups to another remote server, we will use scp - secure copy. First, we need to generate an SSH key:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh-keygen</span></span></pre>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We can leave the passphrase empty for now, and use the /root/.ssh/id_rsa_backup key file (or /home/username/.ssh/id_rsa_backup if we're not running as root). Now we can check the public key part:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">cat .ssh/id_rsa_backup.pub</span></span></pre>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We need to copy this public part of SSH key to the remote server, to a file authorized_keys. I assume we already have a remote server called backup.example.com and a user backup.</span></span></div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">scp .ssh/id_rsa_backup.pub
backup@backup.example.com:/home/backup/backup_key.pub</span></span></pre>
</div>
</div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We'll be prompted for the backup users' password. We copied the file, now let's add it where it should be, in authorized_keys. I cannot assume that this user already has the file and folder set up, so lets check that info:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/.ssh"

</span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/backups"</span></span><span style="background-color: transparent; font-size: 15px; line-height: 26px; text-align: justify; white-space: normal;"><span style="color: #222222; font-family: Verdana, Geneva, sans-serif;">
</span></span></pre>
</div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The few commands above created a directory for SSH to work with, if it didn't exist, and also the authorized_keys file, which needs to be present for backups to work. We also created a backups directory to store our files to. Now what is left is to copy our public key to that file.</span></span></div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "cat /home/backup/backup_key.pub >> /home/backup/.ssh/authorized_keys"</span></span></pre>
</div>
<div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Now we can use this key to copy stuff in the future.</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Now, let's copy the backup file over there:</div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">scp -i .ssh/id_rsa_backup
/backup/wordpress/wordpress-041713.tar.gz backup@backup.example.com:/home/backup/backups</span></span></pre>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
</div>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
</div>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"></span></span></div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">If our key setup was correct, the file will be copied and we won't be asked for passwords. We can check that the file is really there:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "ls -l /home/backup/backups"</span></span><span style="background-color: transparent; font-size: 15px; line-height: 26px; text-align: justify; white-space: normal;"><span style="color: #222222; font-family: Verdana, Geneva, sans-serif;">
</span></span></pre>
</div>
<div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Ok, we can now schedule this action to the crontab too. Start the crontab editor again:</span></span></div>
</div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We will now alter our backup line: we want to add info to copy our backup archive when it's created. So, we append the new command so that it looks like this:</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">30 3 * * * /bin/tar -czf /backup/wordpress/wordpress-`date
+\%m\%d\%y`.tar.gz /var/www/wordpress;/usr/bin/scp -i
/root/.ssh/id_rsa_backup /backup/wordpress/wordpress-`date
+\%m\%d\%y`.tar.gz
backup@backup.example.com:/home/backup/backups</pre>
</div>
<div>
<div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Incremental Backup</u></b></span></span></div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">But what if we have our own backup software at another server? We just want to synchronize the data over, and then leave the other server to do the backup work. In addition, we want to preserve file stamps. Then we use rsync. The use case here is that we want to just incrementally copy over everything from /var/www/wordpress to a remote server, this time to a /home/backup/snapshots/wordpress directory. Here is a simple command to do all that:</span></span></div>
</div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/sync" rsync -avz --delete -e "ssh -i /root/.ssh/id_rsa_backup" /var/www/wordpress backup@backup.example.com:/home/backup/sync</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The first line creates a snapshot directory and the second copies the changed files over. That means the files that were modified, newly created or deleted. We can schedule it in cron too:</span></span></div>
<div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The crontab line should look like this:</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">30 3 * * * /usr/bin/rsync -avz --delete -e "ssh -i /root/.ssh/id_rsa_backup" /var/www/wordpress backup@backup.example.com:/home/backup/sync</pre>
</div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Backup Database</u></b></span></span></div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We can also backup our database. First, we want to dump the data. If we followed the wordpress install guide, we also have a database wordpress, accessed by user wordpressuser with password password. We can do the initial dump like this:</span></span></div>
<div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">mkdir /backup/mysql
mysqldump < wordpress -u wordpressuser -ppassword | gzip > /backup/mysql/initial.sql.gz</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">This command created a initial.sql.gz gziped SQL file. To do it on a daily basis, we can schedule it in cron, like before. Our resulting cron line should look like this:</span></span></div>
<div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">0 4 * * * /usr/bin/mysqldump < wordpress -u wordpressuser
-ppassword | /bin/gzip > /backup/mysql/mysql--`date +\%m\%d\%y`.sql.gz</pre>
</div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now we could also combine it with scp or rsync to copy it remotely.</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">0 4 * * * /usr/bin/mysqldump < wordpress -u wordpressuser
-ppassword | /bin/gzip > /backup/mysql/mysql-`date +\%m\%d\%y`.sql.gz;
/usr/bin/scp -i /root/.ssh/id_rsa_backup /backup/mysql/mysql-`date
+\%m\%d\%y`.sql.gz  backup@backup.example.com:/home/backup/
</pre>
</div>
<div>
<a href="http://www.hackthesec.co.in/">HACKTHESEC.CO.IN</a></div>
</div>
</div>

How To Create An Off-Site Backup Of Your Site With Rsync On Centos 6

Backup Of Your Site With Rsync On Centos 6 There are two ways to do backup: incremental and full backups. A full backup copies all the d...

Shell Script to Backup Files / Directories Using rsync

<div dir="ltr" style="text-align: left;" trbidi="on">
<h1 class="post-title single" style="background-color: white; font-family: Arial, Helvetica, sans-serif; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 5px; padding: 0px;">
<span style="color: red; font-size: large;"><u><i>Backup Files / Directories Using rsync</i></u></span></h1>
<div>
<span style="background-color: white;"><span style="font-family: "arial" , "helvetica" , sans-serif;"><span style="font-size: 14px; line-height: 21px;">rsync command easily backup your home directory to local secondary hard disk or remote server using ssh protocol. rsync is a software application for <a href="http://www.hackthesec.co.in/search/label/Linux" target="_blank">Linux</a> and Unix systems which synchronizes files and directories from one location to another while minimizing data transfer using delta encoding when appropriate.</span></span></span></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjFUpygA2ls1yanqfXaR8YXBiPGVkGLa7aTuV60WvCA-ST3-K8ociheQUjRQzQV399WMH2iRfifzg20C_QctHHP7RwNidFjVUB9-iuJV3Vpc3mImGExKsCe3eFaNtZEQ6qHkfG3Lnzjk5by/s1600/shellscripting_www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="196" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjFUpygA2ls1yanqfXaR8YXBiPGVkGLa7aTuV60WvCA-ST3-K8ociheQUjRQzQV399WMH2iRfifzg20C_QctHHP7RwNidFjVUB9-iuJV3Vpc3mImGExKsCe3eFaNtZEQ6qHkfG3Lnzjk5by/s320/shellscripting_www.hackthesec.co.in.jpg" width="320" /></a></div>
<div>
<span style="background-color: white;"><span style="font-family: "arial" , "helvetica" , sans-serif;"><span style="font-size: 14px; line-height: 21px;"><br /></span></span></span></div>
<div>
<span style="background-color: white; font-family: "arial" , "helvetica" , sans-serif; font-size: 14px; line-height: 21px;"><br /></span></div>
<div>
<div style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 14px; line-height: 21px; margin-bottom: 15px; word-break: break-word;">
<b>We are going to backup bckup.txt, dataconfig.txt, docs and oracledb.</b></div>
</div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">[root@hackthesec tmp]# ls -l
total 12
-rw-r--r--. 1 root root 0 May 15 10:43 bckrsync.sh
-rw-r--r--. 1 root root 0 May 15 10:44 bckup.txt
-rw-r--r--. 1 root root 0 May 15 10:46 dataconfig.txt
drwxr-xr-x. 2 root root 4096 May 15 10:45 docs
drwxr-xr-x. 2 root root 4096 May 15 10:44 oracledb</span></span></pre>
</div>
<div>
<span style="background-color: white; font-family: "arial" , "helvetica" , sans-serif; font-size: 14px; line-height: 21px;">This file contains backup files / dir details</span></div>
<div>
<span style="font-size: medium; line-height: 1.3em;"><br /></span></div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">[root@hackthesec tmp]# cat /tmp/bckup.txt
/tmp/oracledb
/tmp/dataconfig.txt
/tmp/docs</span></span></pre>
</div>
<div>
<span style="line-height: 1.3em;"><span style="color: #0b5394; font-size: large;"><b><u>Script 1</u></b></span></span></div>
<div>
<span style="font-size: medium; line-height: 1.3em;"><br /></span></div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">#!/bin/bash

#We will save path to backup file in variable
backupf='/tmp/bckup.txt'

#Next line just prints message
echo "Shell Script Backup Your Files / Directories Using rsync"

#next line check if entered value is not null, and if null it will reask user to enter Destination Server
while [ x$desthost = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name desthost
read -p "Destination backup Server : " desthost

#next line finishes while loop
done

#next line check if entered value is not null, and if null it will reask user to enter Destination Path
while [ x$destpath = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name destpath
read -p "Destination Folder : " destpath

#next line finishes while loop
done

#Next line will start reading backup file line by line
for line in `cat $backupf`

#and on each line will execute next
do

#print message that file/dir will be copied
echo "Copying $line ... "
#copy via rsync file/dir to destination

rsync -ar "$line" "$desthost":"$destpath"

#this line just print done
echo "DONE"

#end of reading backup file
done</span></span></pre>
</div>
<div>
<strong style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 14px; line-height: 21px;"><span style="color: #0b5394;">Running the script with output</span></strong></div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">[root@hackthesec tmp]# ./bckrsync.sh
Shell Script Backup Your Files / Directories Using rsync
Destination backup Server : 104.*.*.41
Destination Folder : /tmp
Copying /tmp/oracledb ...
The authenticity of host '104.*.*.41 (104.*.*.41)' can't be established.
ECDSA key fingerprint is 96:11:61:17:7f:fa:......
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '104.*.*.41' (ECDSA) to the list of known hosts.
root@104.*.*.41's password:
DONE
Copying /tmp/dataconfig.txt ...
root@104.*.*.41's password:
DONE
Copying /tmp/docs ...
root@104.*.*.41's password:
DONE
[root@Fedora21 tmp]#</span></span></pre>
</div>
<div>
<h2 style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 18pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
<span style="color: #0b5394;">Script 2 :</span></h2>
</div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">#!/bin/bash

#We will save path to backup file in variable
backupf='/tmp/bckup.txt'

#Next line just prints message
echo "Shell Script Backup Your Files / Directories Using rsync"

#next line check if entered value is not null, and if null it will reask user to enter Destination Server
while [ x$desthost = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name desthost
read -p "Destination backup Server : " desthost

#next line finishes while loop
done

#next line check if entered value is not null, and if null it will reask user to enter Destination Path
while [ x$destpath = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name destpath
read -p "Destination Folder : " destpath

#next line finishes while loop
done

#next line check if entered value is not null, and if null it will reask user to enter password
while [ x$password = "x" ]; do
#next line prints what userd should enter, and stores entered value to variable with name password. #To hide password we are using -s key
read -sp "Password : " password
#next line finishes while loop
done

#Next line will start reading backup file line by line
for line in `cat $backupf`

#and on each line will execute next
do

#print message that file/dir will be copied
echo "Copying $line ... "
#we will use expect tool to enter password inside script
/usr/bin/expect << EOD
#next line set timeout to -1, recommended to use
set timeout -1
#copy via rsync file/dir to destination, using part of expect — spawn command

spawn rsync -ar ${line} ${desthost}:${destpath}
#as result of previous command we expect “password” promtp
expect "*?assword:*"
#next command enters password from script
send "${password}\r"
#next command tells that we expect end of file (everything finished on remote server)
expect eof
#end of expect pard
EOD
#this line just print done
echo "DONE"

#end of reading backup file
done</span></span></pre>
</div>
<div>
<span style="line-height: 23.4px;"><b><span style="color: #0b5394; font-size: large;">Script 3: </span></b></span></div>
<div>
<span style="line-height: 23.4px;"><b><span style="color: #0b5394; font-size: large;">Normal Method Through terminal</span></b></span><span style="background-color: white; color: #111111; font-family: "arial" , "helvetica neue" , "helvetica" , sans-serif; font-size: 20px; line-height: 32px;">Task: Backup /home/hackthesec to /mnt/usbdri</span></div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">$ rsync -au /home/hackthesec /mnt/usbdri</span></span></pre>
<div style="background-color: white; color: #111111; font-family: Arial, 'Helvetica Neue', Helvetica, sans-serif; font-size: 16px; line-height: 27px; margin-bottom: 27px; padding: 0px; word-wrap: break-word;">
To delete files in backup directory that no longer exist in directory being backed up, enter:</div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">$ rsync -au --delete /home/hackthesec /mnt/usbdri</span></span></pre>
<div style="background-color: white; color: #111111; font-family: Arial, 'Helvetica Neue', Helvetica, sans-serif; font-size: 16px; line-height: 27px; margin-bottom: 27px; padding: 0px; word-wrap: break-word;">
<a href="http://www.hackthesec.co.in/" target="_blank">www.hackthesec.co.in</a><br />
<a href="http://www.twitter.com/hackthesecurity">www.twitter.com/hackthesecurity</a></div>
</div>
</div>

Shell Script to Backup Files / Directories Using rsync

Backup Files / Directories Using rsync rsync command easily backup your home directory to local secondary hard disk or remote server usi...