Hack The Sec-Leading Resource Of Linux Tutorial: backup

Backup Multiple MySQL Or MariaDB Databases Automatically

<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="color: #990000; font-size: large;"><u>Backup Multiple MySQL Or MariaDB Databases Automatically</u></span><br />
<span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>Introduction</u></b></span></span><br />
<span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">In this write-up, we'll walk through how to backup multiple <a href="http://www.hackthesec.co.in/search/label/Mysql">MySQL</a> or <a href="http://www.hackthesec.co.in/search/label/MariaDB">MariaDB </a>databases that sit on the same machine using a custom bash script and setting up a cron job.</span></span><br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgO88uCszO-9Zrw3ZVIW1PEmPD6ZihgWILMfBTJtMn1wiCRu8_yiGhcfqtsK2u4jg3I_p2HmYzPpKzF0_p3CEO2-100-5x3FQbKeW9vtauEeE-XP_v2W2rF8DJtchISn2kjVsTI1ZccTN8X/s1600/mariadb_backup_mysql_hackthesec.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgO88uCszO-9Zrw3ZVIW1PEmPD6ZihgWILMfBTJtMn1wiCRu8_yiGhcfqtsK2u4jg3I_p2HmYzPpKzF0_p3CEO2-100-5x3FQbKeW9vtauEeE-XP_v2W2rF8DJtchISn2kjVsTI1ZccTN8X/s1600/mariadb_backup_mysql_hackthesec.jpg" /></a></div>
<span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span>
<span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>Database Backup(s)</u></b></span></span><br />
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We have three MySQL databases on our linux server named db-hackthesec-site, db-hackthesec-blog, db-hackthesec-app.</span></span><br />
<br />
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Log on to your MySQL or MariaDB database and run below query to create a database user <b>db_user_backups</b> to handle backups</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">GRANT LOCK TABLES, SELECT ON *.*, SHOW VIEW ON *.*, REPLICATION CLIENT ON *.* TO 'db_user_backups'@'%' IDENTIFIED BY '{COMPLEX-PASSWORD}';</span></span></pre>
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Also run below to make sure MySQL is configured to properly restore stored procedures</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">SET GLOBAL log_bin_trust_function_creators = 1;</span></span></pre>
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Setup the necessarily directory structure and files needed</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;"># create backup directory with environment and log file
sudo mkdir /backups && cd /backups
sudo touch .env db-backup.sh db-backup.log
sudo chmod -R 775 /backups
sudo chmod -R g+s /backups
sudo chmod +x db-backup.sh

# add mysql backup user credentials into environment file
echo "export MYSQL_USER=db_user_backups" > /backups/.env
echo "export MYSQL_PASS={COMPLEX-PASSWORD}" >> /backups/.env</span></span></pre>
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Open db-backup.sh <b>nano /backups/db-backup.sh</b> and paste the code below inside it, then save the file (Ctrl+X -> Y -> hit Enter).</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">DB_NAMES=( 'db-hackthesec-site' 'db-</span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">hackthesec</span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">-blog' 'db-</span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">hackthesec</span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">-app' ) #replace with your own database name(s)</span>
<span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">BKUP_NAMES=()
BKUP_DIR="/backups"

# get total number of directories
total_dbs=${#DB_NAMES[@]}

# create backup file names
for (( i=0; i<${total_dbs}; i++ )); do
    BKUP_NAMES[$i]="`date +%Y%m%d%H%M`-backup-$${DB_NAMES[$i]}.sql.gz"
done

# get backup users credentials
source $BKUP_DIR/.env

# create backups
for (( i=0; i<${total_dbs}; i++ )); do
    # NOTE: --routines flag makes sure stored procedures are also backed up
    mysqldump --routines -u ${MYSQL_USER} -p${MYSQL_PASS} | gzip > ${BKUP_DIR}/${BKUP_NAMES[$i]}
done</span></span></pre>
<span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>Cronjob Setup</u></b></span></span><br />
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Setup a cronjob to run every midnight that runs the backup script and saves the result/output to backup log.</span></span><br />
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span>
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Open crontab</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">crontab -e</span></span></pre>
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Add below entry to crontab</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">0 0 * * * /usr/bin/env bash /backups/db-backup.sh &>> /backups/db-backup.log</span></span></pre>
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Note: While testing you can set cronjob to run every 1 minute instead like below</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">* * * * * /usr/bin/env bash /backups/db-backup.sh &>> /backups/db-backup.log</span></span></pre>
<span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">-OR- every 5 minutes (replace 5 with the number of minutes you want)</span></span><br />
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">*/5 * * * * /usr/bin/env bash /backups/db-backup.sh &>> /backups/db-backup.log</span></span></pre>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;"><a href="http://www.hackthesec.co.in/">www.hackthesec.co.in</a></span></span></pre>
</div>

Backup Multiple MySQL Or MariaDB Databases Automatically

Backup Multiple MySQL Or MariaDB Databases Automatically Introduction In this write-up, we'll walk through how to backup multiple MyS...

Rsync-Automatic Backup Script

<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-size: x-large;"><b><u>Rsync-Backup Script</u></b></span><br />
<div style="background-color: white; text-align: justify;">
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">rsync is a widely-used utility to keep copies of a file on two computer systems the same. It is commonly found on Unix-like systems and functions as both a file synchronization and file transfer program. The rsync algorithm, a type of delta encoding, is used to minimize network usage. Zlib may be used for additional compression, and <a href="http://www.hackthesec.co.in/search/label/SSH">SSH </a>or stunnel can be used for data security.</span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifikxORTcCWGEKUMGs1B6qcE1FGZYXx-mprnhY8QwnPw9dNKSTaGTZZPm_lirxHa8AENfuM2DO4WARHmwYpEE7R1Od8Eax49M_8FbrwO6iCOKtZ3y7Fjy213cJsCYpHW5hV-h17xVcTzx-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifikxORTcCWGEKUMGs1B6qcE1FGZYXx-mprnhY8QwnPw9dNKSTaGTZZPm_lirxHa8AENfuM2DO4WARHmwYpEE7R1Od8Eax49M_8FbrwO6iCOKtZ3y7Fjy213cJsCYpHW5hV-h17xVcTzx-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" /></a></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Rsync is typically used to synchronize files and directories between two different systems. For example, if the command rsync local-file user@remote-host:remote-file is run, rsync will use SSH to connect as user to remote-host. Once connected, it will invoke the remote host's rsync and then the two programs will determine what parts of the file need to be transferred over the connection.</span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Rsync can also operate in a daemon mode, serving files in the native rsync protocol (using the "<a href="http://www.hackthesec.co.in/search/label/rsync">rsync</a>://" syntax).</span></span></div>
</div>
<div style="text-align: center;">
<span style="font-size: x-large;"><b><u><a href="http://hackthesec.byethost22.com/rsync-backup.sh">DOWNLOAD HERE</a></u></b></span></div>
</div>

Rsync-Automatic Backup Script

Rsync-Backup Script rsync is a widely-used utility to keep copies of a file on two computer systems the same. It is commonly found on Un...

How To Create An Off-Site Backup Of Your Site With Rsync On Centos 6

<div dir="ltr" style="text-align: left;" trbidi="on">
<h1 class="content-title" style="background-color: white; font-family: proxima-nova, sans-serif; line-height: 1.2; margin: 0px 0px 10px; padding: 0px;">
<span style="color: #660000; font-size: large;"><u>Backup Of Your Site With Rsync On Centos 6</u></span></h1>
<div style="text-align: justify;">
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">There are two ways to do backup: incremental and full backups. A full backup copies all the data, while the snapshot only handles the changes since the last update.</span></span></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjP9lXyRenQunM7aWiKUiXHl0FBxPohZxc_B_trNi76iWAL_-5AaQajlHiEon2jz7pqgqVrG_BEny7WyNf_DJ6xdzNTUqJtnfByFL4haI9FhU-wwDRDuHMVw4QNmbsRbk2qXLPWumdjmnj-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjP9lXyRenQunM7aWiKUiXHl0FBxPohZxc_B_trNi76iWAL_-5AaQajlHiEon2jz7pqgqVrG_BEny7WyNf_DJ6xdzNTUqJtnfByFL4haI9FhU-wwDRDuHMVw4QNmbsRbk2qXLPWumdjmnj-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" /></a></div>
<div style="text-align: justify;">
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div>
<div style="text-align: justify;">
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; line-height: 26px;">
<b><u><span style="font-size: large;">Full Backup</span></u></b></div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Full backup typically does the following:</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
<ul>
<li>Make an archive of all the files in a folder</li>
<li>Copy the resulting archive to a remote server.</li>
</ul>
</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
As noted, our data will reside in /var/www/wordpress directory. We will designate a backup folder location.</div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;">mkdir -p /backup/wordpress</span></pre>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The above command will create a /backup directory, and a /backup/wordpress directory, if they do not exist. To create a full snapshot of our data, we use the linux tool called tar.</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: justify;">
<span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/wordpress/initial_backup.tar.gz </span></span><span style="background-color: transparent; color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/wordpress</span></div>
</pre>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Tar will create a gzip archive in a file initial_backup.tar.gz. We could add a v flag (so we get tar -czvf) if we want a verbose output (list of filenames). We name the file initial_backup.tar.gz so that we know that this is an initial backup, it is archived with tar and iz is zipped in a gzip format. Tar will use whatever arguments we provide as a source, in our case it will backup /var/www/wordpress directory. We could pass two or more arguments, whether they be files or folders: ie.</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: justify;">
<span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="line-height: 15.6px; text-align: left;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/cms_systems_backup.tar.gz /var/www/wordpress </span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/drupal /var/www/joomla</span></div>
</pre>
</div>
<div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
The last command would backup all of our installed cms systems.</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Now, for our future backups, we may want to add a date when the backup was taken:</div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: left;">
<span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="line-height: 15.6px; text-align: left;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/wordpress/wordpress-`date '+%m%d%y'`.tar.gz </span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/wordpress</span></div>
</pre>
</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
</div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Lets' see what we have now:</span></span></div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ls -l /backup/wordpress/
<div style="text-align: left;">
<span style="background-color: transparent;">-rw-r--r-- 1 root root 4995743 Mar 4 12:16 initial_backup.tar.gz</span></div>
total 9760
<div style="text-align: left;">
<span style="background-color: transparent;">-rw-r--r-- 1 root root 4995743 Mar 4 12:25 wordpress-041713.tar.gz</span></div>
</span></span></pre>
</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now, to schedule this daily, we need to create a crontab entry. Crontab is a linux task scheduler: we tell it when to do something and what task to actually do. Anyway, we open up the crontab editor:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now we need to tell cron to backup, say, every day at 3.30am, when there is hopefully not a lot of traffic. We will also tell it to email us any findings. We put this content into crontab:</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">MAILTO=email@example.com
30 3 * * * /bin/tar -czf /backup/wordpress/wordpress-`date +\%m\%d\%y`.tar.gz /var/www/wordpress</pre>
</div>
<div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We save the file with CTRL-X and confirm with Y and Enter. The above command will tell linux to repeat our command every day at 3:30. We also told cron to email us with the results. </span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Copy the Backups to Another Remote Server</u></b></span></span></div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">To copy the backups to another remote server, we will use scp - secure copy. First, we need to generate an SSH key:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh-keygen</span></span></pre>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We can leave the passphrase empty for now, and use the /root/.ssh/id_rsa_backup key file (or /home/username/.ssh/id_rsa_backup if we're not running as root). Now we can check the public key part:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">cat .ssh/id_rsa_backup.pub</span></span></pre>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We need to copy this public part of SSH key to the remote server, to a file authorized_keys. I assume we already have a remote server called backup.example.com and a user backup.</span></span></div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">scp .ssh/id_rsa_backup.pub
backup@backup.example.com:/home/backup/backup_key.pub</span></span></pre>
</div>
</div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We'll be prompted for the backup users' password. We copied the file, now let's add it where it should be, in authorized_keys. I cannot assume that this user already has the file and folder set up, so lets check that info:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/.ssh"

</span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/backups"</span></span><span style="background-color: transparent; font-size: 15px; line-height: 26px; text-align: justify; white-space: normal;"><span style="color: #222222; font-family: Verdana, Geneva, sans-serif;">
</span></span></pre>
</div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The few commands above created a directory for SSH to work with, if it didn't exist, and also the authorized_keys file, which needs to be present for backups to work. We also created a backups directory to store our files to. Now what is left is to copy our public key to that file.</span></span></div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "cat /home/backup/backup_key.pub >> /home/backup/.ssh/authorized_keys"</span></span></pre>
</div>
<div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Now we can use this key to copy stuff in the future.</div>
<div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">
Now, let's copy the backup file over there:</div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">scp -i .ssh/id_rsa_backup
/backup/wordpress/wordpress-041713.tar.gz backup@backup.example.com:/home/backup/backups</span></span></pre>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
</div>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
</div>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"></span></span></div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">If our key setup was correct, the file will be copied and we won't be asked for passwords. We can check that the file is really there:</span></span></div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "ls -l /home/backup/backups"</span></span><span style="background-color: transparent; font-size: 15px; line-height: 26px; text-align: justify; white-space: normal;"><span style="color: #222222; font-family: Verdana, Geneva, sans-serif;">
</span></span></pre>
</div>
<div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Ok, we can now schedule this action to the crontab too. Start the crontab editor again:</span></span></div>
</div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We will now alter our backup line: we want to add info to copy our backup archive when it's created. So, we append the new command so that it looks like this:</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">30 3 * * * /bin/tar -czf /backup/wordpress/wordpress-`date
+\%m\%d\%y`.tar.gz /var/www/wordpress;/usr/bin/scp -i
/root/.ssh/id_rsa_backup /backup/wordpress/wordpress-`date
+\%m\%d\%y`.tar.gz
backup@backup.example.com:/home/backup/backups</pre>
</div>
<div>
<div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Incremental Backup</u></b></span></span></div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">But what if we have our own backup software at another server? We just want to synchronize the data over, and then leave the other server to do the backup work. In addition, we want to preserve file stamps. Then we use rsync. The use case here is that we want to just incrementally copy over everything from /var/www/wordpress to a remote server, this time to a /home/backup/snapshots/wordpress directory. Here is a simple command to do all that:</span></span></div>
</div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/sync" rsync -avz --delete -e "ssh -i /root/.ssh/id_rsa_backup" /var/www/wordpress backup@backup.example.com:/home/backup/sync</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The first line creates a snapshot directory and the second copies the changed files over. That means the files that were modified, newly created or deleted. We can schedule it in cron too:</span></span></div>
<div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The crontab line should look like this:</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">30 3 * * * /usr/bin/rsync -avz --delete -e "ssh -i /root/.ssh/id_rsa_backup" /var/www/wordpress backup@backup.example.com:/home/backup/sync</pre>
</div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Backup Database</u></b></span></span></div>
<div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We can also backup our database. First, we want to dump the data. If we followed the wordpress install guide, we also have a database wordpress, accessed by user wordpressuser with password password. We can do the initial dump like this:</span></span></div>
<div>
<div>
<div>
<div>
<div>
<pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">mkdir /backup/mysql
mysqldump < wordpress -u wordpressuser -ppassword | gzip > /backup/mysql/initial.sql.gz</span></span></pre>
</div>
<div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div>
</div>
</div>
</div>
<div>
</div>
</div>
<div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;">
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">This command created a initial.sql.gz gziped SQL file. To do it on a daily basis, we can schedule it in cron, like before. Our resulting cron line should look like this:</span></span></div>
<div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">0 4 * * * /usr/bin/mysqldump < wordpress -u wordpressuser
-ppassword | /bin/gzip > /backup/mysql/mysql--`date +\%m\%d\%y`.sql.gz</pre>
</div>
<div>
</div>
</div>
<div>
<span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now we could also combine it with scp or rsync to copy it remotely.</span></span></div>
<div>
<pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">0 4 * * * /usr/bin/mysqldump < wordpress -u wordpressuser
-ppassword | /bin/gzip > /backup/mysql/mysql-`date +\%m\%d\%y`.sql.gz;
/usr/bin/scp -i /root/.ssh/id_rsa_backup /backup/mysql/mysql-`date
+\%m\%d\%y`.sql.gz  backup@backup.example.com:/home/backup/
</pre>
</div>
<div>
<a href="http://www.hackthesec.co.in/">HACKTHESEC.CO.IN</a></div>
</div>
</div>

How To Create An Off-Site Backup Of Your Site With Rsync On Centos 6

Backup Of Your Site With Rsync On Centos 6 There are two ways to do backup: incremental and full backups. A full backup copies all the d...

Interactive Shell Script to Copy Files / Directory using SCP

<div dir="ltr" style="text-align: left;" trbidi="on">
<h1 class="post-title single" style="background-color: white; font-family: Arial, Helvetica, sans-serif; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 5px; padding: 0px;">
<span style="color: red; font-size: large;"><u>Interactive Shell Script to Copy Files / Directory using SCP</u></span></h1>
<div>
<div style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 14px; line-height: 21px; margin-bottom: 15px; word-break: break-word;">
This script will allow copy multiple files and directories. Script will only work assuming you have configured ssh key based authentication between two machines.</div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhQ2QAVsVYa3aUSJrMqy8js6qDvn05hXJDd3yUc-3zVcFenQAx1Be5R1NmWSVvFKsmjZ8VWZ-XwZUPWEmwgVACcmcCJNHK3ZhXPi3EnBr-wltfuCL815oqlDSVIhKcIDIkZa2oPSiqk-f_e/s1600/shellscripting_www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="197" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhQ2QAVsVYa3aUSJrMqy8js6qDvn05hXJDd3yUc-3zVcFenQAx1Be5R1NmWSVvFKsmjZ8VWZ-XwZUPWEmwgVACcmcCJNHK3ZhXPi3EnBr-wltfuCL815oqlDSVIhKcIDIkZa2oPSiqk-f_e/s320/shellscripting_www.hackthesec.co.in.jpg" width="320" /></a></div>
<div style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 14px; line-height: 21px; margin-bottom: 15px; word-break: break-word;">
Script will request to input destination hostname or ip address and path of destination folder. On the new line you need to provide filename or directory that need to be copied. You will be only allowed to copy one file or directory per line. When hitting enter , you will allowed to provide next file/directory. <a href="http://www.hackthesec.co.in/search/label/shell_scripting" target="_blank">Script </a>will exit once it receives a blank field.</div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="font-family: Courier New, Courier, monospace; font-size: large;"><span style="line-height: 15.6px;"><span style="color: lime;">#!/bin/bash
</span><span style="color: orange;">#next line prints hearer of script
</span><span style="color: lime;">echo "Interactive Script to Copy File (files) / Directory using scp"
</span><span style="color: orange;">#next line check if entered value is not null, and if null it will reask user to enter Destination Server
</span><span style="color: lime;">while [ x$desthost = "x" ]; do
</span><span style="color: orange;">#next line prints what userd should enter, and stores entered value to variable with name desthost
</span><span style="color: lime;">read -p "Destination Server Name : " desthost
</span><span style="color: orange;">#next line finishes while loop
</span><span style="color: lime;">done</span><span style="color: white;">
</span><span style="color: orange;">#next line check if entered value is not null, and if null it will reask user to enter Destination Path
</span><span style="color: lime;">while [ x$destpath = "x" ]; do
</span><span style="color: orange;">#next line prints what userd should enter, and stores entered value to variable with name destpath
</span><span style="color: lime;">read -p "Destination Path : " destpath
</span><span style="color: orange;">#next line finishes while loop
</span><span style="color: lime;">done</span><span style="color: white;">
</span><span style="color: orange;">#next line put null value to variable filename
</span><span style="color: lime;">filename='null'
</span><span style="color: orange;">#next line check if entered value is null, and If not null it will reask user to enter file(s) to copy
</span><span style="color: lime;">while ! [ x"$filename" = "x" ]; do
</span><span style="color: orange;">#next line prints what userd should enter, and stores entered value to variable with name filename
</span><span style="color: lime;">read -p "Path to source directory / file : " filename
</span><span style="color: orange;">#next line checks if entered value is not null, and if not null it will copy file(s)
</span><span style="color: lime;">if ! [ x"$filename" = "x" ];
then</span><span style="color: white;">
</span><span style="color: orange;">#next line prints header
</span><span style="color: lime;">echo -n "Copying $filename ... "
</span><span style="color: orange;">#next like copy pre-entered file(s) or dir to destination path on destination server
</span><span style="color: lime;">scp -r "$filename" "$desthost":"$destpath"
</span><span style="color: orange;">#end of if
</span><span style="color: lime;">fi</span><span style="color: white;">
</span><span style="color: orange;">#next line finishes while loop
</span><span style="color: lime;">done</span></span></span></pre>
<div style="background-color: white; font-family: Arial, Helvetica, sans-serif; line-height: 21px; margin-bottom: 15px; word-break: break-word;">
<span style="color: #0b5394; font-size: large;"><u>Running the scp script</u></span></div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="font-family: Courier New, Courier, monospace; font-size: large;"><span style="line-height: 15.6px;"><span style="color: white;">[root@testos ~]# sh </span><span style="color: lime;">scpscript.sh</span><span style="color: white;">
Interactive Script to Copy File (files) / Directory using scp
Destination Server Name : 192.168.0.2
</span><span style="color: lime;">Destination Path : /tmp
</span><span style="color: white;">Path to source directory / file : /root/backup.txt
backup.txt 100% 0 0.0KB/s 00:00
</span><span style="color: yellow;">Path to source directory / file : /root/docsdir
</span><span style="color: lime;">file2.txt 100% 0 0.0KB/s 00:00
</span><span style="color: white;">file3.txt 100% 0 0.0KB/s 00:00
</span><span style="color: lime;">file1.txt 100% 0 0.0KB/s 00:00
</span><span style="color: white;">Path to source directory / file :
[root@testos ~]#</span></span></span></pre>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="font-family: Courier New, Courier, monospace; font-size: large;"><span style="line-height: 15.6px;"><span style="color: white;"><a href="http://www.hackthesec.co.in/" target="_blank">www.hackthesec.co.in</a>
<a href="http://www.twitter.com/hackthesecurity">www.twitter.com/hackthesecurity</a></span></span></span></pre>
</div>
</div>

Interactive Shell Script to Copy Files / Directory using SCP

Interactive Shell Script to Copy Files / Directory using SCP This script will allow copy multiple files and directories. Script will on...

Shell Script to Backup Files / Directories Using rsync

#We will save path to backup file in variable
backupf='/tmp/bckup.txt'

#Next line just prints message
echo "Shell Script Backup Your Files / Directories Using rsync"

#next line check if entered value is not null, and if null it will reask user to enter Destination Server
while [ x$desthost = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name desthost
read -p "Destination backup Server : " desthost

#next line finishes while loop
done

#next line check if entered value is not null, and if null it will reask user to enter Destination Path
while [ x$destpath = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name destpath
read -p "Destination Folder : " destpath

#next line finishes while loop
done

#Next line will start reading backup file line by line
for line in `cat $backupf`

#and on each line will execute next
do

#print message that file/dir will be copied
echo "Copying $line ... "
#copy via rsync file/dir to destination

rsync -ar "$line" "$desthost":"$destpath"

#this line just print done
echo "DONE"

#end of reading backup file
done</span></span></pre>
</div>
<div>
<strong style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 14px; line-height: 21px;"><span style="color: #0b5394;">Running the script with output</span></strong></div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">[root@hackthesec tmp]# ./bckrsync.sh
Shell Script Backup Your Files / Directories Using rsync
Destination backup Server : 104.*.*.41
Destination Folder : /tmp
Copying /tmp/oracledb ...
The authenticity of host '104.*.*.41 (104.*.*.41)' can't be established.
ECDSA key fingerprint is 96:11:61:17:7f:fa:......
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '104.*.*.41' (ECDSA) to the list of known hosts.
root@104.*.*.41's password:
DONE
Copying /tmp/dataconfig.txt ...
root@104.*.*.41's password:
DONE
Copying /tmp/docs ...
root@104.*.*.41's password:
DONE
[root@Fedora21 tmp]#</span></span></pre>
</div>
<div>
<h2 style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 18pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
<span style="color: #0b5394;">Script 2 :</span></h2>
</div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">#!/bin/bash

#We will save path to backup file in variable
backupf='/tmp/bckup.txt'

#Next line just prints message
echo "Shell Script Backup Your Files / Directories Using rsync"

#next line check if entered value is not null, and if null it will reask user to enter Destination Server
while [ x$desthost = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name desthost
read -p "Destination backup Server : " desthost

#next line finishes while loop
done

#next line check if entered value is not null, and if null it will reask user to enter Destination Path
while [ x$destpath = "x" ]; do

#next line prints what userd should enter, and stores entered value to variable with name destpath
read -p "Destination Folder : " destpath

#next line finishes while loop
done

#next line check if entered value is not null, and if null it will reask user to enter password
while [ x$password = "x" ]; do
#next line prints what userd should enter, and stores entered value to variable with name password. #To hide password we are using -s key
read -sp "Password : " password
#next line finishes while loop
done

#Next line will start reading backup file line by line
for line in `cat $backupf`

#and on each line will execute next
do

#print message that file/dir will be copied
echo "Copying $line ... "
#we will use expect tool to enter password inside script
/usr/bin/expect << EOD
#next line set timeout to -1, recommended to use
set timeout -1
#copy via rsync file/dir to destination, using part of expect — spawn command

spawn rsync -ar ${line} ${desthost}:${destpath}
#as result of previous command we expect “password” promtp
expect "*?assword:*"
#next command enters password from script
send "${password}\r"
#next command tells that we expect end of file (everything finished on remote server)
expect eof
#end of expect pard
EOD
#this line just print done
echo "DONE"

#end of reading backup file
done</span></span></pre>
</div>
<div>
<span style="line-height: 23.4px;"><b><span style="color: #0b5394; font-size: large;">Script 3: </span></b></span></div>
<div>
<span style="line-height: 23.4px;"><b><span style="color: #0b5394; font-size: large;">Normal Method Through terminal</span></b></span><span style="background-color: white; color: #111111; font-family: "arial" , "helvetica neue" , "helvetica" , sans-serif; font-size: 20px; line-height: 32px;">Task: Backup /home/hackthesec to /mnt/usbdri</span></div>
<div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">$ rsync -au /home/hackthesec /mnt/usbdri</span></span></pre>
<div style="background-color: white; color: #111111; font-family: Arial, 'Helvetica Neue', Helvetica, sans-serif; font-size: 16px; line-height: 27px; margin-bottom: 27px; padding: 0px; word-wrap: break-word;">
To delete files in backup directory that no longer exist in directory being backed up, enter:</div>
<pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-size: medium;"><span style="line-height: 15.6px;">$ rsync -au --delete /home/hackthesec /mnt/usbdri</span></span></pre>
<div style="background-color: white; color: #111111; font-family: Arial, 'Helvetica Neue', Helvetica, sans-serif; font-size: 16px; line-height: 27px; margin-bottom: 27px; padding: 0px; word-wrap: break-word;">
<a href="http://www.hackthesec.co.in/" target="_blank">www.hackthesec.co.in</a><br />
<a href="http://www.twitter.com/hackthesecurity">www.twitter.com/hackthesecurity</a></div>
</div>
</div>

Shell Script to Backup Files / Directories Using rsync

Backup Files / Directories Using rsync rsync command easily backup your home directory to local secondary hard disk or remote server usi...