Cryptmount – A Utility to Create Encrypted Filesystems in Linux

<div dir="ltr" style="text-align: left;" trbidi="on"> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">cryptmount is a utility for GNU/Linux operating systems which allows an ordinary user to mount an encrypted filing system without requiring superuser privileges. It is aimed at Linux systems using the 2.6 kernel series or later.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <br /> <div class="separator" style="clear: both; text-align: center;"> <a href="http://cryptmount.sourceforge.net/crypt-img.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="482" data-original-width="700" src="http://cryptmount.sourceforge.net/crypt-img.png" /></a></div> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Technical background</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">There are currently two main approaches to using encrypted filesystems within the linux kernel:</span></span><br /> <br /> <ul style="text-align: left;"> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">the cryptoloop device driver;</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">the device-mapper system, using the dm-crypt target.</span></span></li> </ul> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">The (older) cryptoloop system has grown in parallel with the loopback device-driver of 2.4 kernel series, but has now been superseded by the device-mapper capabilities of the 2.6 kernel series. The newer devmapper system offers a <a href="http://docs.linux.com/article.pl?sid=04/06/07/2036205&tid=72&tid=14&tid=35">cleaner organization</a> of encryption and device-access, and superior performance has <a href="http://deb.riseup.net/storage/encryption/dmcrypt">been noted</a>. Alternative user-space tools which allow individual files to be encrypted are also widely available, but allow some information about file sizes & organization to be exposed.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">With the older cryptoloop system, it was possible to describe all the details of an encrypted filesystem within /etc/fstab so that it could be configured completely by 'mount'. This meant that it was particularly easy to give any user permission to mount those encrypted filesystems simply by providing the 'user' option within /etc/fstab.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">With the newer device-mapper infrastructure, there are more stages involved in mounting an encrypted filing system, and neither does 'mount' currently allow this nor does the syntax of /etc/fstab lend itself to describing all the necessary filesystem parameters. This is especially so if the filesystem is stored in an ordinary file, which would require separate configuration of a loopback device and a devmapper target before the filesystem could be accessed.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">cryptmount was written to make it as easy for ordinary users to access encrypted filesystems on-demand using the newer devmapper mechansism as it was to use the older, now deprecated, cryptoloop methods. This offers the following advantages:</span></span><br /> <br /> <ul style="text-align: left;"> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">access to improved functionality in the kernel</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">transparent support for filesystems stored on either raw disk partitions or loopback files</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"></span></li> <li style="font-size: 15px;"><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;">separate encryption of filesystem access keys, allowing access passwords to be changed without re-encrypting the entire filesystem</span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">storing multiple encrypted filesystems within a single disk partition, using a designated subset of blocks for each</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">rarely used filesystems do not need to be mounted at system startup</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">un-mounting of each filesystem is locked so that this can only be performed by the user that mounted it, or the superuser</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">encrypted filesystems compatible with cryptsetup</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">encrypted access-keys can be chosen to be compatible with openssl, or managed via libgcrypt, or (for 2.0 release-series) built-in SHA1/Blowfish ciphers</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">support for encrypted swap partitions (superuser only)</span></span></li> <li><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">support for setting up encrypted filesystems or crypto-swap at system boot-up</span></span></li> </ul> <span style="font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><u><span style="color: #0b5394;"><b>Install and Configure Cryptmount in Linux</b></span></u></span></span><br /> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">On Debian/Ubuntu distributions, you can install Cryptmount using the following command line</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">sudo apt install cryptmount</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">On RHEL/CentOS/Fedora distributions,install it from source. First start installing the required package(s) to successfully build and use cryptmount.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">yum install device-mapper-devel</span></span></pre> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">yum groupinstall "Development tools"</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Then download the latest Cryptmount source files.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">wget https://downloads.sourceforge.net/project/cryptmount/cryptmount/cryptmount-5.2/cryptmount-5.2.4.tar.gz tar -xzf cryptmount-5.2.4.tar.gz cd cryptmount-5.2.4 ./configure make make instal</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">After installation go for setup using bellow command line</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">cryptmount-setup</span></span></pre> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi4_bf_zluIl3w2Tpa7Kj-r9HtLoen_02EXBU0bh0fZCpA9sXzYivNF0EIGcs7tNx4I95ID2E9k3NkajvFnLo8BGvbCj5ovWxGdVFnPo6EqmrnqtPihRHc-53-IqMBlBufcKWY8yQPfXWmF/s1600/crypt.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="729" data-original-width="872" height="534" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi4_bf_zluIl3w2Tpa7Kj-r9HtLoen_02EXBU0bh0fZCpA9sXzYivNF0EIGcs7tNx4I95ID2E9k3NkajvFnLo8BGvbCj5ovWxGdVFnPo6EqmrnqtPihRHc-53-IqMBlBufcKWY8yQPfXWmF/s640/crypt.png" width="640" /></a></div> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Once the new encrypted filesystem is created, you can access it as follows (enter the name you specified for your target – hackthesec), you will be prompted to enter the password for the target.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">cryptmount hackthesec cd /home/crypt</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">To unmount the target run cd command to get out of the encrypted filesystem, then use the -u switch to unmount as shown.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">cryptmount -u hackthesec</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">For more information you can use bellow command or you can visit cryptmount website </span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">man cryptmount man cmtab </span></span></pre> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">Website - <a href="http://cryptmount.sourceforge.net/">http://cryptmount.sourceforge.net/</a></span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #990000; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Troubleshooting in my case</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">After installation i just received a error message from my ubuntu box</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">"Taking backup of cryptmount master config-file (@ETCDIR@/cmtab.bckp-setup)...mv: cannot stat '@ETCDIR@/cmtab': No such file or directory"</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">for this error just follow bellow commands </span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">root@new:~# which cryptmount-setup /usr/sbin/cryptmount-setup </span></span></pre> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">root@new:~# vi /usr/sbin/cryptmount-setup</span></span></pre> <div> <br /></div> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">and</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Changed from: </span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">CM_CFGDIR="@ETCDIR@" </span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Changed to: </span></span><br /> <span style="font-size: 15px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">CM_CFGDIR="/etc/cryptmount" </span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgl2TwF9Wwl7nDpTkNEiFGAiPXW-CHo-qnTXW_GHzY9KFg-J7h3DYLDB9UWEwpKukmywnK7Aq5BguCnHgZ5DbkStwhDSdk162w3-GjzuSkqQvoQEIBAjnUaeCpcuIMra1s6zJsh-TM-Nefg/s1600/cryptchange.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="424" data-original-width="723" height="374" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgl2TwF9Wwl7nDpTkNEiFGAiPXW-CHo-qnTXW_GHzY9KFg-J7h3DYLDB9UWEwpKukmywnK7Aq5BguCnHgZ5DbkStwhDSdk162w3-GjzuSkqQvoQEIBAjnUaeCpcuIMra1s6zJsh-TM-Nefg/s640/cryptchange.png" width="640" /></a></div> <br /></div>

Cryptmount – A Utility to Create Encrypted Filesystems in Linux

cryptmount is a utility for GNU/Linux operating systems which allows an ordinary user to mount an encrypted filing system without requiring...

Read more »

How to Install and Configure Amanda Backup Server

<div dir="ltr" style="text-align: left;" trbidi="on"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">AMANDA, the Advanced Maryland Automatic Network Disk Archiver, is a backup solution that allows the IT administrator to set up a single master backup server to back up multiple hosts over network to tape drives/changers or disks or optical media. Amanda uses native utilities and formats (e.g. dump and/or GNU tar) and can back up a large number of servers and workstations running multiple versions of Linux or Unix.</span></span><br /> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg8r3zI99geeFCqnAhyL_W4ik18Y2ec0_hKGF2wSvyU4U0dgSK0miJgw1xFeuvbRMWYRoeVwiF0YUm6D89lr2QNPKYSqXYs2LI96wZoVv-nz9VoQdEVHvRd1ymdfG1px2u_Nvpt6BySxig/s1600/amanda1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="409" data-original-width="611" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg8r3zI99geeFCqnAhyL_W4ik18Y2ec0_hKGF2wSvyU4U0dgSK0miJgw1xFeuvbRMWYRoeVwiF0YUm6D89lr2QNPKYSqXYs2LI96wZoVv-nz9VoQdEVHvRd1ymdfG1px2u_Nvpt6BySxig/s1600/amanda1.png" /></a></div> <div class="separator" style="clear: both; text-align: center;"> <br /></div> <div class="separator" style="clear: both; text-align: left;"> <b><span style="color: blue;"><br /></span></b></div> <div class="separator" style="clear: both; text-align: left;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><b>Install Amanda Server</b></span></span></div> <div class="separator" style="clear: both; text-align: left;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><b>==============</b></span></span></div> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Install amanda packages using yum:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif; font-size: 12px;"><span style="font-size: 14px;"># </span></span><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">yum install -y amanda*</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Create the configuration file. I am going to name this backup project is ServerNetBackup. We need to create a directory named by this project and all configuration files for this project will be underneath it:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif; font-size: 12px;"><span style="font-size: 14px;"># </span></span><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">mkdir /etc/amanda/ServerNetBackup</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Create the core configuration file, amanda.conf:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">vim /etc/amanda/ServerNetBackup/amanda.conf</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">And paste following line:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">org "ServerNetBackup" # Organization name for reports mailto "address@hackthesec.co.in" # Email address to receive reports netusage 10000 Kbps # Bandwidth limit, 10M dumpcycle 1 week # Backup cycle is 7 days runspercycle 7 # Run 7 times every 7 days tapecycle 15 tapes # Dump to 15 different tapes during the cycle tpchanger "chg-disk" # The tape-changer glue script changerfile "/etc/amanda/ServerNetBackup/changer" # The tape-changer file tapedev "file://central_backup/ServerNetBackup/slots" # The no-rewind tape device to be used tapetype HARDDISK # Define the type of tape infofile "/etc/amanda/ServerNetBackup/curinfo" # Database directory logdir "/etc/amanda/ServerNetBackup/logs" # Log directory indexdir "/etc/amanda/ServerNetBackup/index" # Index directory define tapetype HARDDISK { # Define our tape behaviour length 100000 mbytes # Every tape is 100GB in size } amrecover_changer "changer" # Changer for amrecover define dumptype global { # The global dump definition maxdumps 2 # The maximum number of backups run in parallel estimate calcsize # Estimate the backup size before dump holdingdisk yes # Dump to temp disk (holdingdisk) before backup to tape index yes # Generate index. For restoration usage } define dumptype root-tar { # How to dump root's directory global # Include global (as above) program "GNUTAR" # Program name for compress comment "root partitions dumped with tar" compress none # No compress index # Index this dump priority low # Priority level } define dumptype user-tar { # How to dump user's directory root-tar # Include root-tar (as above) comment "user partitions dumped with tar" priority medium # Priority level } define dumptype comp-user-tar { # How to dump & compress user's directory user-tar # Include user-tar (as above) compress client fast # Compress in client side with less CPU (fast) }</span></span></pre> <div> <span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;"><br /></span></span></div> <div class="separator" style="clear: both; text-align: left;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Configure Backup Location</span></span></div> <div class="separator" style="clear: both; text-align: left;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">=================</span></span></div> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Prepare the directory to store all backups:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">mkdir -p /central_backup/ServerNetBackup/slots</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Assign correct permission to user amandabackup for the configuration directory and backup directory:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ chown amandabackup.disk /central_backup -Rf $ chown amandabackup.disk /etc/amanda/ServerNetBackup -Rf</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Login as user amandabackup:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">su - amandabackup</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Create the virtual tape. This is where the backup files will be stored. We will need to create 15 slots as per tapecycle keyword:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ for n in `seq 1 15`; do mkdir /central_backup/ServerNetBackup/slots/slot${n}; done</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">We then need to label all slots:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ for n in `seq 1 15` ; do amlabel ServerNetBackup ServerNetBackup-${n} slot ${n}; done</span></span></pre> <div class="separator" style="clear: both; text-align: left;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Create all required directories as defined in the configuration file:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ mkdir /etc/amanda/ServerNetBackup/curinfo $ mkdir /etc/amanda/ServerNetBackup/logs $ mkdir /etc/amanda/ServerNetBackup/index</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Configure Service and What to Backup</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> </div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">We need to define what to backup in a file called disklist. As user amandabackup, create this file:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ su - amandabackup $ vim /etc/amanda/ServerNetBackup/disklist</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">And add following line:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">sv101.hackthesec.co.in /home/webby/public_html comp-user-tar gogogo.hackthesec.co.in /etc root-tar</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Notes: Make sure the hostname is FQDN and can be resolved to an IP. Add the host entry into /etc/hosts is recomended.</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> </div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Exit from amandabackup user and get back to root user:</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Enable amanda service in xinetd.d directory:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">vim /etc/xinetd.d/amanda</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">And change following line from "yes" to "no"</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Enable on boot and restart xinetd service:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ chkconfig xinetd on $ service xinetd restart</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Check the amanda server whether it is running properly by using following command:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ netstat -a | grep amanda udp 0 0 *:amanda *:*</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">If you see result as above, amanda server is ready to serve!</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Install Amanda Backup Client</span></span></div> <div class="separator" style="clear: both;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">======================</span></span></div> <div class="separator" style="clear: both;"> </div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Login to the client’s server and install required package for Amanda using yum:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ yum install -y amanda amanda-client</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">As user amandabackup, add following line into /var/lib/amanda/.amandahosts to specify where is Amanda backup server:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ su - amandabackup $ vim /var/lib/amanda/.amandahosts</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">And make sure the value as below:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">office.hackthesec.co.in amandabackup amdump localhost amandabackup amdump localhost.localdomain amandabackup amdump</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Exit from user amandabackup and turn to root user:</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Enable amanda service in xinetd.d directory:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ vim /etc/xinetd.d/amanda</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">And change following line from"yes" to "no"</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Enable on boot and start the xinetd service</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ chkconfig xinetd on $ service xinetd start</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Add an entry in /etc/hosts to define backup server IP by adding following line:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">125.10.90.90 office.hackthesec.co.in</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">In some case, you may need to change the permission of the directory that you want to backup. For example, I need to allow user amandabackup to access directory /home/webby/public_html to create backup:</span></span></div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> </div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">As root user, change the permission of the directory:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ chmod 755 /home/webby</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Run the Backup Process</span></span></div> <div class="separator" style="clear: both;"> <span style="color: blue; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">=================</span></span></div> <div class="separator" style="clear: both;"> </div> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Now go back to the Amanda server and check our configuration file as amandabackup user:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ su - amandabackup $ amcheck ServerNetBackup</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">You should see the output similar to this:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">Client check: 2 host checked in 2.070 seconds. 0 problems found.</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">If no error found, you can start the backup process immediately by running following command:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ amdump ServerNetBackup</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">Or, we can automate this process using cronjob. Run following command as amandabackup user:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ crontab -e</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">And add following line:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">45 0 * * 2-6 /usr/sbin/amdump ServerNetBackup</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;">As root user, reload the crond service to activate this job:</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white; font-family: monospace, serif;"><span style="font-size: 14px;">$ service crond reload</span></span></pre> <div class="separator" style="clear: both;"> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div> <div class="separator" style="clear: both;"> <a href="http://forums.zmanda.com/" style="background-color: #7baac3; color: white; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 15.36px; font-weight: 900; padding: 2px 0px 2px 10px; text-decoration-line: none;">Amanda forums</a><a href="http://forums.zmanda.com/" style="background-color: #7baac3; color: white; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 15.36px; font-weight: 900; padding: 2px 0px 2px 10px; text-decoration-line: none;"></a><a href="http://wiki.zmanda.com/index.php/Tapetype%20definitions" style="color: white; display: block; font-size: 15.36px; padding: 2px 0px 2px 10px; text-decoration-line: none;">Tape Type List</a><a href="http://forums.zmanda.com/" style="background-color: #7baac3; color: white; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 15.36px; font-weight: 900; padding: 2px 0px 2px 10px; text-decoration-line: none;"></a><a href="http://wiki.zmanda.com/index.php/Main_Page" style="background-color: #d7e6ee; color: #0f519a; display: block; font-size: 15.36px; padding: 2px 0px 2px 10px; text-decoration-line: none;">Amanda Wiki</a></div> <div class="separator" style="clear: both;"> <br /></div> </div>

How to Install and Configure Amanda Backup Server

AMANDA, the Advanced Maryland Automatic Network Disk Archiver, is a backup solution that allows the IT administrator to set up a single mas...

Read more »

How to Install and Configure GlusterFS on Ubuntu 16.04 / Debian 8

<div dir="ltr" style="text-align: left;" trbidi="on"> <div style="text-align: center;"> <span style="color: #0b5394; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Install and Configure GlusterFS(CDN) on Linux</u></b></span></span></div> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">GlusterFS is a scale-out network-attached storage file system. It has found applications including cloud computing, streaming media services, and content delivery networks. GlusterFS was developed originally by Gluster, Inc. and then by Red Hat, Inc., as a result of Red Hat acquiring Gluster in 2011.</span></span><br /> <div class="separator" style="clear: both; text-align: center;"> </div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhdJnOaTc6MSKjAYBe4dn9k7e5ZNAFkeEU6mYamvzREsHufPleqXVl-gUhp_ySHmxGUIob5XPa-sn_QU6gFyF5eqibhdyWQt13Mz79YzQFrKVzjxHtVmOfuh21wD5XR7X6ZIMK338_-oJgO/s1600/Configure-GlusterFS-on-Ubuntu-16.04.png" imageanchor="1"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhdJnOaTc6MSKjAYBe4dn9k7e5ZNAFkeEU6mYamvzREsHufPleqXVl-gUhp_ySHmxGUIob5XPa-sn_QU6gFyF5eqibhdyWQt13Mz79YzQFrKVzjxHtVmOfuh21wD5XR7X6ZIMK338_-oJgO/s1600/Configure-GlusterFS-on-Ubuntu-16.04.png" /></a></div> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="background-color: white; font-size: 15px;"></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">In June 2012, Red Hat Storage Server was announced as a commercially supported integration of GlusterFS with Red Hat Enterprise Linux.Red Hat bought Inktank Storage in April 2014, which is the company behind the Ceph distributed file system, and re-branded GlusterFS-based Red Hat Storage Server to "Red Hat Gluster Storage"</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #0b5394; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Requirements:</u></b></span></span><br /> <div style="clear: both; margin: 10px 0;"> <center> <script async="" src="//pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script> <!-- linuxtutorial8 --> <ins class="adsbygoogle" data-ad-client="ca-pub-5744890361111211" data-ad-slot="1658755283" style="display: inline-block; height: 15px; width: 728px;"></ins></center> </div> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Here, we are going to configure GlusterFS volume with two replicas. Make sure you have two 64bit systems (either virtual or physical) with 1GB of memory, and one spare hard disk on each system.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">gluster1.hackthesec.local|</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">192.168.12.16|</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">Ubuntu 16.04|</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">1GG|</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">/dev/sdb (5GB)</span>--<span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">Node 1</span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;"><br /></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">gluster2.</span></span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">hackthesec.local|</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">192.168.12.17|Debian 8|1GB|/dev/sdb (5GB)--Node 2</span></span><br /> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">client.</span></span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif; font-size: 15px;">hackthesec.local|</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">192.168.12.8|CentOS 7 / Debian|NA|NA|Client Machine</span></span><br /> <br /> <span style="color: #0b5394; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Configure DNS:</u></b></span></span><br /> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">GlusterFS components use DNS for name resolutions, so configure either DNS or set up a hosts entry. If you do not have a DNS on your environment, modify /etc/hosts file and update it accordingly.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo vi /etc/hosts 192.168.12.16 gluster1.hackthesec.local gluster1 192.168.12.17 gluster2.hackthesec.local gluster2 192.168.12.20 client.hackthesec.local client</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Add GlusterFS Repository:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Before proceeding to the installation, we need to configure GlusterFS repository on both storage nodes. Follow the instruction to add the repository to your system.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Debian:</u></b></span></span><br /> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Install support package for https transactions.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo apt-get install -y lsb-release sudo apt-get install -y apt-transport-https</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Add the public key for GlusterFS repository.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">wget -O - http://download.gluster.org/pub/gluster/glusterfs/LATEST/rsa.pub | sudo apt-key add - echo deb https://download.gluster.org/pub/gluster/glusterfs/LATEST/Debian/$(lsb_release -sc)/apt $(lsb_release -sc) main | sudo tee /etc/apt/sources.list.d/gluster.list</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Ubuntu 16.04 / 14.04:</u></b></span></span><br /> <div style="clear: both; margin: 10px 0;"> <center> <script async="" src="//pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script> <!-- linuxtutorial8 --> <ins class="adsbygoogle" data-ad-client="ca-pub-5744890361111211" data-ad-slot="1658755283" style="display: inline-block; height: 15px; width: 728px;"></ins></center> </div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo apt-get install -y software-properties-common sudo add-apt-repository ppa:gluster/glusterfs-3.8</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Install GlusterFS:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Once you have added the repository on your systems, we are good to go for the installation of GlusterFS.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Update the repository cache.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo apt-get update</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Install GlusterFS package using the following command.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo apt-get install -y glusterfs-server</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Start the glusterfs-server service on all gluster nodes.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo service glusterfs-server start</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Verify that the glusterfs service is running fine.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">hackthesec@gluster1:~$ sudo service glusterfs-server status ● glusterfs-server.service - LSB: GlusterFS server Loaded: loaded (/etc/init.d/glusterfs-server; bad; vendor preset: enabled) Active: active (running) since Sat 2016-09-24 21:47:20 IST; 1min 6s ago Docs: man:systemd-sysv-generator(8) Process: 1570 ExecStop=/etc/init.d/glusterfs-server stop (code=exited, status=0/SUCCESS) Process: 1664 ExecStart=/etc/init.d/glusterfs-server start (code=exited, status=0/SUCCESS) Tasks: 7 (limit: 512) Memory: 25.5M CPU: 3.552s CGroup: /system.slice/glusterfs-server.service └─1673 /usr/sbin/glusterd -p /var/run/glusterd.pid Sep 24 21:47:16 gluster1.hackthesec.local systemd[1]: Starting LSB: GlusterFS server... Sep 24 21:47:16 gluster1.hackthesec.local glusterfs-server[1664]: * Starting glusterd service glusterd Sep 24 21:47:20 gluster1.hackthesec.local glusterfs-server[1664]: ...done. Sep 24 21:47:20 gluster1.hackthesec.local systemd[1]: Started LSB: GlusterFS server.</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Configure Firewall:</u></b></span></span><br /> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">You would need to either disable the firewall or configure the firewall to allow all connections within a cluster.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo iptables -I INPUT -p all -s <ip-address> -j ACCEPT</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Add Storage:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Assuming that you have one spare hard disk on your machine, /dev/sdb is the one I will use here for a brick. Create a single partition on the spare hard disk shown like below.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">You would need to perform the below steps on both nodes.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">sudo iptables -I INPUT -p all -s <ip-address> -j ACCEPT</pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Add Storage:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Assuming that you have one spare hard disk on your machine, /dev/sdb is the one I will use here for a brick. Create a single partition on the spare hard disk shown like below.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">You would need to perform the below steps on both nodes.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;">sudo fdisk /dev/sdb</pre> <div class="separator" style="clear: both; text-align: center;"> </div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi77o2pDFqlYzs1YeLig6t_MyZiWZDp-gZdp520aemOh3gJRCGdVn6dTfCQiZGYpfiNOVTEB0sSQDTNJ7J_m0dpeJZv7hPWlF23BhrMIt6h1R3256r4AzsIGbGroniCMLuCVpl2DQLp9v01/s1600/xCreate-a-Partition.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi77o2pDFqlYzs1YeLig6t_MyZiWZDp-gZdp520aemOh3gJRCGdVn6dTfCQiZGYpfiNOVTEB0sSQDTNJ7J_m0dpeJZv7hPWlF23BhrMIt6h1R3256r4AzsIGbGroniCMLuCVpl2DQLp9v01/s1600/xCreate-a-Partition.png" /></a></div> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Format and Mount the created partition with the filesystem of your choice.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif; font-size: 14px;">sudo mkfs.ext4 /dev/sdb1 sudo mkdir -p /data/gluster sudo mount /dev/sdb1 /data/gluster echo "/dev/sdb1 /data/gluster ext4 defaults 0 0" | sudo tee --append /etc/fstab</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px; white-space: normal;"> </span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Configure GlusterFS on Ubuntu 16.04:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Before creating a volume, we need to create trusted storage pool by adding gluster2.hackthesec.local. You can run GlusterFS configuration commands on any one server in the cluster will execute the same command on all other servers.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Here I will run all GlusterFS commands in gluster1.hackthesec.local node.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif; font-size: 14px;">hackthesec@gluster1:~$ sudo gluster peer probe gluster2.hackthesec.local peer probe: success. hackthesec@gluster1:~$ sudo gluster peer status Number of Peers: 1 Hostname: gluster2.hackthesec.local Uuid: 51470928-dfa8-42e1-a221-d7bbcb8c13bd State: Peer in Cluster (Connected) hackthesec@gluster1:~$ sudo gluster pool list UUID Hostname State 51470928-dfa8-42e1-a221-d7bbcb8c13bd gluster2.hackthesec.local Connected dc7c1639-d21c-4adf-b28f-5150229e6980 localhost Connected</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px; white-space: normal;"> </span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Setup GlusterFS Volume:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Create a brick (directory) called "gvol0" in the mounted file system on both nodes.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">sudo mkdir -p /data/gluster/gvol0</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Since we are going to use replicated volume, so create the volume named "gvol0" with two replicas.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">hackthesec@gluster1:~$ sudo gluster volume create gvol0 replica 2 gluster1.hackthesec.local:/data/gluster/gvol0 gluster2.hackthesec.local:/data/gluster/gvol0 volume create: gvol0: success: please start the volume to access data</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Start the volume.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">hackthesec@gluster1:~$ sudo gluster volume start gvol0 volume start: gvol0: success</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Check the status of the created volume.</span></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">hackthesec@gluster1:~$ sudo gluster volume info gvol0 Volume Name: gvol0 Type: Replicate Volume ID: ca102e4b-6cd1-4d9d-9c5a-03b882c76da0 Status: Started Snapshot Count: 0 Number of Bricks: 1 x 2 = 2 Transport-type: tcp Bricks: Brick1: gluster1.hackthesec.local:/data/gluster/gvol0 Brick2: gluster2.hackthesec.local:/data/gluster/gvol0 Options Reconfigured: transport.address-family: inet performance.readdir-ahead: on nfs.disable: on</span></span></pre> <span style="color: #0b5394; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>Setup GlusterFS Client:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Install glusterfs-client package to support the mounting of GlusterFS filesystems. Run all commands as root user.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">$ su - ### CentOS / RHEL ### yum install -y glusterfs-client ### Ubuntu / Debian ### apt-get install -y glusterfs-client</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Create a directory to mount the GlusterFS filesystem.</span></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">mkdir -p /mnt/glusterfs</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Now, mount the GlusterFS filesystem to /mnt/glusterfs using the following command.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">mount -t glusterfs gluster1.hackthesec.local:/gvol0 /mnt/glusterfs</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">You can also use gluster2.hackthesec.local instead of gluster1.hackthesec.com in the above command.</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Verify the mounted GlusterFS filesystem.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">[root@client ~]# df -hP /mnt/glusterfs Filesystem Size Used Avail Use% Mounted on gluster1.hackthesec.local:/gvol0 4.8G 11M 4.6G 1% /mnt/glusterfs</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">You can also use below command to verify the GlusterFS filesystem.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">[root@client ~]# cat /proc/mounts rootfs / rootfs rw 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=490448k,nr_inodes=122612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpuacct,cpu 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls cgroup rw,nosuid,nodev,noexec,relatime,net_cls 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/mapper/centos-root / xfs rw,seclabel,relatime,attr2,inode64,noquota 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=25,pgrp=1,timeout=300,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 /dev/mapper/centos-home /home xfs rw,seclabel,relatime,attr2,inode64,noquota 0 0 /dev/sda1 /boot xfs rw,seclabel,relatime,attr2,inode64,noquota 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=100136k,mode=700 0 0 gluster1.hackthesec.local:/gvol0 /mnt/glusterfs fuse.glusterfs rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Add below entry to /etc/fstab for automatically mounting during system boot.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">gluster1.hackthesec.local:/gvol0 /mnt/glusterfs glusterfs defaults,_netdev 0 0</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Test GlusterFS Replication and High-Availability:</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">GlusterFS Server Side:</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">To check the replication, mount the created GlusterFS volume on the same storage node.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">hackthesec@gluster1:~$ sudo mount -t glusterfs gluster1.hackthesec.local:/gvol0 /mnt hackthesec@gluster2:~$ sudo mount -t glusterfs gluster2.hackthesec.local:/gvol0 /mnt</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Data inside the /mnt directory of both nodes will always be same (replication).</span></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;"><br /></span></span></span> <span style="color: #0b5394; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><b><u>GlusterFS Client Side:</u></b></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Let’s create some files on the mounted filesystem on the client.hackthesec.local.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif; font-size: 14px;">touch /mnt/glusterfs/file1 touch /mnt/glusterfs/file2 [root@client ~]# ll /mnt/glusterfs/ total 0 -rw-r--r--. 1 root root 0 Sep 26 11:22 file1 -rw-r--r--. 1 root root 0 Sep 26 11:22 file2</span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px; white-space: normal;"> </span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> </span></span><span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Test the both GlusterFS nodes whether they have same data inside /mnt.</span></span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">hackthesec@gluster1:~$ ll /mnt/ total 12 drwxr-xr-x 4 root root 4096 Sep 26 20:52 ./ drwxr-xr-x 24 root root 4096 Sep 25 21:57 ../ -rw-r--r-- 1 root root 0 Sep 26 20:52 file1 -rw-r--r-- 1 root root 0 Sep 26 20:52 file2 hackthesec@gluster2:~$ ls -al /mnt/ total 12 drwxr-xr-x 4 root root 4096 Sep 26 06:30 . drwxr-xr-x 23 root root 4096 Sep 24 08:39 .. -rw-r--r-- 1 root root 0 Sep 26 2016 file1 -rw-r--r-- 1 root root 0 Sep 26 2016 file2</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">As you know, we have mounted GlusterFS volume from gluster1.hackthesec.local on client.hackthesec.local, now it is the time to test the high-availability of the volume by shutting down the node.</span></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">hackthesec@gluster1:~$ sudo poweroff</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Now test the availability of the files, you would see files that we created recently even though the node is down.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">[root@client ~]# ll /mnt/glusterfs/ total 0 -rw-r--r--. 1 root root 0 Sep 26 11:22 file1 -rw-r--r--. 1 root root 0 Sep 26 11:22 file2</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Create some more files on the GlusterFS filesystem to check the replication.</span></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">touch /mnt/glusterfs/file3 touch /mnt/glusterfs/file4</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><span style="font-size: 15px;">Verify the files count.</span></span></span> <br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">[root@client ~]# ll /mnt/glusterfs/ total 0 -rw-r--r--. 1 root root 0 Sep 26 11:22 file1 -rw-r--r--. 1 root root 0 Sep 26 11:22 file2 -rw-r--r--. 1 root root 0 Sep 26 11:26 file3 -rw-r--r--. 1 root root 0 Sep 26 11:26 file4</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Since the gluster1 is down, all your data’s are now written on gluster2.hackthesec.local due to High-Availability. Now power on the node1 (gluster1.hackthesec.local).</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;"><br /></span></span> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Check the /mnt of the gluster1.hackthesec.local; you should see all four files in the directory, this confirms the replication is working as expected.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none; margin-bottom: 10px; margin-top: 10px; overflow: auto; padding: 10px; width: auto; word-break: break-all;"><span style="color: white; font-family: monospace , serif;"><span style="font-size: 14px;">hackthesec@gluster1:~$ sudo mount -t glusterfs gluster1.hackthesec.local:/gvol0 /mnt [sudo] password for hackthesec: hackthesec@gluster1:~$ ll /mnt/ total 12 drwxr-xr-x 4 root root 4096 Sep 26 20:59 ./ drwxr-xr-x 24 root root 4096 Sep 25 21:57 ../ -rw-r--r-- 1 root root 0 Sep 26 20:52 file1 -rw-r--r-- 1 root root 0 Sep 26 20:52 file2 -rw-r--r-- 1 root root 0 Sep 26 20:56 file3 -rw-r--r-- 1 root root 0 Sep 26 20:56 file4</span></span></pre> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">Thanks for watching...</span></span><br /> <span style="color: #333333; font-family: "verdana" , "geneva" , sans-serif;"><span style="font-size: 15px;">www.hackthesec.co.in</span></span></div>

How to Install and Configure GlusterFS on Ubuntu 16.04 / Debian 8

Install and Configure GlusterFS(CDN) on Linux GlusterFS is a scale-out network-attached storage file system. It has found applications in...

Read more »

How to Install and Configure Puppet on CentOS 7 / RHEL 7

<div dir="ltr" style="text-align: left;" trbidi="on"> <span style="background-color: white; line-height: 26px;"><span style="color: #990000; font-family: verdana, geneva, sans-serif; font-size: large;"><b><u>Install and Configure Puppet on CentOS 7 / RHEL 7</u></b></span></span><br /> <span style="background-color: white; color: #333333; font-family: verdana, geneva, sans-serif; font-size: 12px; line-height: 19.2px;"><span style="font-size: 15px; line-height: 26px;"><b><u><a href="http://www.hackthesec.co.in/search/label/puppet" target="_blank">Puppet </a></u></b>is an open-source configuration management tool. It runs on many Unix-like systems as well as on Microsoft Windows, and includes its own declarative language to describe system configuration.</span></span><br /> <div class="separator" style="background-color: white; clear: both; color: #333333; font-family: Verdana, Geneva, sans-serif; font-size: 12px; line-height: 19.2px; text-align: center;"> </div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh7ox3PLkn1wWucxc5pzawlrlkniY2vrwbbOgxyDP-sdmzqZJGZ2SFjp5zooTXX2yUp5sQyeLRudJxODHJTH9A2VaD2BhxXfRVdLjfI41bjM14B0dxikkcksis0X-Jkkeu6x-1vPO9iI82y/s1600/Install-Puppet-in-CentOS_hackthesec.co.in.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh7ox3PLkn1wWucxc5pzawlrlkniY2vrwbbOgxyDP-sdmzqZJGZ2SFjp5zooTXX2yUp5sQyeLRudJxODHJTH9A2VaD2BhxXfRVdLjfI41bjM14B0dxikkcksis0X-Jkkeu6x-1vPO9iI82y/s1600/Install-Puppet-in-CentOS_hackthesec.co.in.png" /></a></div> <span style="background-color: white; color: #333333; font-family: verdana, geneva, sans-serif; font-size: 12px; line-height: 19.2px;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span><span style="background-color: white; color: #333333; font-family: Verdana, Geneva, sans-serif; font-size: 12px; line-height: 19.2px;"></span><span style="background-color: white; color: #333333; font-family: verdana, geneva, sans-serif; font-size: 12px; line-height: 19.2px;"><span style="font-size: 15px; line-height: 26px;"><a href="http://www.hackthesec.co.in/search/label/puppet" target="_blank">Puppet</a> is produced by Puppet Labs, founded by Luke Kanies in 2005. It is written in Ruby and released as free software under the GNU General Public License (GPL) until version 2.7.0 and the Apache License 2.0 after that.</span></span><br /> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"><b><u>Puppet Master:</u></b></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">Operating system : CentOS 7 Minimal IP Address       : 192.168.2.10 HostName         : server.hackthesec.local</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"><b><u>Puppet client:</u></b></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">Operating System : CentOS 7 Minimal IP Address       : 192.168.2.20 HostName         : client.hackthesec.local</pre> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Make sure your system (both puppet server and client) is able to resolve the hostname each other, either use /etc/hosts file or DNS server.</span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="background-color: white; font-size: 15px; line-height: 26px;"></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">To have a production ready puppet setup, we have to use apache with passenger. To get the passenger, download and place the repo file to /etc/yum.repos.d/</span></span><br /> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"><b>Note: Only on the master server.</b></span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; float: none !important; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# curl --fail -sSLo /etc/yum.repos.d/passenger.repo https://oss-binaries.phusionpassenger.com/yum/definitions/el-passenger.repo</pre> <div> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">To install the puppet master / agent, we would require to setup puppet repository on the all the nodes. Enable puppet labs repository by installing below rpm.</span></span></div> <div> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b>Note: Run it on both master and agent nodes.</b></span></span></div> <div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"># rpm -ivh https://yum.puppetlabs.com/puppetlabs-release-el-7.noarch.rpm</pre> </div> <div> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><div> <b><u><span style="color: #0b5394;">Install and Configure Puppet on CentOS 7:</span></u></b></div> <div style="color: #333333;"> Now, its time to install puppet. Install the puppet server using below command.</div> </span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; float: none !important; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# yum -y install puppet-server</pre> <div> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">As said earlier, we will configure puppet for master / agent architecture. So, this node will acts as a master node. Edit the puppet configuration file and modify the dns_alt_names.</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"><span style="color: white;">[</span><span style="color: white;">root@hackthesec server</span><span style="color: white;"> ~]# vi /etc/puppet/puppet.conf</span> <span style="color: white;"> [main] dns_alt_names = </span><span style="box-sizing: border-box;"><span style="box-sizing: border-box;"><span style="color: white;">server,server.hackthesec.local</span></span></span><span style="color: white;"> certname = </span><span style="box-sizing: border-box;"><span style="box-sizing: border-box;"><span style="color: white;">server.hackthesec.local</span></span></span></pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">If this machine is the only puppet master in your environment, run below command to create the puppet master certificate.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# puppet master --verbose --no-daemonize Info: Creating a new SSL key for ca Info: Creating a new SSL certificate request for ca Info: Certificate Request fingerprint (SHA256): 81:C6:BB:8B:1D:71:4C:64:E1:13:54:1B:EC:CF:99:D8:85:90:D1:6C:E8:85:50:3E:03:41:BA:C5:47:A7:4C:E5 Notice: Signed certificate request for ca Info: Creating a new certificate revocation list Info: Creating a new SSL key for server.hackthesec.local Info: csr_attributes file loading from /etc/puppet/csr_attributes.yaml Info: Creating a new SSL certificate request for server.hackthesec.local Info: Certificate Request fingerprint (SHA256): FF:BE:D4:9B:E4:12:83:79:AE:BE:50:17:76:5F:F5:CD:5F:53:EA:5D:AA:5D:87:9E:7C:C4:BC:1B:8A:C6:FA:5C Notice: server.hackthesec.local has a waiting certificate request Notice: Signed certificate request for server.hackthesec.local Notice: Removing file Puppet::SSL::CertificateRequest server.hackthesec.local at '/var/lib/puppet/ssl/ca/requests/server.hackthesec.local.pem' Notice: Removing file Puppet::SSL::CertificateRequest server.hackthesec.local at '/var/lib/puppet/ssl/certificate_requests/server.hackthesec.local.pem' Notice: Starting Puppet master version 3.8.3</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Once you get "Notice: Starting Puppet master version <VERSION>", press ctrl-C to kill the process.</span></span><br /> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"><b><u>Configure a Production-Ready Web Server:</u></b></span></span><br /> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Puppet comes with a basic puppet master web server, but this cannot be used for real-life loads. We must configure a production quality web server before we start managing our nodes with Puppet.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; float: none !important; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# yum -y install httpd httpd-devel mod_ssl ruby-devel rubygems gcc gcc-c++ pygpgme curl</pre> <div> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Install Passenger and apache module.</span></span></div> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# yum install -y mod_passenger</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Create three directories for the application (a parent directory, a "public" directory, and a "tmp" directory), Copy the <b>ext/rack/config.ru</b> file from the Puppet source code into the parent directory and Set the ownership of the config.ru file.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# mkdir -p /usr/share/puppet/rack/puppetmasterd [root@hackthesec server ~]# mkdir /usr/share/puppet/rack/puppetmasterd/public /usr/share/puppet/rack/puppetmasterd/tmp [root@hackthesec server ~]# cp /usr/share/puppet/ext/rack/config.ru /usr/share/puppet/rack/puppetmasterd/ [root@hackthesec server ~]# chown puppet:puppet /usr/share/puppet/rack/puppetmasterd/config.ru</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Add virtual host for puppet by creating the below configuration file.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# vi /etc/httpd/conf.d/puppetmaster.conf</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Add below content into the virtual host file, change the  entries as per your environement.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;"># you probably want to tune these settings PassengerHighPerformance on PassengerMaxPoolSize 12 PassengerPoolIdleTime 1500 # PassengerMaxRequests 1000 PassengerStatThrottleRate 120 <span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">Listen 8140</span></span> <VirtualHost *:8140>         SSLEngine on         SSLProtocol             ALL -SSLv2 -SSLv3         SSLCipherSuite          EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!IDEA:!ECDSA:kEDH:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA         SSLHonorCipherOrder     on         SSLCertificateFile      /var/lib/puppet/ssl/certs/<span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">server.<span style="color: white; font-weight: normal;">hackthesec</span>.local.pem</span></span>        SSLCertificateKeyFile   /var/lib/puppet/ssl/private_keys/<span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">server.<span style="color: white; font-weight: normal;">hackthesec</span>.local.pem</span></span>        SSLCertificateChainFile /var/lib/puppet/ssl/ca/<span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">ca_crt.pem</span></span>         SSLCACertificateFile   /var/lib/puppet/ssl/ca/<span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">ca_crt.pem</span></span>         # If Apache complains about invalid signatures on the CRL, you can try disabling         # CRL checking by commenting the next line, but this is not recommended.         SSLCARevocationFile     /var/lib/puppet/ssl/ca/<span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">ca_crl.pem</span></span>         # Apache 2.4 introduces the SSLCARevocationCheck directive and sets it to none         # which effectively disables CRL checking; if you are using Apache 2.4+ you must         # specify 'SSLCARevocationCheck chain' to actually use the CRL.         # SSLCARevocationCheck chain         SSLVerifyClient optional         SSLVerifyDepth  1         # The `ExportCertData` option is needed for agent certificate expiration warnings         SSLOptions +StdEnvVars +ExportCertData         # This header needs to be set if using a loadbalancer or proxy         RequestHeader unset X-Forwarded-For         RequestHeader set X-SSL-Subject %{SSL_CLIENT_S_DN}e         RequestHeader set X-Client-DN %{SSL_CLIENT_S_DN}e         RequestHeader set X-Client-Verify %{SSL_CLIENT_VERIFY}e          DocumentRoot <span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">/usr/share/puppet/rack/puppetmasterd/public</span></span>         RackBaseURI /         <Directory <span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">/usr/share/puppet/rack/puppetmasterd/</span></span>>                 Options None                 AllowOverride None                 Order allow,deny                 allow from all         </Directory> </VirtualHost>  </pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Restart apache server to take an effect of puppet virtual host, to do that, run following command on terminal.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# systemctl restart  httpd.service</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Disable puppet service and enable apache server to auto start on system boot.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# systemctl disable puppet.service [root@hackthesec server ~]# systemctl enable httpd.service</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><b><u>Firewall:</u></b></span></span><br /> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Puppet listens on port no <b>8140</b>; Configure the IP tables to allow it.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# firewall-cmd --zone=public --add-port=8140/tcp --permanent [root@hackthesec server ~]# firewall-cmd --reload</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><b><u>Install Puppet on Agent Nodes:</u></b></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">On your client machine, install puppet agent using below command.</span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="background-color: white; font-size: 15px; line-height: 26px;"></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Note: You must have puppet repository configured on the agent nodes.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec client ~]# yum -y install puppet</pre> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Edit the puppet configuration file and set puppet master information on the client stanza.</span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="background-color: white; font-size: 15px; line-height: 26px;"></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Note: Modify "server" value as per your environment. In my case, server is "server.hackthesec.local"</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec client ~]# vi /etc/puppet/puppet.conf [agent] server = <span style="box-sizing: border-box; color: lime;"><span style="box-sizing: border-box; font-weight: 700;">server.hackthesec.local</span></span></pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Start puppet on agent node and make it to start automatically on system boot.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec client ~]# systemctl start  puppet.service [root@hackthesec client ~]# systemctl enable puppet.service</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">You would get below events in the logs.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">05:46:45 client systemd: Starting Puppet agent... 05:46:46 client systemd: Started Puppet agent. 05:47:03 client systemd: Reloading. 05:49:10 client puppet-agent[2694]: Did not receive certificate</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"><b><u>Sign the Agent Node's Certificate on Master Server:</u></b></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">In an agent/master deployment, an admin must approve a certificate request for each agent node before that node can fetch configurations. Agent nodes will request certificates the first time they attempt to run.</span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="background-color: white; font-size: 15px; line-height: 26px;"></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Log into the puppet master server and run below command to view outstanding requests.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; line-height: 19.2px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# puppet cert list "server.hackthesec.local" (SHA256) 35:D1:B5:67:52:1C:1C:BH:6H:DD:3C:2E:B0:28:D7:15:52:95:32:95:1F:37:29:2G:5F:D7:4C:F5:DB:94:A1:B2</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Run puppet cert sign to sign a request, or puppet cert sign –all to sign all pending requests.</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec server ~]# puppet cert sign client.hackthesec.local Notice: Signed certificate request for client.hackthesec.local Notice: Removing file Puppet::SSL::CertificateRequest client.hackthesec.local at '/var/lib/puppet/ssl/ca/requests/client.hackthesec.local.pem'</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">Run the following command on client machine to check the certificate</span></span><br /> <pre style="background: rgb(68, 67, 65); border-radius: 6px; border: 1px solid rgb(227, 227, 227); box-sizing: border-box; clear: none !important; color: white; font-family: monospace, serif; font-size: 14px; margin-bottom: 10px !important; margin-top: 10px !important; overflow: auto; padding: 10px !important; width: auto !important; word-break: break-all;">[root@hackthesec client ~]# puppet agent -t Info: Caching certificate for client.hackthesec.local Info: Caching certificate_revocation_list for ca Info: Caching certificate for client.hackthesec.local Info: Retrieving pluginfacts Info: Retrieving plugin Info: Caching catalog for client.hackthesec.local Info: Applying configuration version '1445401911' Info: Creating state file /var/lib/puppet/state/state.yaml Notice: Finished catalog run in 0.09 seconds</pre> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;">That’s All. Now, you have successfully configured puppet master and an agent.</span></span><br /> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"><br /></span></span> <div style="text-align: center;"> <span style="background-color: white; font-size: 15px; line-height: 26px;"><span style="color: #333333; font-family: verdana, geneva, sans-serif;"><a href="http://www.hackthesec.co.in/">www.hackthesec.co.in</a></span></span></div> </div>

How to Install and Configure Puppet on CentOS 7 / RHEL 7

Install and Configure Puppet on CentOS 7 / RHEL 7 Puppet  is an open-source configuration management tool. It runs on many Unix-like syste...

Read more »