Added integrity check option(--checksum)
This commit is contained in:
88
README.md
88
README.md
@@ -1,14 +1,9 @@
|
||||
# backup.sh 
|
||||
`backup.sh` is a POSIX compliant, modular and lightweight backup utility to save and encrypt your files.
|
||||
This tool is intended to be used on small scale UNIX environments such as VPS, personal servers and
|
||||
workstations. `backup.sh` uses [rsync](https://linux.die.net/man/1/rsync), [tar](https://linux.die.net/man/1/tar)
|
||||
and [gpg](https://linux.die.net/man/1/gpg) to copy, compress and encrypt the backup.
|
||||
|
||||
`backup.sh` works under the following operating systems:
|
||||
- GNU/Linux;
|
||||
- OpenBSD
|
||||
- FreeBSD;
|
||||
- Apple MacOS.
|
||||
workstations. `backup.sh` uses [rsync](https://linux.die.net/man/1/rsync), [tar](https://linux.die.net/man/1/tar),
|
||||
[gpg](https://linux.die.net/man/1/gpg) and [sha256sum](https://linux.die.net/man/1/sha256sum)
|
||||
to copy, compress, encrypt the backup and verify the backup.
|
||||
|
||||
## Installation
|
||||
`backup.sh` consists in a single source file, to install it you can copy the script wherever you want.
|
||||
@@ -30,18 +25,23 @@ To show the available options, you can run `backup.sh --help`, which will print
|
||||
```text
|
||||
backup.sh - POSIX compliant, modular and lightweight backup utility.
|
||||
|
||||
Syntax: ./backup.sh [-b|-e|-h]
|
||||
Syntax: ./backup.sh [-b|-c|-e|-h]
|
||||
options:
|
||||
-b|--backup SOURCES DEST PASS Backup folders from SOURCES file.
|
||||
-e|--extract ARCHIVE PASS Extract ARCHIVE using PASS.
|
||||
-h|--help Show this helper.
|
||||
-b|--backup SOURCES DEST PASS Backup folders from SOURCES file.
|
||||
-c|--checksum Generate/check SHA256 of a backup.
|
||||
-e|--extract ARCHIVE PASS Extract ARCHIVE using PASS.
|
||||
-h|--help Show this helper.
|
||||
|
||||
General help with the software: https://github.com/ceticamarco/backup.sh
|
||||
Report bugs to: Marco Cetica(<email@marcocetica.com>)
|
||||
```
|
||||
|
||||
As you can see, `backup.sh` supports two options: **backup creation** and **backup extraction**, the former requires
|
||||
root permissions, while the latter does not. Let us see them in details.
|
||||
As you can see, `backup.sh` supports three options: **backup creation**, **backup extraction** and **checksum** to verify the
|
||||
integrity of a backup. The first option requires
|
||||
root permissions, while the second one does not. The checksum option must be used in combination of one of the previous options.
|
||||
|
||||
### Backup creation
|
||||
To specify the directories to backup, `backup.sh` uses an associative array
|
||||
To specify the directories to back up, `backup.sh` uses an associative array
|
||||
defined in a text file(called _sources file_) with the following syntax:
|
||||
|
||||
```text
|
||||
@@ -68,7 +68,7 @@ backup-ssh-<YYYYMMDD>
|
||||
```
|
||||
|
||||
You can add as many entries as you want, just be sure to use the proper syntax. In particular,
|
||||
the _sources file_, **should not** includes:
|
||||
the _sources file_, **should not** include:
|
||||
- Spaces between the label and the equal sign;
|
||||
- Empty lines;
|
||||
- Comments.
|
||||
@@ -88,19 +88,26 @@ In the previous example, this would be:
|
||||
$> sudo ./backup.sh --backup sources.bk /home/john badpw1234
|
||||
```
|
||||
|
||||
You can also tell `backup.sh` to generate a SHA256 file containing the hash of each file using the `-c` option.
|
||||
In the previous example, this would be:
|
||||
```sh
|
||||
$> sudo ./backup.sh --checksum --backup sources.bk /home/john badpw1234
|
||||
```
|
||||
|
||||
The backup utility will begin to copy the files defined in the _sources file_:
|
||||
```text
|
||||
Copying nginx(1/2)
|
||||
Copying ssh(2/2)
|
||||
Compressing backup...
|
||||
Encrypting backup...
|
||||
File name: /home/marco/backup-<HOSTNAME>-<YYYYMMDD>.tar.gz.enc
|
||||
File name: /home/john/backup-<HOSTNAME>-<YYYYMMDD>.tar.gz.enc
|
||||
Checksum file: /home/john/backup-<HOSTNAME>-<YYYYMMDD>.sha256
|
||||
File size: 7336400696(6.9G)
|
||||
File hash: 0e75ca393117f389d9e8edfea7106d98
|
||||
Elapsed time: 259 seconds.
|
||||
```
|
||||
|
||||
After that, you will find the final backup archive in `/home/john/backup-<HOSTNAME>-<YYYYMMDD>.tar.gz.enc`.
|
||||
After that, you will find the backup archive and the checksum file in
|
||||
`/home/john/backup-<HOSTNAME>-<YYYYMMDD>.tar.gz.enc` and `/home/john/backup-<HOSTNAME>-<YYYYMMDD>.sha256`, respectively.
|
||||
|
||||
You can also use `backup.sh` from a crontab rule:
|
||||
```sh
|
||||
@@ -114,7 +121,8 @@ key is stored in a local file(with fixed permissions) to avoid password leaking
|
||||
adopt this practice while using the `--extract` option to avoid password leaking in shell history.
|
||||
|
||||
### Backup extraction
|
||||
`backup.sh` can also extract the encrypted backup archive using the following syntax:
|
||||
`backup.sh` can also be used to extract the encrypted backup as well to verify the integrity
|
||||
of the backup data. To do so, use the following commands:
|
||||
|
||||
```sh
|
||||
$> ./backup.sh --extract <ENCRYPTED_ARCHIVE> <ARCHIVE_PASSWORD>
|
||||
@@ -128,16 +136,31 @@ For instance:
|
||||
$> ./backup.sh --extract backup-<hostname>-<YYYYMMDD>.tar.gz.enc badpw1234
|
||||
```
|
||||
|
||||
This will create a new folder called `backup.sh.tmp` in your local directory. Be sure to rename any directory
|
||||
with that name to avoid collisions. From the previous example, you should have the following directories:
|
||||
This will create a new folder called `backup.sh.tmp` in your local directory with the following content:
|
||||
```text
|
||||
backup-nginx-<YYYYMMDD>
|
||||
backup-ssh-<YYYYMMDD>
|
||||
```
|
||||
|
||||
**note:**: be sure to rename any directory with that name to avoid collisions.
|
||||
|
||||
|
||||
Instead, if you also want to verify the integrity of the backup data, use the following commands:
|
||||
```sh
|
||||
$> ./backup.sh --checksum --extract <ENCRYPTED_ARCHIVE> <ARCHIVE_PASSWORD> <CHECKSUM_ABSOLUTE_PATH>
|
||||
```
|
||||
|
||||
For instance:
|
||||
|
||||
```sh
|
||||
$> ./backup.sh --checksum --extract backup-<hostname>-<YYYYMMDD>.tar.gz.enc badpw1234 $PWD/backup-<hostname>-<YYYYMMDD>.sha256
|
||||
```
|
||||
|
||||
**note:** be sure to provide the ABSOLUTE PATH of the checksum file.
|
||||
|
||||
## How does backup.sh work?
|
||||
**backup.sh** uses _rsync_ to copy the files, _tar_ to compress the backup and _gpg_ to encrypt it.
|
||||
**backup.sh** uses _rsync_ to copy the files, _tar_ to compress the backup, _gpg_ to encrypt it and
|
||||
_sha256sum_ to verify it.
|
||||
By default, rsync is being used with the following parameters:
|
||||
|
||||
```
|
||||
@@ -153,10 +176,15 @@ That is:
|
||||
- q: quiet mode: reduces the amount of information rsync produces;
|
||||
- delete: delete mode: forces rsync to delete any extraneous files at the destination dir.
|
||||
|
||||
If specified(`--checksum` option), `backup.sh` can also generate the checksum of each file of the backup.
|
||||
To do so, it uses `sha256sum(1)` to compute the hash of every single file using the SHA256 hashing algorithm.
|
||||
The checksum file contains nothing but the checksums of the files, no other information about the files stored
|
||||
on the backup archive is exposed on the unencrypted checksum file. This may be an issue if you want plausible
|
||||
deniability(see privacy section for more information).
|
||||
|
||||
|
||||
After that the backup folder is being encrypted using gpg. By default, it is used with the following parameters:
|
||||
|
||||
|
||||
```
|
||||
$> gpg -a \
|
||||
--symmetric \
|
||||
@@ -177,6 +205,18 @@ This command encrypts the backup using the AES-256 symmetric encryption algorith
|
||||
- `--output`: Specify output file;
|
||||
- `$INPUT`: Specify input file.
|
||||
|
||||
## Plausible Deniability
|
||||
While `backup.sh` provide some pretty strong security against bruteforce attack(assuming a strong passphrase is being used)
|
||||
it should by no means considered a viable tool against a cryptanalysis investigation. Many of the copying, compressing and
|
||||
encrypting operations made by `backup.sh` during the backup process can be used to invalidate plausible deniability.
|
||||
In particular, you should pay attention to the following details:
|
||||
|
||||
1. The `--checksum` option generates an **UNENCRYPTED** checksum file containing the _digests_ of **EVERY**
|
||||
file in your backup archive. If your files are known to your adversary(e.g., a banned book), they may use a rainbow table attack to
|
||||
determine whether you own a given file, voiding your plausible deniability;
|
||||
2. Since `backup.sh` is essentially a set of shell commands, an eavesdropper could monitor the whole backup process to extract
|
||||
the name of the files or the encryption password.
|
||||
|
||||
## Unit tests
|
||||
`backup.sh` provides some unit tests inside the `tests.sh` script. This script generates some dummy files inside the following
|
||||
directories:
|
||||
|
||||
Reference in New Issue
Block a user