Changes

Jump to navigation Jump to search
14,065 bytes removed ,  04:15, 18 October 2008
split page, wiki says it's too large
Line 663: Line 663:     
=== Additional information ===
 
=== Additional information ===
==== Performance ====
+
For details of performance, changelog etc see [[:Affa:Additional information]]
 
  −
It is hard to predict how much time a backup job needs to complete. It depends on the number of files, the total file size, the file changes since last run, the network speed and not least on the CPU power, disk speed and RAM of the source and backup server. The following table of measured values will give you an idea of what you can expect.
  −
     
  −
{|  border="1" cellpadding="3" cellspacing=0
  −
|-
  −
| '''Backup server''' || '''Source server''' || '''Data on source server''' || '''Transferred Data''' || '''Connection''' || '''Compression''' || '''Affa run time'''
  −
|-
  −
| 2x3.2GHz Xeon<br>2 GB RAM, 1.5 TB RAID6
  −
| 2x3.2GHz Dual Core Xeon<br>4 GB RAM, RAID5, SME 7.1<br>Intranet Web Server + MySQL|| 1.4 GB, 12,000 files|| 300 MB, 16 files || Internet 2 Mbit || yes || 2 minutes
  −
|-
  −
| 2x3.2GHz Xeon<br>2 GB RAM, 1.5 TB RAID6
  −
| 2x3.2GHz Dual Core Xeon<br>4 GB RAM, RAID5<br>SME 7.1 Mailserver || 43 GB, 410,000 files || 140 MB, 2,700 files || Internet 2 Mbit|| yes || 10 minutes
  −
|-
  −
| 2x2GHz Dual Core Xeon 5130<br>6 GB RAM, 1 TB RAID 5
  −
| 2x2GHz Dual Core Xeon 5130<br>6 GB RAM, 1 TB RAID 5<br>SME 7.1 File- and Mailserver || 125 GB, 98,000 files || 3,2 GB, 3,000 files || Gbit LAN || no ||  25 minutes
  −
|-
  −
| 2x2GHz Dual Core Xeon 5130<br>6 GB RAM, 874 GB RAID 5
  −
| 2x2GHz Dual Core Xeon 5130<br>6 GB RAM, 1 TB RAID 5<br>SME 7.1 File- and Mailserver || 125 GB, 98,000 files || 3.5 GB, 2000 files || Internet 2 Mbit || yes ||  17 minutes
  −
|-
  −
| 2x800MHz Pentium 3<br>1 GB RAM, 300 GB RAID1
  −
| 2x2.8GHz Xeon,<br> 1GB RAM, 140 GB RAID5<br>SME 7.1 File- and Mailserver || 39 GB, 370,000 files || 12 GB, 4,000 files || 100Mbit LAN || no || 52 minutes
  −
|-
  −
| 1xP4 2.4GHz<br>256 MB RAM<br>SME 7.1
  −
| 2xP4 1GHz<br>1 GB RAM<br>SME 6 || 7.4 GB, 134,790 files || 7.4 GB, 134,790 files || 100Mbit LAN || no || 35 minutes
  −
|}
  −
 
  −
'''Note:''' The last action of a job run is to remove the oldest backup, e.g. if archive scheduled.11 exists and you have set the scheduledKeep property to 12, then it must be deleted. This can take a significantly long time, which increases the total job execution time.
  −
 
  −
A affa --rise run on a SME 7.2, 40 GB data, 411.500 files, 2x2.8 Xeon CPU, 1GB RAM, SW-RAID 5 with 4 U320 SCSI drives took 7 minutes including the final reboot.
  −
 
  −
==== Bug report ====
  −
Affa is listed in the [http://bugs.contribs.org/enter_bug.cgi?product=SME%20Contribs&component=smeserver-affa bugtracker contribs section].
  −
Please report all bugs, new feature requests and documentation issues there.
  −
 
  −
==== Changelog ====
  −
<pre>
  −
* Wed Apr 23 2008 Michael Weinberger 1.0.0-2
  −
  Bug fix #4210, command "affa --show-schedule" executes postJobCommand
  −
* Fri Apr 04 2008 Michael Weinberger 1.0.0-1
  −
  Final release
  −
  man page updated
  −
* Fri Apr 04 2008 Michael Weinberger 0.10.0-2
  −
  added --all option to --rise
  −
* Mon Mar 10 2008 Michael Weinberger 0.10.0-1
  −
  Increased release number
  −
  Added 10 sec timeout in Net::DNS::Resolver->search
  −
* Mon Mar 10 2008 Michael Weinberger 0.9.0-11
  −
  Specfile fix
  −
* Mon Mar 10 2008 Michael Weinberger 0.9.0-10
  −
  Delete locally created watchdog file after remotecopy
  −
  Bugfix 4035
  −
  Added default AutoUnmount property to sample script
  −
  Fix man page
  −
  Do not delete md5sum in --create-backup-file when verify is skipped by user
  −
  Set lock in --create-backup-file
  −
* Sun Mar 09 2008 Michael Weinberger 0.9.0-9
  −
  trap signals in --create-backup-file
  −
* Sat Mar 08 2008 Michael Weinberger 0.9.0-8
  −
  Permissions in /usr/lib/affa
  −
* Sat Mar 08 2008 Michael Weinberger 0.9.0-7
  −
  md5sum in --create-backup-file
  −
* Fri Mar 07 2008 Michael Weinberger 0.9.0-6
  −
  Added option --create-backup-file
  −
  Using line number as error code in affaErrorExit()
  −
  Fixed /etc/profile.d/affa.sh
  −
* Mon Mar 03 2008 Michael Weinberger 0.9.0-5
  −
  delete new style Dovecot's index files dovecot.index*
  −
  delete dovecot index files on remote server in --full-restore
  −
* Fri Feb 29 2008 Michael Weinberger 0.9.0-4
  −
  set localhost as default remoteHostName in /etc/e-smith/templates//etc/cron.d/affa/00jobs
  −
* Wed Feb 27 2008 Michael Weinberger 0.9.0-3
  −
  removed %post from spec file
  −
* Sat Feb 02 2008 Michael Weinberger 0.9.0-2
  −
  Bugfix: Report db was not deleted in deleteJob()
  −
  don't use -q on ssh commands with Debug=yes
  −
* Fri Feb 1 2008 Shad L. Lords <slords@mail.com> 0.9.0-1
  −
  Fix specfile for building in new buildsystem
  −
* Fri Jan 18 2008 Michael Weinberger
  −
  Version 0.9.0
  −
  Bugfix: run cronSetup() after job delete
  −
  Throw error if nothing was backed up (empty archive)
  −
  Added rsyncd support for backing up Windows/Cygwin
  −
  Added option and property remoteOS. Which remoteOS=cgywin the
  −
  send key and revoke key functions use the right path to the
  −
  authorized_keys2 file and login as user Administrator
  −
* Sat Dec 29 2007 Michael Weinberger
  −
  Version 0.8.1
  −
  Automount Bugfix [Bug 3165]: Only exit with error on mount failure when in backup run. Otherwise log the error and  continue.
  −
* Thu Dec 20 2007 Michael Weinberger
  −
  Version 0.8.0
  −
  added bash completion script
  −
  added option --kill JOB
  −
  improved INT and TERM signal handling
  −
  replaced all scp commands by rsync
  −
  added poperty BandwidthLimit (unit KBytes/sec)
  −
  each job write its own known hosts entry using ssh option HostKeyAliasOption
  −
  affa --send-key w/o arguments sends the keys for all jobs
  −
  removed Property StrictHostKeyChecking
  −
  UPDATE FROM VERSIONS<8: run the command 'affa --send-key' to generate the known hosts entries for all jobs
  −
* Wed Dec 12 2007 Michael Weinberger
  −
  Version 0.7.0
  −
  Modified logging: Job run logs to /var/log/affa/JOBNAME.log, all other to /var/log/affa/affa.log
  −
  Bugfix: Check error status of --send-key  and --revoke-key
  −
  New: Options --show-schedule
  −
  Modified: Option --list-archives now accepts multiple args or none
  −
  Fix: install watchdog on source server before every run not only scheduled, to avoid watchdog triggered if a non-scheduled run take to long time.
  −
* Wed Nov 28 2007 Michael Weinberger
  −
  Version 0.6.8
  −
  Bugfix: Automount was done too late. Daily backup never ran.
  −
* Wed Nov 21 2007 Michael Weinberger
  −
  Version 0.6.7
  −
  Bugfix: Size and No. of files were not shown in --status
  −
  Improved deleting of directories
  −
  added --check-connections option
  −
  Increased width of job column in --stats table
  −
* Sun Nov 11 2007 Michael Weinberger
  −
  Version 0.6.6
  −
  Property rsync--modify-window added
  −
  Modified recursivly deleting directories
  −
* Wed Nov 07 2007 Michael Weinberger
  −
  Version 0.6.5
  −
  ssh options added to scp commands
  −
  added post-backup event
  −
* Wed Aug 08 2007 Michael Weinberger
  −
  Version 0.6.4
  −
  delete dovcot index files after a --rise
  −
* Thu Jul 05 2007 Michael Weinberger
  −
  Version 0.6.3
  −
  Bugfix: with RPMCheck=yes the affa-rpmlist was not found in the
  −
  archive. Wrong path to schedule.0 instead of scheduled.running.
  −
  Side effect of changes in version 0.5.0. [Bug 3128]
  −
* Tue Jul 03 2007 Michael Weinberger
  −
  Version 0.6.2
  −
  Bugfix: Filesys::DiskFree requires $ENV{LANG}="en_US" [Bug 3119]
  −
  Bug reported to bug-Filesys-DiskFree [at] rt.cpan.org
  −
* Mon Jun 25 2007 Michael Weinberger
  −
  Version 0.6.1
  −
  Fix 3080 was not applied.
  −
* Mon Jun 18 2007 Michael Weinberger
  −
  Version 0.6.0
  −
  Replaced Filesys::DiskSpace by Filesys::DiskFree as the latter supports CIFS file system
  −
  using Filesys::DiskFree->mount and ->device instead of scanning /proc/mounts
  −
  mkdir RootDir only on job run to avoid making it in an unmounted mountpoint
  −
* Mon Jun 18 2007 Michael Weinberger
  −
  Version 0.5.2
  −
  Sending ssh key failed. When grep returned an error
  −
  the mv command was not executed. Using ';' instead of '&&'
  −
  for chaining commands. [Bug 3080]
  −
  /root/.ssh/authorized_keys2: No such file or directory warning.
  −
  Run a touch to guarantee, that the file exists. [Bug 3080]
  −
  same issue with --revoke-key
  −
* Thu Jun 14 2007 Michael Weinberger
  −
  Version 0.5.1
  −
  Bugfix automount: getStatus() unmounts the device while a job is running
  −
  Status table: Last=never, if there are no archives at all
  −
* Tue Jun 12 2007 Michael Weinberger
  −
  Version 0.5.0
  −
  New property AutomountOptions
  −
  status table: grouped disabled jobs. Show Last='-' for disabled jobs instead of 'failed'
  −
  unlink lockfile in getLock()
  −
  Changes to improve robustness in case of network outage:
  −
  - writing to a temporary archive scheduled.running and linkdest
  −
    against the latest existing archive (usually scheduled.0). Then
  −
    shift archives and rename scheduled.running to scheduled.0
  −
  - scheduledKeep=1 is now allowed
  −
  - also check connection in daily,weekly etc., not only in scheduled run
  −
  - don't run daily, weekly, monthly or yearly, when scheduled.0 doesn't exist.
  −
  new option --revoke-key
  −
  added optional option --revoke-key to --delete-job
  −
  avoid multiple adding public key to authorized_keys2 on source server
  −
* Wed Jun 06 2007 Michael Weinberger
  −
  Version 0.4.7
  −
  use StrictHostKeyChecking=no in sendKeys()
  −
* Tue Jun 05 2007 Michael Weinberger
  −
  Version 0.4.6
  −
  mailtest: Send also a testmail from the remotehost, when property Watchdog=yes
  −
  removed useless code in mailTestWatchdogRemote()
  −
* Mon Jun 04 2007 Michael Weinberger
  −
  Version 0.4.5
  −
  write job config file to the archive dir
  −
* Thu May 31 2007 Michael Weinberger
  −
  Version 0.4.4
  −
  added property StrictHostKeyChecking (ssh option)
  −
  string comparison instead of numric for $job{'doneYearly'} ne $thisYear etc.
  −
* Wed May 30 2007 Michael Weinberger
  −
  Version 0.4.3
  −
  Minor bugfixes:
  −
  calculation of RootDirFilesystemUsage in .AFFA-REPORT
  −
  improved error handling with rsync status and df in DiskspaceWarn()
  −
* Tue May 29 2007 Michael Weinberger
  −
  Version 0.4.2
  −
  Infinite loop in execPostJobCommand() if command could not be executed:
  −
  Don't call execPostJobCommand() in affaErrorExit() if err==115
  −
  RPMCheck property was ignored
  −
  added Property chattyOnSuccess
  −
  modified jobconfig-sample.pl to preserve 'doneDaily','doneWeekly','doneMonthly','doneYearly' and 'chattyOnSuccess'
  −
  write error codes of affaErrorExit() to log
  −
* Thu May 24 2007 Michael Weinberger
  −
  Version 0.4.1
  −
  fixed bug in disk usage calculation
  −
* Mon May 21 2007 Michael Weinberger
  −
  Version 0.4.0
  −
  added option --rename-job
  −
  changed syntax of --send-keys (!)
  −
  added option --move-archive
  −
* Sun May 20 2007 Michael Weinberger
  −
  Version 0.3.3
  −
  rebuild cronjobs after rise/undorise
  −
  ignore job of own backup, when creating cronjobs (job appears after a rise run)
  −
* Sun May 20 2007 Michael Weinberger
  −
  Version 0.3.2
  −
  man: added sshPort propperty
  −
  chdir /tmp to avoid cwd warnings when the cwd disappears while running rise or undo rise
  −
  bugfix: undorise() did not found own backup archive. Was searching for a wrong name
  −
* Wed May 16 2007 Michael Weinberger
  −
  Version 0.3.1 minor bugfixes
  −
  checkCrossFS() did not work (used in --rise)
  −
  jobconfig-sample.pl: deleting record before setting props
  −
  Perl errors with --status before a job run
  −
* Thu May 10 2007 Michael Weinberger
  −
  Version 0.3.0
  −
  man page completed
  −
  mark archives with indices > keep setting with '*' in --list-acrchive output
  −
  Option --delete-job
  −
  Option --cleanup
  −
  added --job=JOB alternative to --send-keys
  −
* Wed May 09 2007 Michael Weinberger
  −
  Version 0.2.0
  −
  added --mailtest option
  −
* Tue May 08 2007 Michael Weinberger
  −
  Version 0.1.5
  −
  improved --status output
  −
  removed options --report and --send-report
  −
  added option --show-archives
  −
  added --csv for status and show-archives output in CSV format
  −
  added property 'sshPort'
  −
* Mon May 07 2007 Michael Weinberger
  −
  Version 0.1.4
  −
  don't install the remote watchdog, when remotehost is eq localhost
  −
  improved check for remoteHostName eq localhost using DNS
  −
  ssh -o PasswordAuthentication=no in checkConnection()
  −
  added --full-restore
  −
  missing check for HOSTNAME argument in --send-keys added
  −
  improved error check
  −
  prevent run of --rise of localhost from own backup
  −
* Mon Apr 30 2007 Michael Weinberger
  −
  Version 0.1.3
  −
  modified 'use constant* syntax in watchdog script for compatibility with perl 5.6 on SME6
  −
* Fri Apr 27 2007 Michael Weinberger
  −
  Version 0.1.2
  −
  Bugfix: Preserve of ethernet driver setting with --rise did not work.
  −
  Also preserve NIC bonding.
  −
* Mon Apr 23 2007 Michael Weinberger
  −
  Version 0.1.1
  −
  scheduledKeep must be>=2 for --link-dest
  −
  set scheduledKeep to 2 if <2
  −
  get lastrun date from affa-report rather than from report file
  −
  added auto mount function
  −
  added AutomountDevice and AutomountPoint to jobconfig-sample.pl
  −
* Wed Apr 18 2007 Michael Weinberger
  −
  Version 0.0.8
  −
  dont die if report db does not exist
  −
* Wed Apr 18 2007 Michael Weinberger
  −
  Version 0.0.7
  −
  run checkConnection() only for scheduled backups
  −
  added Size and Disk usage information to --status
  −
* Thu Apr 12 2007 Michael Weinberger
  −
  Version 0.0.5
  −
  fixed calculation of lastrun-now
  −
* Thu Apr 12 2007 Michael Weinberger
  −
  Version 0.0.4
  −
  added --send-status plus templates
  −
  fixed format error of times in affa --status
  −
  show 'failed', if lastrun is older 1 day in affa --status
  −
  fixed typo. default status=disabled (was disable)
  −
* Fri Apr 06 2007 Michael Weinberger
  −
  Version 0.0.3
  −
  watchdog reminder was not deleted on soure
  −
  wrong version mismatch list in  rpm compare
  −
* Thu Apr 05 2007 Michael Weinberger
  −
  added 'rsync--inplace' property
  −
* Mon Apr 02 2007 Michael Weinberger
  −
  initial release
  −
</pre>
  −
 
  −
==== Files ====
  −
<pre>
  −
/etc/e-smith/events/actions/affa-make-cronjobs
  −
/etc/e-smith/events/post-upgrade/S90affa-make-cronjobs
  −
/etc/e-smith/templates/etc/cron.d/affa-status/00run
  −
/etc/e-smith/templates/etc/cron.d/affa/00jobs
  −
/etc/logrotate.d/affa
  −
/etc/profile.d/affa.sh
  −
/sbin/e-smith/affa
  −
/sbin/e-smith/affa-rpmlist.sh
  −
/usr/lib/affa/COPYING
  −
/usr/lib/affa/jobconfig-cygwin-sample.pl
  −
/usr/lib/affa/jobconfig-sample.pl
  −
/usr/lib/affa/postJobCommand-sample.pl
  −
/usr/lib/affa/preJobCommand-sample.pl
  −
/usr/lib/affa/watchdog-mailtest.template
  −
/usr/lib/affa/watchdog.template
  −
/usr/man/man1/affa.1.gz
  −
</pre>
  −
 
  −
==== References ====
  −
* Wikipedia article http://en.wikipedia.org/wiki/Rsync
  −
* Rsync homepage http://rsync.samba.org/
  −
* Wiki article [[Moving SME to new Hardware]]
  −
* Wiki article [[Backup with Affa and FreeDup]]
  −
* Wiki article [[Rsyncd setup on a windows computer for use with Affa backup]]
  −
* Wiki article [[Backup Windows Computers Using Affa]]
  −
 
      
==== Acronym ====
 
==== Acronym ====

Navigation menu