Talk:Mirrors

From SME Server
Revision as of 17:15, 7 July 2011 by Slords (talk | contribs) (Created page with "==New Push Mirror== We are implementing a new push style of mirrors. ---- ====In order to participate you will need the following:==== * Static IP address * Dedicated user for sy...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigationJump to search

New Push Mirror

We are implementing a new push style of mirrors.


In order to participate you will need the following:

  • Static IP address
  • Dedicated user for syncing
  • Allow SSH from internet to static IP (port doesn't matter)

Advantages to push mirror:

  • Sync only happens when there are changes
  • Changes are propagated as close to real-time as possible
  • Changes can be staged (sync data first, repodata second)
  • Less out of sync mirrors for yum

How push works:

  1. Master mirror updates timestamp file
  2. Master initiates ssh into tier 1 mirrors to start stage 1 sync (wait)
  3. Tier 1 mirrors rsync everything but repodata from designated targets (no delete)
  4. Tier 1 mirrors initiate ssh into tier 2 mirrors to start stage 1 sync (wait)
  5. Repeat prior to steps for each tier under 2
  6. Master initiates ssh into tier 1 mirrors to start stage 2 sync
  7. Tier 1 mirrors rsync everything from designated targets (with delete)
  8. Tier 1 mirrors initiate ssh into tier 2 mirrors to start state 2 sync
  9. Repeat prior to steps for each tier under 2
  10. Master mirror checks freshness of mirrors and generates mirrorlists

Steps to configure push sync:

  1. create location for mirror
  2. create new user to perform sync
  3. download ftpsync script
  4. extract tarball in users directory
    • tar zxvf ftpsync.tgz
  5. append the keys to authorized_keys file
    • cat .ssh/pushmirror-*.pub >> .ssh/authorized_keys
  6. change ownership of directories to new user
    • chown -R {newuser} bin etc log .ssh {path to mirror}
  7. update location (TO) in config file (etc/ftpsync.conf)
  8. perform initial sync (and test that script does what it needs to)
    • su - {newuser} -s /bin/bash
      ~/bin/ftpsync
  9. check logs to see if there were any errors
    • cd ~/log
      cat rsync-ftpsync.error.0
  10. open bug requesting to be added to the mirror infrastructure
Please include the following in the bug report:
* name of site
* primary contact name/email
* location/country
* bandwidth available to mirror
* URL to site (for freshness checks and yum)
* hostname to connect to (for ssh)
* port to connect to (for ssh)
* username to connect with (for ssh)

The scripts should keep the 14 most recent sync attempts and will email (root by default) if there are any errors that occur during the sync attempt.