1,574
edits
Changes
Jump to navigation
Jump to search
Line 3:
Line 3: − + Line 12:
Line 12: − + Line 30:
Line 30: − + + + − + Line 40:
Line 42: − + + + − + Line 104:
Line 108: + + Line 174:
Line 180: + + + + + + Line 187:
Line 199: − '''+ − + Line 242:
Line 254: + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
→Configuring for pull
To view the status of contribs.org mirrors, look at http://mirror.contribs.org/mirrors.
To view the status of contribs.org mirrors, look at http://mirror.contribs.org/mirrors.
===Accessing the contribs.org mirros===
===Accessing the contribs.org mirrors===
To access the contribs.org download mirrors, always use the URL http://mirror.contribs.org. The current releases can be found at http://mirror.contribs.org/smeserver/releases/, the contribs section can be found at: http://mirror.contribs.org/smeserver/contribs/
To access the contribs.org download mirrors, always use the URL http://mirror.contribs.org. The current releases can be found at http://mirror.contribs.org/smeserver/releases/, the contribs section can be found at: http://mirror.contribs.org/smeserver/contribs/
{{Tip box|If you use the mirrors.contribs.org URL you will automatically be redirected to a mirror that is current within the last 8 hours.}}
{{Tip box|If you use the mirrors.contribs.org URL you will automatically be redirected to a mirror that is current within the last 8 hours.}}
The obsolete directory accounts for 16Gb, and the testing directory which include the next version SME8 is 7Gb big.
The obsolete directory accounts for 16Gb, and the testing directory which include the next version SME8 is 7Gb big.
If you are short in space you can easily save 16Gb with --exclude=obsolete/ in the EXCLUDE="" tag in etc/ftpsync.conf like this:
If you are short in space you can easily save 16Gb with --exclude=obsolete/ in the EXCLUDE="" tag in etc/ftpsync-smeserver.conf like this:
EXCLUDE="--exclude=obsolete/"
EXCLUDE="--exclude=obsolete/"
====Preparing your system====
====Preparing your system====
<ol><li>Create a storage location for mirror<br/>
<ol><li>Create a storage location for mirror<br />
<pre>mkdir -p {/path/to/your/data/store/}</pre>
<pre>mkdir -p {/path/to/your/data/store/}</pre>
</li><li>Create a new user to perform sync. If you are running SME Server you can create the user through the server-manager panel.
</li><li>Create a new user to perform sync. If you are running SME Server you can create the user through the server-manager panel.
</li><li>Go to the new user's directory. On SME server this will be: <tt>/home/e-smith/files/users/{user}/</tt>
cd {/path/to/user/dir/}
</li><li>Now it is time to download the ftpsync script and all files it requires:
</li><li>Now it is time to download the ftpsync script and all files it requires:
wget http://contribs.org/ftpsync.tgz
wget http://wiki.contribs.org/files/ftpsync.tgz
</li><li>Extract the tarball in users directory
</li><li>Extract the tarball in users directory
tar zxof ftpsync.tgz
tar zxof ftpsync.tgz
chown -R {user} bin etc log locks .ssh {/path/to/your/data/store/}
chown -R {user} bin etc log locks .ssh {/path/to/your/data/store/}
</li><li>Now we have installed and set things up as is required but we will need to update the configuration file to point to the storage location of the data (TO) in the config file (etc/ftpsync-smeserver.conf). Use your favorite text editor for it.</li>
</li><li>Now we have installed and set things up as is required but we will need to update the configuration file to point to the storage location of the data (TO) in the config file (etc/ftpsync-smeserver.conf). Use your favorite text editor for it.</li>
<li>'''Only''' when you are setting your server up as a [[#Configuring for pull|pull-mirror]], set the ''RSYNC_HOST'' value in the config file (etc/ftpsync-smeserver.conf) to:<pre>RSYNC_HOST=smeserver.bhs.mirrors.ovh.net</pre>This because of the recent unreliability of ibiblio.org (see: [[bugzilla:7360]]).</li></ol>
TO="/path/to/your/data/store/"
<li>'''Only''' when you are setting your server up as a [[#Configuring for pull|pull-mirror]], set the ''RSYNC_HOST'' value in the config file (etc/ftpsync-smeserver.conf) to (this is the default setting - disable for push) :<pre>RSYNC_HOST=mirror.canada.pialasse.com</pre>This because of the recent unreliability of ibiblio.org (see: [[bugzilla:7360]]).</li></ol>
====Testing your setup====
====Testing your setup====
<ol><li>Now it is time to perform the initial sync (and test that script does what it needs to)
<ol><li>Now it is time to perform the initial sync (and test that script does what it needs to)
{{Note box| This may take a long time depending on the speed of your connection}}
<pre>su - {user} -s /bin/bash
<pre>su - {user} -s /bin/bash
~/bin/ftpsync sync:archive:smeserver</pre>
~/bin/ftpsync sync:archive:smeserver</pre>
</li><li>Now check heck the logs to see if there are any errors. Since the initial sync will take a lot of time you can best do this in a second terminal window:
</li><li>Now check the logs to see if there are any errors. Since the initial sync will take a lot of time you can best do this in a second terminal window:
cd ~/log
cd ~/log
cat rsync-ftpsync-smeserver.error.0
cat rsync-ftpsync-smeserver.error.0
=====Configuring for pull=====
=====Configuring for pull=====
{{Note box|We prefer you configure your mirror to be setup as a push mirror, but if you can not do so or have other reasons for not doing so you can also configure your mirror to pull.}}
{{Note box|We prefer you configure your mirror to be setup as a push mirror, but if you can not do so or have other reasons for not doing so you can also configure your mirror to pull.}}
{{Note box| See Bug list at bottom of page re error on ftpsync pull request when using this version of ftpsync, see Bugzilla 11754}}
Configuring for a pull based mirror is easy. Just schedule a cron job to run every 2 hours that does the exact same sync command you do to get the mirror in the first place, you can add a comment like in the example below:
Configuring for a pull based mirror is easy. Just schedule a cron job to run every 2 hours that does the exact same sync command you do to get the mirror in the first place, you can add a comment like in the example below:
echo "rsync: ALL" > /etc/e-smith/templates-custom/etc/hosts.allow/rsync
echo "rsync: ALL" > /etc/e-smith/templates-custom/etc/hosts.allow/rsync
signal-event remoteaccess-update
signal-event remoteaccess-update
you can browse your server like this
rsync --list-only rsync://YourIP
you can download from your server like this
rsync -avz YourIP::smeserver YourLocalFolder
==== create a rsa file ====
==== create a rsa file ====
finally protect your keys
finally protect your keys
chmod 0600 ~/.ssh/contribs-push\@{MY MIRROR}.rs*
chmod 0600 ~/.ssh/contribs-push\@{MY MIRROR}.rs*
never give your private key, only send your public (.pub) to the downstream mirror.'''
never give your private key, only send your public (.pub) to the downstream mirror.
==== setting up ftpsync-smeserver.conf====
==== setting up ftpsync-smeserver.conf====
tada! you are done!
tada! you are done!
=== Current SME Server contribs.org Mirror Tree ===
{| class="wikitable"
|+
| rowspan="11" |koozali.org mirrors
| rowspan="11" |mirror.canada.pialasse.com
Rsync, Push
|smeserver.bhs.mirrors.ovh.net
Rsync / 1GPs /pull %36h
|
|-
|distro.ibiblio.org
Rsync, Push
|ftp.iinet.net.au
mirror.internode.on.net
ftp.icm.edu.pl
|-
|mirror.pialasse.com
Push
|
|-
|sme-mirror.tw.co.nz
Pull
|
|-
|sme-mirror.firewall-services.com
Pull
|
|-
|ibsgaarden.dk
Push
|
|-
|mirrors.rbx.opencare.nl
Push
|
|-
|ftp.nluug.nl / ftp.vim.org
Pull
|
|-
|ftp.icm.edu.pl
Pull
|
|-
|mirrors.mab974.re
Pull
|
|-
|www.mirrorservice.org
Rsync, Pull
|
|}
====RSYNC access====
# ibiblio : rsync://distro.ibiblio.org/smeserver/releases/ ( rsync -avv --stats distro.ibiblio.org::smeserver/releases . )
# mirror.canada.pialasse.com: rsync -avv mirror.canada.pialasse.com::smeserver/releases .
# mirrorservice.org : rsync[http://rsync.mirrorservice.org/sites/mirror.contribs.org/smeserver/releases/ //rsync.mirrorservice.org/sites/mirror.contribs.org/smeserver/releases/] (rsync -avv --stats rsync.mirrorservice.org::mirror.contribs.org/smeserver/releases/ . )
====FTP access====
# ftp://distro.ibiblio.org/smeserver/releases/
=== Bugs ===
Please raise bugs under the SME-Contribs section in [http://bugs.contribs.org/enter_bug.cgi bugzilla]
and select the Mirrors component or use {{BugzillaFileBug|product=SME%20Contribs|component=Mirrors|title=this link}}
{{#bugzilla:columns=id,product,version,status,summary |sort=id |order=desc |component=Mirrors |noresultsmessage="No open bugs found."}}
[[Category:Howto]]
[[Category:Development Tools]]