Changes

Jump to navigation Jump to search
1,222 bytes added ,  04:22, 2 November 2023
Line 30: Line 30:     
====Preparing your system====
 
====Preparing your system====
<ol><li>Create a storage location for mirror<br/>
+
<ol><li>Create a storage location for mirror<br />
 
<pre>mkdir -p {/path/to/your/data/store/}</pre>
 
<pre>mkdir -p {/path/to/your/data/store/}</pre>
 
</li><li>Create a new user to perform sync. If you are running SME Server you can create the user through the server-manager panel.
 
</li><li>Create a new user to perform sync. If you are running SME Server you can create the user through the server-manager panel.
Line 36: Line 36:  
  cd {/path/to/user/dir/}
 
  cd {/path/to/user/dir/}
 
</li><li>Now it is time to download the ftpsync script and all files it requires:
 
</li><li>Now it is time to download the ftpsync script and all files it requires:
  wget http://contribs.org/ftpsync.tgz
+
  wget http://wiki.contribs.org/files/ftpsync.tgz
 
</li><li>Extract the tarball in users directory
 
</li><li>Extract the tarball in users directory
 
  tar zxof ftpsync.tgz
 
  tar zxof ftpsync.tgz
Line 43: Line 43:  
</li><li>Now we have installed and set things up as is required but we will need to update the configuration file to point to the storage location of the data (TO) in the config file (etc/ftpsync-smeserver.conf). Use your favorite text editor for it.</li>
 
</li><li>Now we have installed and set things up as is required but we will need to update the configuration file to point to the storage location of the data (TO) in the config file (etc/ftpsync-smeserver.conf). Use your favorite text editor for it.</li>
 
  TO="/path/to/your/data/store/"
 
  TO="/path/to/your/data/store/"
<li>'''Only''' when you are setting your server up as a [[#Configuring for pull|pull-mirror]], set the ''RSYNC_HOST'' value in the config file (etc/ftpsync-smeserver.conf) to:<pre>RSYNC_HOST=smeserver.bhs.mirrors.ovh.net</pre>This because of the recent unreliability of ibiblio.org (see: [[bugzilla:7360]]).</li></ol>
+
<li>'''Only''' when you are setting your server up as a [[#Configuring for pull|pull-mirror]], set the ''RSYNC_HOST'' value in the config file (etc/ftpsync-smeserver.conf) to (this is the default setting - disable for push) :<pre>RSYNC_HOST=mirror.canada.pialasse.com</pre>This because of the recent unreliability of ibiblio.org (see: [[bugzilla:7360]]).</li></ol>
    
====Testing your setup====
 
====Testing your setup====
 
<ol><li>Now it is time to perform the initial sync (and test that script does what it needs to)
 
<ol><li>Now it is time to perform the initial sync (and test that script does what it needs to)
 +
{{Note box| This may take a long time depending on the speed of your connection}}
 
<pre>su - {user} -s /bin/bash
 
<pre>su - {user} -s /bin/bash
 
~/bin/ftpsync sync:archive:smeserver</pre>
 
~/bin/ftpsync sync:archive:smeserver</pre>
</li><li>Now check heck the logs to see if there are any errors. Since the initial sync will take a lot of time you can best do this in a second terminal window:
+
</li><li>Now check the logs to see if there are any errors. Since the initial sync will take a lot of time you can best do this in a second terminal window:
 
  cd ~/log
 
  cd ~/log
 
  cat rsync-ftpsync-smeserver.error.0
 
  cat rsync-ftpsync-smeserver.error.0
Line 107: Line 108:  
=====Configuring for pull=====
 
=====Configuring for pull=====
 
{{Note box|We prefer you configure your mirror to be setup as a push mirror, but if you can not do so or have other reasons for not doing so you can also configure your mirror to pull.}}
 
{{Note box|We prefer you configure your mirror to be setup as a push mirror, but if you can not do so or have other reasons for not doing so you can also configure your mirror to pull.}}
 +
{{Note box| See Bug list at bottom of page re error on ftpsync pull request when using this version of ftpsync, see Bugzilla 11754}}
 +
 
Configuring for a pull based mirror is easy. Just schedule a cron job to run every 2 hours that does the exact same sync command you do to get the mirror in the first place, you can add a comment like in the example below:
 
Configuring for a pull based mirror is easy. Just schedule a cron job to run every 2 hours that does the exact same sync command you do to get the mirror in the first place, you can add a comment like in the example below:
   Line 177: Line 180:  
  echo "rsync: ALL" > /etc/e-smith/templates-custom/etc/hosts.allow/rsync
 
  echo "rsync: ALL" > /etc/e-smith/templates-custom/etc/hosts.allow/rsync
 
  signal-event remoteaccess-update
 
  signal-event remoteaccess-update
 +
 +
you can browse your server like this
 +
rsync --list-only rsync://YourIP
 +
 +
you can download from your server like this
 +
rsync -avz  YourIP::smeserver YourLocalFolder
    
==== create a rsa file ====
 
==== create a rsa file ====
Line 190: Line 199:  
finally protect your keys
 
finally protect your keys
 
  chmod 0600 ~/.ssh/contribs-push\@{MY MIRROR}.rs*
 
  chmod 0600 ~/.ssh/contribs-push\@{MY MIRROR}.rs*
'''
+
 
never give your private key, only send your  public (.pub) to the downstream mirror.'''
+
never give your private key, only send your  public (.pub) to the downstream mirror.
    
==== setting up ftpsync-smeserver.conf====
 
==== setting up ftpsync-smeserver.conf====
Line 247: Line 256:     
=== Current SME Server contribs.org Mirror Tree ===
 
=== Current SME Server contribs.org Mirror Tree ===
[[Image:Smeserver_mirrors.png|Current Mirror Tree|600px| ]]
+
{| class="wikitable"
this is the current tree of Mirror for SME Server.
+
|+
 +
| rowspan="11" |koozali.org mirrors
 +
| rowspan="11" |mirror.canada.pialasse.com
 +
Rsync, Push
 +
|smeserver.bhs.mirrors.ovh.net
 +
Rsync / 1GPs /pull %36h
 +
|
 +
|-
 +
|distro.ibiblio.org
 +
Rsync, Push
 +
|ftp.iinet.net.au
 +
mirror.internode.on.net
 +
 
 +
ftp.icm.edu.pl
 +
|-
 +
|mirror.pialasse.com
 +
Push
 +
|
 +
|-
 +
|sme-mirror.tw.co.nz
 +
Pull
 +
|
 +
|-
 +
|sme-mirror.firewall-services.com
 +
Pull
 +
|
 +
|-
 +
|ibsgaarden.dk
 +
Push
 +
|
 +
|-
 +
|mirrors.rbx.opencare.nl
 +
Push
 +
|
 +
|-
 +
|ftp.nluug.nl / ftp.vim.org
 +
Pull
 +
|
 +
|-
 +
|ftp.icm.edu.pl
 +
 
 +
Pull
 +
|
 +
|-
 +
|mirrors.mab974.re
 +
Pull
 +
|
 +
|-
 +
|www.mirrorservice.org
 +
Rsync, Pull
 +
|
 +
|}
    
====RSYNC access====
 
====RSYNC access====
 
# ibiblio : rsync://distro.ibiblio.org/smeserver/releases/ ( rsync -avv --stats distro.ibiblio.org::smeserver/releases . )
 
# ibiblio : rsync://distro.ibiblio.org/smeserver/releases/ ( rsync -avv --stats distro.ibiblio.org::smeserver/releases . )
# bhs ovh : rsync://smeserver.bhs.mirrors.ovh.net/smeserver/releases/ (rsync -avv --stats smeserver.bhs.mirrors.ovh.net::smeserver/releases .)
+
# mirror.canada.pialasse.com:  rsync -avv mirror.canada.pialasse.com::smeserver/releases .
# mirrorservice.org : rsync://http://rsync.mirrorservice.org/sites/mirror.contribs.org/smeserver/releases/ (rsync -avv --stats rsync.mirrorservice.org::mirror.contribs.org/smeserver/releases/ . )
+
# mirrorservice.org : rsync[http://rsync.mirrorservice.org/sites/mirror.contribs.org/smeserver/releases/ //rsync.mirrorservice.org/sites/mirror.contribs.org/smeserver/releases/] (rsync -avv --stats rsync.mirrorservice.org::mirror.contribs.org/smeserver/releases/ . )
    
====FTP access====
 
====FTP access====
# ftp://smeserver.bhs.mirrors.ovh.net/smeserver/releases/
   
# ftp://distro.ibiblio.org/smeserver/releases/
 
# ftp://distro.ibiblio.org/smeserver/releases/
 +
 +
=== Bugs ===
 +
Please raise bugs under the SME-Contribs section in [http://bugs.contribs.org/enter_bug.cgi bugzilla]
 +
and select the Mirrors component or use {{BugzillaFileBug|product=SME%20Contribs|component=Mirrors|title=this link}}
 +
{{#bugzilla:columns=id,product,version,status,summary |sort=id |order=desc |component=Mirrors |noresultsmessage="No open bugs found."}}
 +
    
[[Category:Howto]]
 
[[Category:Howto]]
 
[[Category:Development Tools]]
 
[[Category:Development Tools]]

Navigation menu