Difference between revisions of "Talk:Build an Official ISO"

From SME Server
Jump to navigationJump to search
m (add note re checksums)
 
(11 intermediate revisions by 2 users not shown)
Line 1: Line 1:
* Note: Maybe obvious, generate checksums for final ISO's
+
* Note: Maybe obvious, generate checksums for final ISO's : --[[User:Stephdl|Stephdl]] ([[User talk:Stephdl|talk]]) 13:29, 3 January 2015 (CET)
 +
 
 +
it seems that anaconda does the job and create the checksum and the sha1 automatically
 +
 
 +
==> in fact this is handled by the build_iso script [[User:Unnilennium|Unnilennium]] ([[User talk:Unnilennium|talk]]) 16:23, 17 July 2016 (CEST)
  
 
* Each installer and ISO needs to built on the corresponding version (cos5 for sme8 and cos6 for sme9).
 
* Each installer and ISO needs to built on the corresponding version (cos5 for sme8 and cos6 for sme9).
Line 77: Line 81:
  
 
I forget the solution to the beta-nag. Either I modified the build script on the buildsys. Or I modified anaconda on the buildsys.
 
I forget the solution to the beta-nag. Either I modified the build script on the buildsys. Or I modified anaconda on the buildsys.
 +
 +
== SME10 preparation and build_installer ==
 +
 +
===first for reference ===
 +
* original Red hat doc forc customisation
 +
** https://access.redhat.com/documentation/en/red-hat-enterprise-linux/7/anaconda-customization-guide/anaconda-customization-guide
 +
** https://access.redhat.com/documentation/en/red-hat-enterprise-linux/7/anaconda-customization-guide/4-branding-and-chroming-the-graphical-user-interface
 +
** https://access.redhat.com/documentation/en/red-hat-enterprise-linux/version-7.1/red-hat-enterprise-linux-71-anaconda-customization-guide/
 +
 +
* how to customize centos 7
 +
 +
** http://serverfault.com/questions/517908/how-to-create-a-custom-iso-image-in-centos
 +
** https://github.com/joyent/mi-centos-7
 +
**
 +
 +
* fedora doc
 +
** https://fedoraproject.org/wiki/Anaconda/Changes
 +
** https://fedoraproject.org/wiki/LiveOS_image
 +
 +
*using squashfs
 +
** http://www.tldp.org/HOWTO/html_single/SquashFS-HOWTO/#mksqusing
 +
** https://blog.sleeplessbeastie.eu/2012/05/27/how-to-modify-squashfs-image/
 +
** http://voidmain.is-a-geek.net/redhat/fedora_10_live_cd_hacking.html <= really helpfull
 +
 +
 +
*kickstart
 +
**http://serverfault.com/questions/517908/how-to-create-a-custom-iso-image-in-centos
 +
 +
*rootfs
 +
**http://www.wiki.xilinx.com/Build+and+Modify+a+Rootfs
 +
 +
===Foreword===
 +
Red Hat suggest to create a product.img (https://access.redhat.com/documentation/en/red-hat-enterprise-linux/7/anaconda-customization-guide/2-working-with-iso-images#sect-product-img) and to put it in the folder images at the root of the CD, however, Centos did not use this way, but rather edited directly the anaconda image inside the live image.
 +
 +
Also, we might want to patch Anaconda at least to handle the degraded raid 1
 +
 +
Hence I feel we will have to do the same to hide all Centos branding.[[User:Unnilennium|Unnilennium]] ([[User talk:Unnilennium|talk]]) 17:20, 17 July 2016 (CEST)
 +
 +
=== THE KEY===
 +
 +
- the holly Grail is the .buildstamp file
 +
$ cat product/.buildstamp
 +
 +
[Main]
 +
Product=Koozali SME Server
 +
Version=10alpha2
 +
BugURL=https://bugs.koozali.org
 +
IsFinal=False
 +
UUID=alpha2.x86_64
 +
[Compose]
 +
Lorax=19.6.66-1
 +
 +
 +
=== how to create a good product.img for SME 10 alpha 2  (WIP)===
 +
mkdir product
 +
cd product
 +
 +
create the followings directories
 +
mkdir -p ./run/install/product/pyanaconda/installclasses
 +
mkdir -p ./usr/lib64/python2.7/site-packages/pyanaconda/installclasses
 +
mkdir -p ./usr/share/anaconda
 +
mkdir -p ./usr/share/anaconda/pixmaps/rnotes/en
 +
mkdir -p ./usr/share/xml/scap/ssg/content
 +
mkdir -p ./usr/share/anaconda/help/en-US/CentOSPlaceholder.html
 +
mkdir ./etc
 +
 +
add following files and edit (I think only one of them would be useful):
 +
./run/install/product/pyanaconda/installclasses/custom.py
 +
./run/install/product/pyanaconda/installclasses/koozali.py
 +
 +
make a copy of the following from the original rootfs and edit in case to hide the centos one :
 +
./usr/lib64/python2.7/site-packages/pyanaconda/installclasses/centos.py
 +
 +
we can put one  here too  (I think only one of them would be useful):
 +
./usr/lib64/python2.7/site-packages/pyanaconda/installclasses/koozali.py
 +
 +
make a copy and edit the following from the original rootfs:
 +
./usr/share/anaconda/anaconda-gtk.css
 +
 +
put your own image there with he right format, and the following name to hide the original centos files (you can also add more)
 +
./usr/share/anaconda/pixmaps/rnotes/en/centos-artwork.png
 +
./usr/share/anaconda/pixmaps/rnotes/en/centos-cloud.png
 +
./usr/share/anaconda/pixmaps/rnotes/en/centos-core.png
 +
./usr/share/anaconda/pixmaps/rnotes/en/centos-jp.png
 +
./usr/share/anaconda/pixmaps/rnotes/en/centos-promotion.png
 +
./usr/share/anaconda/pixmaps/rnotes/en/centos-virtualization.png
 +
./usr/share/anaconda/pixmaps/sidebar-bg.png
 +
./usr/share/anaconda/pixmaps/sidebar-logo.png
 +
./usr/share/anaconda/pixmaps/topbar-bg.png
 +
 +
 +
there are a lot of centos reference there, maybe we want to do something with it:
 +
./usr/share/xml/scap/ssg/content/ssg-centos6-ds.xml
 +
./usr/share/xml/scap/ssg/content/ssg-centos7-ds.xml
 +
./usr/share/xml/scap/ssg/content/ssg-centos7-xccdf.xml
 +
./usr/share/xml/scap/ssg/content/ssg-firefox-ds.xml
 +
./usr/share/xml/scap/ssg/content/ssg-jre-ds.xml
 +
./usr/share/xml/scap/ssg/content/ssg-rhel7-cpe-dictionary.xml
 +
./usr/share/xml/scap/ssg/content/ssg-rhel7-cpe-oval.xml
 +
./usr/share/xml/scap/ssg/content/ssg-rhel7-oval.xml
 +
 +
and the branding of the os installer:
 +
./etc/centos-release
 +
./etc/os-release
 +
./etc/redhat-release
 +
./etc/e-smith-release
 +
./etc/system-release-cpe
 +
 +
edit the buildstamp accordingly
 +
./.buildstamp
 +
 +
do the following:
 +
find . | cpio -c -o | gzip -9cv > ../product.img; cd ..
 +
cp product.img /build/smeserver/stage/10/x86_64/images/
 +
 +
 +
TO DO :
 +
*translation files ?
 +
*CentOSPlaceholder.html
 +
*help files
 +
*/usr/share/centos-release/EULA
 +
 +
=== alternative how to edit content of squashfs for SME 10 alpha 2  (WIP)===
 +
 +
f we want a little more liberty in term of remove centos 7 branding in the installer (eg, remove pictures to use the name we want for ours instead of hiding centos ones):
 +
 +
* first extract the content of Live image, and the image of Anaconda inside
 +
cd /build/smeserver/stage/10.0.alpha1/x86_64/LiveOS/
 +
mkdir /mnt/squashfs
 +
sudo mount -o loop squashfs.img /mnt/squashfs
 +
mkdir -p  /tmp/rootfs/LiveOS
 +
cp -a /mnt/squashfs/LiveOS/rootfs.img /tmp/rootfs/LiveOS/
 +
mkdir /mnt/rootfs
 +
sudo umount /mnt/squashfs
 +
sudo mount -o loop /tmp/rootfs/LiveOS/rootfs.img /mnt/rootfs
 +
 +
 +
*then we have to modify what we want like usual
 +
 +
WORK IN PROGRESS:
 +
NB: cp and rm inside the fs will need to be done with sudo :(
 +
 +
# usr/share/anaconda/pixmaps/ content (logo, side bar, top bar, etc.)
 +
# usr/share/anaconda/pixmaps/rnotes/en/ content  (Banners for the installation progress screen)
 +
# usr/share/anaconda/anaconda-gtk.css (gui stylesheet)
 +
# run/install/product/pyanaconda/installclasses/custom.py (for changing the product name as told by red hat)
 +
# usr/lib64/python2.7/site-packages/pyanaconda/installclasses/centos.py ( to effectively change the product name!! )
 +
 +
we can also remove centos pictures in rnotes this way.
 +
 +
 +
* finally rebuild images
 +
sudo umount /mnt/rootfs
 +
rm /build/smeserver/stage/10.0.alpha1/x86_64/LiveOS/squashfs.img
 +
cd /build/smeserver/stage/10.0.alpha1/x86_64/LiveOS/
 +
mksquashfs /tmp/rootfs  squashfs.img
 +
 +
=== patch anaconda and rebuild the whole installer  for SME 10 alpha 3 or next  (WIP)===
 +
 +
TO DO

Latest revision as of 20:59, 1 June 2017

  • Note: Maybe obvious, generate checksums for final ISO's : --Stephdl (talk) 13:29, 3 January 2015 (CET)

it seems that anaconda does the job and create the checksum and the sha1 automatically

==> in fact this is handled by the build_iso script Unnilennium (talk) 16:23, 17 July 2016 (CEST)

  • Each installer and ISO needs to built on the corresponding version (cos5 for sme8 and cos6 for sme9).
This can be misleading. The build box can be the same, eg COS6 x64 for all ISOs, it is only the mock image that needs to match the ISO, and this is magically handled by the mock configs

For clarification read http://bugs.contribs.org/show_bug.cgi?id=7675#c37

'The corresponding version' refers to either a cos5 install or a cos5 mock env. Building packages does require the same 'corresponding version' You can't easily build sme8 packages on a cos6 box. But with mock you can because you can create a small chroot of cos5 to build the packages. We use the same trick to build the ISO. The ISO mock creates a minimal cos5 with the correct packages to build the ISO.


  • Note I needed to edit mock cfg file to include /build in the chroot due to my local setup.
These are the changes that I made as I do not have the nfs mounts on my local machine. I replaced
config_opts['plugin_conf']['mount_opts']['dirs'].append(('storage:/export/build', '/build', 'nfs', 'defaults,noatime,nodiratime,nosuid'))
config_opts['plugin_conf']['mount_opts']['dirs'].append(('storage:/mirrors', '/mirrors', 'nfs', 'defaults,noatime,nodiratime,nosuid'))
with
config_opts['plugin_conf']['bind_mount_opts']['dirs'].append(('/build', '/build' ))


Also note http://bugs.contribs.org/show_bug.cgi?id=7675#c61

  • There is also an update to /usr/lib/python2.6/site-packages/mockbuild/mounts.py that needs to happen so loop devices get mounted correctly. Check /var/lib/mock/smeserver-VERSION-ARCH/result/root.log after mock -r smeserver-VERSION-ARCH-iso --init (eg mock -r smeserver-8-i386-iso --init). The mounting of the /dev/loopX should pass (return code 0). If it fails (return code 32) then the patch below is needed on your build host.


@@ -83,6 +83,9 @@
    decorate(traceLog())
    def mount(self):
+        if not os.path.isdir(self.srcpath) and not os.path.isfile(self.srcpath):
+            mockbuild.util.touch(self.bindpath)
+
        if not self.mounted:
            cmd = ['/bin/mount', '-n',
                   '--bind', self.srcpath, self.bindpath ]


  • For SME Server 8 check that anaconda-runtime was installed in the mock instance. For SME 8 the anaconda-runtime needs to be installed, check /usr/lib/anaconda-runtime/mk-images* exists in the mock instance after the mock --init. (check /var/lib/mock/smeserver-8-i386/root/usr/lib/anaconda-runtime)

If it does not then run the following, assuming i386 ARCH.

mock -r smeserver-8-i386-iso --cwd /build/smeserver/stage/8 --chroot /usr/bin/yum install anaconda-runtime

If you have error for lack of privileges, noticed for sme9 --Stephdl (talk) 15:29, 31 December 2014 (CET)

 mock -r smeserver-8-i386-iso --cwd /build/smeserver/stage/8 --chroot '/usr/bin/sudo /usr/bin/yum install anaconda-runtime'

You can find logs of the related scripts build_ISO and build_installer

/build/smeserver/stage/8/build_ISO.i386

&

/build/smeserver/stage/8/build_installer.i386
  • for sme9 modify /build/smeserver/stage/bin/build_installer --Stephdl (talk) 13:53, 31 December 2014 (CET)

L100

       /build/smeserver/repo/testing/$distrel/smeextras/$distarch/ \

in

       /build/smeserver/repo/$distrel/smeextras/$distarch/ \
  • The beta Tag in the installer --Stephdl (talk) 15:24, 31 December 2014 (CET)

I noticed that the Iso gets a 'beta' tag with warnings during the install process. How remove the the beta tag, add --final in the build_installer

# add --final when we have final product
   PYTHONPATH=/usr/lib/anaconda/ sudo /usr/lib/anaconda-runtime/buildinstall \
       --product "$distname" \
       --version "${distvers/[^0-9.]*/}" \
       --release "$distname" \
       --brand "centos" \
       --final \
       --bugurl http://bugs.contribs.org/ \
       --output $(pwd)/$distarch/ \
       /build/smeserver/repo/$distrel/smeextras/$distarch/ \
       $(pwd)/$distarch/
   /bin/sed -i -e "s|packagedir =.*|packagedir = Packages|" $(pwd)/$distarch/.treeinfo


I forget the solution to the beta-nag. Either I modified the build script on the buildsys. Or I modified anaconda on the buildsys.

SME10 preparation and build_installer

first for reference

  • how to customize centos 7


Foreword

Red Hat suggest to create a product.img (https://access.redhat.com/documentation/en/red-hat-enterprise-linux/7/anaconda-customization-guide/2-working-with-iso-images#sect-product-img) and to put it in the folder images at the root of the CD, however, Centos did not use this way, but rather edited directly the anaconda image inside the live image.

Also, we might want to patch Anaconda at least to handle the degraded raid 1

Hence I feel we will have to do the same to hide all Centos branding.Unnilennium (talk) 17:20, 17 July 2016 (CEST)

THE KEY

- the holly Grail is the .buildstamp file

$ cat product/.buildstamp
[Main]
Product=Koozali SME Server
Version=10alpha2
BugURL=https://bugs.koozali.org
IsFinal=False
UUID=alpha2.x86_64
[Compose]
Lorax=19.6.66-1


how to create a good product.img for SME 10 alpha 2 (WIP)

mkdir product
cd product

create the followings directories

mkdir -p ./run/install/product/pyanaconda/installclasses
mkdir -p ./usr/lib64/python2.7/site-packages/pyanaconda/installclasses
mkdir -p ./usr/share/anaconda
mkdir -p ./usr/share/anaconda/pixmaps/rnotes/en
mkdir -p ./usr/share/xml/scap/ssg/content
mkdir -p ./usr/share/anaconda/help/en-US/CentOSPlaceholder.html
mkdir ./etc

add following files and edit (I think only one of them would be useful):

./run/install/product/pyanaconda/installclasses/custom.py
./run/install/product/pyanaconda/installclasses/koozali.py

make a copy of the following from the original rootfs and edit in case to hide the centos one :

./usr/lib64/python2.7/site-packages/pyanaconda/installclasses/centos.py

we can put one here too (I think only one of them would be useful):

./usr/lib64/python2.7/site-packages/pyanaconda/installclasses/koozali.py

make a copy and edit the following from the original rootfs:

./usr/share/anaconda/anaconda-gtk.css

put your own image there with he right format, and the following name to hide the original centos files (you can also add more)

./usr/share/anaconda/pixmaps/rnotes/en/centos-artwork.png
./usr/share/anaconda/pixmaps/rnotes/en/centos-cloud.png
./usr/share/anaconda/pixmaps/rnotes/en/centos-core.png
./usr/share/anaconda/pixmaps/rnotes/en/centos-jp.png
./usr/share/anaconda/pixmaps/rnotes/en/centos-promotion.png
./usr/share/anaconda/pixmaps/rnotes/en/centos-virtualization.png
./usr/share/anaconda/pixmaps/sidebar-bg.png
./usr/share/anaconda/pixmaps/sidebar-logo.png
./usr/share/anaconda/pixmaps/topbar-bg.png


there are a lot of centos reference there, maybe we want to do something with it:

./usr/share/xml/scap/ssg/content/ssg-centos6-ds.xml
./usr/share/xml/scap/ssg/content/ssg-centos7-ds.xml
./usr/share/xml/scap/ssg/content/ssg-centos7-xccdf.xml
./usr/share/xml/scap/ssg/content/ssg-firefox-ds.xml
./usr/share/xml/scap/ssg/content/ssg-jre-ds.xml
./usr/share/xml/scap/ssg/content/ssg-rhel7-cpe-dictionary.xml
./usr/share/xml/scap/ssg/content/ssg-rhel7-cpe-oval.xml
./usr/share/xml/scap/ssg/content/ssg-rhel7-oval.xml

and the branding of the os installer:

./etc/centos-release
./etc/os-release
./etc/redhat-release
./etc/e-smith-release
./etc/system-release-cpe

edit the buildstamp accordingly

./.buildstamp

do the following:

find . | cpio -c -o | gzip -9cv > ../product.img; cd ..
cp product.img /build/smeserver/stage/10/x86_64/images/

TO DO :

  • translation files ?
  • CentOSPlaceholder.html
  • help files
  • /usr/share/centos-release/EULA

alternative how to edit content of squashfs for SME 10 alpha 2 (WIP)

f we want a little more liberty in term of remove centos 7 branding in the installer (eg, remove pictures to use the name we want for ours instead of hiding centos ones):

  • first extract the content of Live image, and the image of Anaconda inside
cd /build/smeserver/stage/10.0.alpha1/x86_64/LiveOS/
mkdir /mnt/squashfs
sudo mount -o loop squashfs.img /mnt/squashfs
mkdir -p  /tmp/rootfs/LiveOS
cp -a /mnt/squashfs/LiveOS/rootfs.img /tmp/rootfs/LiveOS/
mkdir /mnt/rootfs
sudo umount /mnt/squashfs
sudo mount -o loop /tmp/rootfs/LiveOS/rootfs.img /mnt/rootfs


  • then we have to modify what we want like usual

WORK IN PROGRESS: NB: cp and rm inside the fs will need to be done with sudo :(

  1. usr/share/anaconda/pixmaps/ content (logo, side bar, top bar, etc.)
  2. usr/share/anaconda/pixmaps/rnotes/en/ content (Banners for the installation progress screen)
  3. usr/share/anaconda/anaconda-gtk.css (gui stylesheet)
  4. run/install/product/pyanaconda/installclasses/custom.py (for changing the product name as told by red hat)
  5. usr/lib64/python2.7/site-packages/pyanaconda/installclasses/centos.py ( to effectively change the product name!! )

we can also remove centos pictures in rnotes this way.


  • finally rebuild images
sudo umount /mnt/rootfs
rm /build/smeserver/stage/10.0.alpha1/x86_64/LiveOS/squashfs.img
cd /build/smeserver/stage/10.0.alpha1/x86_64/LiveOS/
mksquashfs /tmp/rootfs  squashfs.img

patch anaconda and rebuild the whole installer for SME 10 alpha 3 or next (WIP)

TO DO