Difference between revisions of "Koji Usage"

From SME Server
Jump to navigationJump to search
 
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
This howto is for using the Koozali.org Koji Build Farm (http://koji.koozali.org/koji).
 
This howto is for using the Koozali.org Koji Build Farm (http://koji.koozali.org/koji).
  
{{Note box|This is no longer the case (Aug 2024):Warning: The Koji farm is still in development and locked inside the koozali compound, so you will need to have VPN access until we open it up to the world.
+
{{Note box|Koji is now publicly available for read-only, but you are advised to get a login in order that you can fully utilise it.
  
Koji is now publically available, but you are advised to get a login in order that you can fully utilise it.}}
+
Developers should be following the guide at [[Howto interact with gitea and koji to do an rpm build for SME11]].
 +
 
 +
This wiki page is for interacting directly with koji.}}
  
 
Official Koji documentation can be found at: https://docs.pagure.org/koji/
 
Official Koji documentation can be found at: https://docs.pagure.org/koji/
Line 9: Line 11:
 
We are slowly migrating smeserver to newer build tools, which includes git for source management and koji for managing the builds.
 
We are slowly migrating smeserver to newer build tools, which includes git for source management and koji for managing the builds.
  
Here we will try to explain how to setup and use Koji within the development process.
+
Here we will try to explain how to setup and and interact directly with Koji.
 +
 
 +
Please read [[Howto interact with gitea and koji to do an rpm build for SME11|here]] for the normal development process.
  
Another document worth reading is [[Howto interact with gitea and koji to do an rpm build for SME11|here]].  This document is up to date as of Aug 2024.
+
This page is primarily focussed on understanding the koji backend and how to interact with it directly.  
  
 
== Web Interface ==
 
== Web Interface ==
Line 33: Line 37:
  
 
Install the koji client ('sudo dnf install koji' or equivalent on your flavour of linux)
 
Install the koji client ('sudo dnf install koji' or equivalent on your flavour of linux)
* on fedora do  
+
* on fedora do
 
   dnf install koji-tool -y
 
   dnf install koji-tool -y
 
* on centos 7 do
 
* on centos 7 do
Line 54: Line 58:
  
 
=== Build from git ===
 
=== Build from git ===
For now, this is the only way we can do a build from git on koji, but in the future this will be incorporated into the 'make build'. (Aug 2024) This has now been done. <syntaxhighlight lang="bash">
+
Building of rpms is usually done via a make build within your dev environment, but you can trigger a build via the koji client <syntaxhighlight lang="bash">
 
koji build sme11-test git+https://src.koozali.org/smeserver/<pkg>.git?#<tag>
 
koji build sme11-test git+https://src.koozali.org/smeserver/<pkg>.git?#<tag>
 
koji build sme11-contribs-test git+https://src.koozali.org/smecontribs/<pkg>.git?#<tag>
 
koji build sme11-contribs-test git+https://src.koozali.org/smecontribs/<pkg>.git?#<tag>
Line 60: Line 64:
  
 
* <pkg> = your package (e.g. smeserver-php)
 
* <pkg> = your package (e.g. smeserver-php)
* <tag> = version tag to be built (3_0-1)
+
* <tag> = git version tag to be built (3_0-1.el8.sme)
  
 
Example:<syntaxhighlight lang="bash">
 
Example:<syntaxhighlight lang="bash">
koji build sme11-test git+https://src.koozali.org/smeserver/smeserver-php.git?#3_0-1
+
koji build smeserver11 git+https://src.koozali.org/smeserver/smeserver-php.git?#3_0-1.el8.sme
 
</syntaxhighlight>
 
</syntaxhighlight>
  
Line 69: Line 73:
 
We have created build targets that align with the standard development practice of building into test, then migrating that build through the different environments
 
We have created build targets that align with the standard development practice of building into test, then migrating that build through the different environments
  
* smeserver/<pkg>-<tag> -> sme11-test (dist-sme11-os-testing) -> dist-sme11-updates-testing -> dist-sme11-updates
+
* smeserver/<pkg>-<tag> -> smeserver11 (smeserver11-test) -> smeserver11
* smecontribs/<pkg>-<tag> -> sme11-contribs-test (dist-sme11-contribs-testing) -> dist-sme11-contribs
+
* smecontribs/<pkg>-<tag> -> smecontribs11 (smecontribs11-testing) -> smecontribs11
{{Note box|There is a target of sme11-os that will build into dist-sme11-os, but this should ONLY be used for tthe initial load of the smeos repository}}
+
There is 1 build tag for each of smeserver and smecontribs to allow for the use of different external repos and settings.
There is ONLY 1 build tag for sme11 which is used by all targets (dist-sme11-build) as all sme11 builds use the same external repos and settings.
 
 
 
  
 
The repos align with the repos available to dnf in smeserver:
 
The repos align with the repos available to dnf in smeserver:
  
* smeos (dist-sme11-os)
+
* smeos (smeserver11)
* smetest (dist-sme11-os-test)
+
* smetest (smeserver11-test)
* smeupdates-test (dist-sme11-updates-testing)
+
* smecontribs (smecontribs11)
* smeupdates (dist-sme11-updates)
+
* smecontribs-test (smecontribs11-testing)
* smecontribs-test (dist-sme11-contribs-testing)
 
* smecontribs (dist-sme11-contribs)
 
*smeaddons (dist-sme11-addons)
 
  
 
==Advanced commands ==
 
==Advanced commands ==
to add a rpm to the base rpm to install in a mock environment :
+
If adding a new package, it needs to be added to the parent tag for that Stream/Release:<syntaxhighlight lang="bash">
 +
koji add-pkg --owner kojiadmin smecontribs11 smeserver-my-new-contrib
 +
</syntaxhighlight>to add a rpm to the build group to install in a mock environment :
 
   
 
   
 
  koji add-group-pkg dist-sme11-build build perl-Module-Install
 
  koji add-group-pkg dist-sme11-build build perl-Module-Install
Line 99: Line 100:
 
   koji add-pkg  --owner jpp dist-sme12-os smeserver-manager-jsquery  
 
   koji add-pkg  --owner jpp dist-sme12-os smeserver-manager-jsquery  
  
to tag and existing build against a new tag (e.g. copy from testing to updates-testing-)
+
to tag and existing build against a new tag (e.g. copy from testing to os)
     koji tag-build dist-sme11-updates-testing smeserver-updaye-11.0.0-7.el8.sme
+
     koji tag-build dist-sme11-os smeserver-update-11.0.0-7.el8.sme
  
to populate an external repo for use by dnf
+
to manually populate an external repo for use by dnf (external repos should be automatically generated when a new build is attached to that tag)
     koji dist-repo dist-sme11-testing --allow-missing-signatures
+
     koji dist-repo dist-sme11-testing <gpg key>
    koji dist-repo dist-sme11-updates-testing --allow-missing-signatures
+
     koji dist-repo dist-sme11-os <gpg key>
     koji dist-repo dist-sme11-os --allow-missing-signatures
+
     koji dist-repo smecontribs11-testing <gpg key>
     koji dist-repo dist-sme11-contribs-testing --allow-missing-signatures
+
     koji dist-repo smecontribs11 <gpg key>
     koji dist-repo dist-sme11-contribs --allow-missing-signatures
+
 
+
 
[[Category:Developer]]
+
[[Category:Developer]]

Latest revision as of 01:24, 1 October 2024

This howto is for using the Koozali.org Koji Build Farm (http://koji.koozali.org/koji).


Important.png Note:
Koji is now publicly available for read-only, but you are advised to get a login in order that you can fully utilise it.

Developers should be following the guide at Howto interact with gitea and koji to do an rpm build for SME11.

This wiki page is for interacting directly with koji.


Official Koji documentation can be found at: https://docs.pagure.org/koji/

We are slowly migrating smeserver to newer build tools, which includes git for source management and koji for managing the builds.

Here we will try to explain how to setup and and interact directly with Koji.

Please read here for the normal development process.

This page is primarily focussed on understanding the koji backend and how to interact with it directly.

Web Interface

The web interface is available to everyone for read-only access to the status of builds the configuration of the farm.

Developers and Admins have additional rights after they login.

<<We'll add a bit more here>>

Developers

As a developer, you will need access to koji to be able to initiate builds, add new packages and tweak settings.

Please ask in the Development Forum or via the #buildsys channel on Rocket Chat.

A koji user will be created and you'll be given a 'bundle' (koji-<userid>-bundle.tgz) that contains your koji config and keys.

Please extract this in your home directory on your development workstation.

 tar -xzf koji-<userid>-bundle.tgz
 ls ~/.koji
 client.crt  config  <userid>_browser_cert.p12  serverca.crt

Install the koji client ('sudo dnf install koji' or equivalent on your flavour of linux)

  • on fedora do
 dnf install koji-tool -y
  • on centos 7 do
 yum install koji -y
  • On Rocky 8
    #!/bin/sh
    dnf -y install epel-release
    dnf -y install policycoreutils-python-utils
    dnf -y install setools-console
    dnf -y install rsyslog
    dnf -y install setroubleshoot-server
    dnf -y install koji
    

Check that you can connect

koji moshimoshi

And you should receive a welcome message, telling you that you've connected.

Build from git

Building of rpms is usually done via a make build within your dev environment, but you can trigger a build via the koji client

koji build sme11-test git+https://src.koozali.org/smeserver/<pkg>.git?#<tag>
koji build sme11-contribs-test git+https://src.koozali.org/smecontribs/<pkg>.git?#<tag>

Where:

  • <pkg> = your package (e.g. smeserver-php)
  • <tag> = git version tag to be built (3_0-1.el8.sme)

Example:

koji build smeserver11 git+https://src.koozali.org/smeserver/smeserver-php.git?#3_0-1.el8.sme

Structure

We have created build targets that align with the standard development practice of building into test, then migrating that build through the different environments

  • smeserver/<pkg>-<tag> -> smeserver11 (smeserver11-test) -> smeserver11
  • smecontribs/<pkg>-<tag> -> smecontribs11 (smecontribs11-testing) -> smecontribs11

There is 1 build tag for each of smeserver and smecontribs to allow for the use of different external repos and settings.

The repos align with the repos available to dnf in smeserver:

  • smeos (smeserver11)
  • smetest (smeserver11-test)
  • smecontribs (smecontribs11)
  • smecontribs-test (smecontribs11-testing)

Advanced commands

If adding a new package, it needs to be added to the parent tag for that Stream/Release:

koji add-pkg --owner kojiadmin smecontribs11 smeserver-my-new-contrib

to add a rpm to the build group to install in a mock environment :

koji add-group-pkg dist-sme11-build build perl-Module-Install

to list rpms in the mock environment:

 koji list-groups dist-sme11-build build

to add a package to build list

 koji add-pkg  --owner jpp dist-sme10-os smeserver-manager-jsquery 
 koji add-pkg  --owner jpp dist-sme11-os smeserver-manager-jsquery 
 koji add-pkg  --owner jpp dist-sme12-os smeserver-manager-jsquery 

to tag and existing build against a new tag (e.g. copy from testing to os)

   koji tag-build dist-sme11-os smeserver-update-11.0.0-7.el8.sme

to manually populate an external repo for use by dnf (external repos should be automatically generated when a new build is attached to that tag)

   koji dist-repo dist-sme11-testing <gpg key>
   koji dist-repo dist-sme11-os <gpg key>
   koji dist-repo smecontribs11-testing <gpg key>
   koji dist-repo smecontribs11 <gpg key>