🏗️ Kairos factory - Streamline derivatives creation

[mudler]

This card is the epic to track all the issues related to streamlining derivatives creation. This includes all the tools, design document, flows in place in order to get full OS image building easied out and also carried in Kubernetes native contexts, including onboarding.

The ultimate goal is to be able to convert upstream images directly with our CRD and artifacts built from our factory - if someone wants can build them manually or just use ours.

Design goals

• Be able to create a derivative from a Dockerfile with standard container build tools (buildah, docker, etc.)
• Be able to create a derivative from a Kubernetes manifest CRD, using also artifacts from the Kairos factory in a "static", immutable way. Instead of running dynamic commands, we focus on statically creating high reproducible builds of images.
• Be able to create custom OS from Kairos core releases from the CRD and a dedicated CLI with additional customizations: such as kernel, packages, etc.
• Be able to create assets to boot the OS in different scenarios: raw disk images for cloud, ISOs for baremetal, disk images for embedded platforms, netboot artifacts for booting from network
• Be able to netboot seamlessly from network with zero-touch infrastructure configuration - plugging into the existing network with our CRDs.
• Be able to create your own Kairos factory artifacts
• Be able to SBOM, sign, and trace all the artifacts in SLSA compliant base images #92 and 🌱 SBOM #51

---

MVP:

• support for airgap by embedding bundles into image #270
• generates also netboot artifacts #272
• systemd toolkit services should be installed to /etc #297
• Rework services packages #300
• CRD to generate custom OS images. input: cloud-init, set of bundles, a base image https://github.com/c3os-io/osbuilder
• Separate dracut module package #299
• Expose qcow/cloud disk images creation from the controller #377
• Framework images from packages repositories #296
• CLI to generate ISO and images from same input as CRD (cloud-init, bundles, base image) #273
• 🏗️ Central http server where to push result artifacts #515
• 🐛 Framework image missing kairos-agent binaries. #777
• 📦 Cloud config from packages repositories #298
• 🏗️ Save built images as importable tars #514
• ✨ Publish images for BYOI #755
• 📖 Documentation about framework images #1044
• 🐛 Framework image contains optional components #776
• 515 central server osbuilder#22
• Always produce an importable tar from the image osbuilder#23
• 🌱 Split elemental-cli into a lifecycle manager for the system (install/upgrade) and a building component #711
• 🏗️ pull/push from private repo - use kubernetes and imagePull secret to pull #513
• 🌱 Support runtime registry authentication for updates #932
• 🌱 Registry authentication for installations and upgrades #1042

Deliverables:

• Complete LFS stack #430
• consume luet as a binary in the elemental-cli #712
• 📦 Enabler packages to enable services #269
• 📦 Build the kairos-agent in packages #301
• redesign osbuilder CRDs for v1
• Create provider packages in our luet repositories, that can be consumed as a bundles during installation
• Create provider live layer packages for systemd-sysext
• Base images from packages repositories #258
• k3s live layer #384
• osbuilder: Push artifacts to PVC https://github.com/kairos-io/osbuilder/pull/22/files#diff-7263fc341f1b59afdc8599e1f570cdd180c28bf8cca71ecee1e58b58131202c5R44
• osbuilder: Push artifact to minio
• osbuilder image is multiplatform, but the packaged elemental is not #451
• 🌱 Attach and sign SBOM to images #1055
• 🌱 Vanilla kernel/initrd packages #432
• Logic should live in the overlay files, not in Earthly #1726
• CRDs to serve netboot artifacts and deployment over lan ( https://github.com/kairos-io/osbuilder/tree/netboot ) with pixiecore #1913
• osbuilder should allow nodeSelector/affinity arguments for the builder deployments #455
• 🌱 Streamline grub settings #435
• 🌱 Conformance tests #958
• 🌱 Proper support for openRC in the oem layouts #511
• There should be only one framework image with the logic for all distros #1896
• Dockefiles should separate the base image from the "build strategy" (aka flavor) #1898

After MVP phase is concluded, we should have all the cards to track deliverables opened, and we can close this epic.

[mudler]

closing this in favor of the follow-up (#1914) . We now are far away from a MVP ( see https://kairos.io/docs/reference/build-from-scratch/ )