Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Radxa notes to run LocalAI #307

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Radxa notes to run LocalAI #307

wants to merge 2 commits into from

Conversation

mauromorales
Copy link
Member

@mauromorales mauromorales commented Nov 10, 2024

@mudler these are the notes I have for the Radxa, please review and feel free to improve if you also work on it

  • I'm not sure if this should be a blog post or an example
  • And how much in detail do we want to go on each section, for example I only referenced the part about creating a UKI bootable image

Signed-off-by: Mauro Morales <[email protected]>
Copy link

netlify bot commented Nov 10, 2024

Deploy Preview for kairos-io ready!

Name Link
🔨 Latest commit e9a505b
🔍 Latest deploy log https://app.netlify.com/sites/kairos-io/deploys/67604197d9630200080acdeb
😎 Deploy Preview https://deploy-preview-307--kairos-io.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@mauromorales mauromorales requested a review from mudler November 10, 2024 19:36
@mauromorales mauromorales self-assigned this Nov 10, 2024

## Create a bootable image and flash it to the Radxa X4

Follow the instructions on https://kairos.io/docs/installation/trustedboot/ to create a bootable image.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe we can add the full steps here for reference and make it a e2e example, wdyt? docs mutate and would be nice to give people something replicate.

We can also merge as-is and improve later, when at it I will update the article, or whoever gets at it first :)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mudler makes sense, I was hesitating between doing one and the other, I'll get back to it as soon as I'm in front of my desk


{{< alert title="Warning" color="warning" >}}
- Radxa's Firmware to enable Secure Boot is still in beta. Use it at your own risk.
- Without proper cooling, the Radxa X4 might overheat and shut down during the firmware update process, which could brick the device.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤣

Create the file `images/Dockerfile.full-firmware` with the following content:

```Dockerfile
FROM ubuntu:24.04
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cant we use an existing image to base this off ? A simple FROM kairos whatever and then install the kernel and link it?

so basically do it the other way around, from a kairos image ADD the kernel missing stuff, instead of generating a ubuntu image to then transform it into kairos? Seems easier

## Install LocalAI

1. Log into the machine with the user you created.
2. Download the [LocalAI binary](https://github.com/mudler/LocalAI/releases/download/v2.22.1/local-ai-Linux-x86_64)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why not use a bundle in teh cc directly? https://github.com/kairos-io/community-bundles/tree/main/LocalAI

docker build -t ubuntu-full-firmware -f images/Dockerfile.full-firmware ./images
```

Now we are going to use our newly created image and convert it to a Kairos image for Trusted Boot.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would drop the trusted mention here, after all this will transform it into a generic kairos image which is valid for trusted or non-trusted workflows no?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Todo 🖊
Development

Successfully merging this pull request may close these issues.

4 participants