k8s -> sysbox -> incus cluster ?

[IngwiePhoenix]

Hello!

So there are two applications that genuenly require persistent rootfs storage that I frequently use, mainly because they need to be recompiled time after time and setting up CI/CD for that would be really annoying. So instead, I was looking at a way to run incus within Kubernetes - that way, I could manage all my things in Kubernetes, and run rootfs-dependent containers as Incus containers as I have, so far.

This "idea" has been brewing for a while and I wanted to just put this out here and ask for feedback for this idea.

Here's how I'd imagine it to work (consider a three-node setup):

• each node has sysbox installed,
• each node runs a sysbox-backed container (DaemonSet) that in return runs incus,
• each of those containers is somewhat resource-limited on purpose to control resource-sharing between kubernetes and incus,
• each of those incus containers builds an Incus cluster together.

Would that be possible/feasible to implement using Sysbox?

Thank you and kind regards!