Custom kairos-debian ISO with systemd-journald errors on boot

[massimogallina]

I am using a custom version of kairos-debian ISO to boot a VirtualBox VM.
The custom ISO is built in this way:

docker run -v ./build:/tmp/auroraboot \
            -v ./config.yaml:/config.yaml \
            --rm quay.io/kairos/auroraboot \
            --set container_image=${REGISTRY}/${REPOSITORY}:${CI_COMMIT_TAG} \
            --set "disable_http_server=true" \
            --set "disable_netboot=true" \
            --set "state_dir=/tmp/auroraboot" \
            --cloud-config /config.yaml

The container image is generated with this Dockerfile:

FROM quay.io/kairos/kairos-debian:v2.3.0-k3sv1.27.3-k3s1

# Add all additional packages to install on kairos 
RUN sudo apt-get update && sudo apt-get install -y curl wireguard unzip iputils-ping easy-rsa tcpdump cron vim

# Install AWS CLI
RUN sudo curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip" && sudo unzip awscliv2.zip && sudo ./aws/install -b /usr/bin -i /opt/awscli && rm awscliv2.zip

# Set version
RUN touch /etc/edgegaldi_version
RUN echo "edgegaldi-os:<TAG>" > /etc/edgegaldi_version

and the config.yaml file is the following one:

#cloud-config

install:
  auto: true
  device: "auto"
  reboot: false
  poweroff: true

users:
- name: "test"
  passwd: "test123"
  ssh_authorized_keys:
  - "ssh-rsa ..........."
  groups:
  - "admin"
  shell: /bin/bash
  homedir: "/home/test"

When I boot the VM, after the grub boot the following messages start to be printed continuosly and the VM is not able to complete the boot:

Data hash table of /run/log/journal/####/system.journal has a fill level at 75.0 (3273 of 4359 items, 8388608 file size, 627 bytes per hash table item), suggesting rotation
/run/log/journal/####/system.journal: Journal header limits reached or header out-of-date, rotating

If I use the same process but using the kairos image quay.io/kairos/kairos-debian:v2.1.0-k3sv1.26.4-k3s1 in the Dockerfile, the VM is able to start without printing any logs about sytemd-journald.

How can I solve this issue?

Thanks,
M

[massimogallina]

I tried also using the standard kairos image as:

docker run -v ./build:/tmp/auroraboot \
            -v ./config.yaml:/config.yaml \
            --rm quay.io/kairos/auroraboot \
            --set container_image=quay.io/kairos/kairos-debian:v2.3.0-k3sv1.27.3-k3s1 \
            --set "disable_http_server=true" \
            --set "disable_netboot=true" \
            --set "state_dir=/tmp/auroraboot" \
            --cloud-config /config.yaml

and we have the same issue.
I attach also a printscreen of the error.

If I try to boot the VM directly with thekairos-debian-v2.3.0-k3sv1.27.3+k3s1.iso image it works fine.

[jimmykarily]

There is enough information to try to reproduce. I created an issue instead to plan it. Closing this, let's move the discussion to the issue.