[Bug]: Issue with setting nvidia container runtime debug logs file path via nvidia-ctk

[harishxr]

Important Note: NVIDIA AI Enterprise customers can get support from NVIDIA Enterprise support. Please open a case here.

Describe the bug
When trying to enable debug logging for the nvidia-container-runtime, running

nvidia-ctk config --in-place --set nvidia-container-runtime.log-level=debug

works and sets the log level from info to debug.

Running

nvidia-ctk config --in-place --set nvidia-container-runtime.debug=/var/log/nvidia-container-runtime.log

to route debug logs to nvidia-container-runtime.log does not seem to uncomment the #debug in /etc/nvidia-container-runtime/config.toml unless we specify a new log file path.

To Reproduce
Detailed steps to reproduce the issue.

nvidia-ctk config --in-place --set nvidia-container-runtime.debug=/var/log/nvidia-container-runtime.log

Does not uncomment the debug file path in config.toml unless a new file path is given
Expected behavior
A clear and concise description of what you expected to happen.

nvidia-ctk config --in-place --set nvidia-container-runtime.debug=/var/log/nvidia-container-runtime.log

Running the above command should uncomment the file path in config.toml
Environment (please provide the following information):

• nvidia-container-toolkit version: 1.18.1
• NVIDIA Driver Version: 580.126.09
• Host OS: Amazon Linux 2023
• Kernel Version: 6.1.159-182.297.amzn2023.x86_64
• Container Runtime Version: Docker version 25.0.14
• CPU Architecture : x86_64
• GPU Model(s) L4

[elezar]

Thanks @harishxr. I have created #1629 to address this.

[elezar]

@harishxr v1.19.0-rc.3 is now available. To install this from the experimental repo:

sudo apt-get update && sudo apt-get install -y --no-install-recommends \
   curl \
   gnupg2

curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
  && curl -s -L https://nvidia.github.io/libnvidia-container/experimental/deb/nvidia-container-toolkit.list | \
    sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
    sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list

export NVIDIA_CONTAINER_TOOLKIT_VERSION=1.19.0~rc.3-1
    sudo apt-get install -y \
        nvidia-container-toolkit=${NVIDIA_CONTAINER_TOOLKIT_VERSION} \
        nvidia-container-toolkit-base=${NVIDIA_CONTAINER_TOOLKIT_VERSION} \
        libnvidia-container-tools=${NVIDIA_CONTAINER_TOOLKIT_VERSION} \
        libnvidia-container1=${NVIDIA_CONTAINER_TOOLKIT_VERSION}

Please confirm that this addresses your issue or wait for the next v1.18.x release if you prefer.