diff --git a/cutlass/rocm/README.md b/cutlass/rocm/README.md new file mode 100644 index 0000000..b4e8a20 --- /dev/null +++ b/cutlass/rocm/README.md @@ -0,0 +1,75 @@ +### Validated with rocm6.4.1 docker from https://hub.docker.com/u/rocm + +```bash + +docker run -it --rm --network=host \ + --device=/dev/kfd --device=/dev/dri \ + --ipc=host --shm-size 16G \ + --group-add video \ + --cap-add=SYS_PTRACE \ + --security-opt seccomp=unconfined \ + -v /home/workspace:/workspace \ + rocm/vllm:rocm6.4.1_vllm_0.9.1_20250702 + +``` + +### insider rocm docker, set up scale repo and install scale + +```bash +cd /workspace + +# Tell apt to authenticate to the repo +sudo tee /etc/apt/auth.conf.d/scale.conf <