Failed convert DeepSeek-R1-Distill-Llama-70B weight : AssertionError: (5120,1024) != (8192,)

[Jhonlv]

when I user "python -m mttransformer.convert_weight --in_file /data/mtt/DeepSeek-R1-Distill-Llama-70B --saved_dir /data/mtt/DeepSeek-R1-Distill-Llama-70B-tp8 --tensor-para-size 8" to convert DeepSeek-R1-Distill-Llama-70B weight ,countred this error:

GPU: 8*S4000

dirver version：1.2.0
mthread-gmi: 1.12.2
dokcer-images: registry.mthreads.com/mcctest/musa-pytorch-transformervllm:v0.1.4-kuae1.2

[gliangMT]

Hi @Jhonlv，your docker-image may be incorrect, please refer this doc: https://docs.mthreads.com/mtt/mtt-doc-online/

[caizhi-mt]

sudo pip install musa-deploy; sudo musa-deploy
请执行上面的命令，我们看一下环境信息