-
Notifications
You must be signed in to change notification settings - Fork 88
Open
Description
Hi, dear authors. I am trying to run LocAgent with CL-7B and CL-32B. I use this command to start the vllm server:
vllm serve /path/to/Qwen2.5-Coder-32B-CL --tensor-parallel-size 8 --served-model-name qwen2.5-32b-coder-cl --host 0.0.0.0 --port 8006
There are no apparent errors in the log, but localization failed and all 'found_files' lists are empty. Am I using the right way to start a server? Thanks! (for CL-7B, there is no problems, but for CL-32B there is)
Metadata
Metadata
Assignees
Labels
No labels