This repository was archived by the owner on Jul 20, 2025. It is now read-only.
This repository was archived by the owner on Jul 20, 2025. It is now read-only.
"expected scalar type BFloat16 but found Half" #58
Description
Tried your fork to run your model https://huggingface.co/OccamRazor/mpt-7b-storywriter-4bit-128g/
Using it locally, this model throws the error expected scalar type BFloat16 but found Half
IDK what to do to fix this.
Would you please let me know if it works for you or how to fix this?
Attached is debug and config.json:
debug.zip
Thanks