On line 325 in the file `gradio-app/app.py` change `if quant == "8bit":` to `if quant == "int8":`. Otherwise, you won't be able to load the 8bit quant in the gradio app.