vLLM or TGI or any other serving at scale not supported #100
Description
Hello Team,
I wish to serve speech T5 model at scale using servers like vllm or TGI, but sadly, it is failing. Please advise.
{{ message }}
Hello Team,
I wish to serve speech T5 model at scale using servers like vllm or TGI, but sadly, it is failing. Please advise.