[Feature Request] Support multiple LLMs using litellm

[SanderVUMC]

Hi Team,

Not sure if you can support different LLMs in your app?

https://github.com/BerriAI/litellm

Thanks.

[ishaan-jaff]

I'm the maintainer of LiteLLM - will make a PR

[ishaan-jaff]

@SanderVUMC #53