Rate limit Genoss GPT.

[mattzcarey]

Add capability for rate limiting users

[Wirg]

Hi @mattzcarey ,

I think it might be a good goal to test extending Genoss based on FastAPI plugins.

You have a stackoverflow on the subject here : https://stackoverflow.com/questions/65491184/ratelimit-in-fastapi
With a bunch of packages, for example this one : https://github.com/laurentS/slowapi .

I would test it and document how to do this rather than directly implementing it.