would be nice to have a stop request button

[raghu-135]

Enhancement description

It would be nice to have a stop/kill request button. Sometimes the LLM can take long and doesn't return. In those scenarios, it would be nice to have a stop/kill request button.