I have released v0.5.3 with support for cancel’ing an ongoing streaming chat completion request. This seems necessary for any production use of interactive chat.
The streaming api had to be changed so that a task pid for cancellation could be returned. I took the opportunity to also return the response status and headers in addition to the streaming body.
The user guide has been updated to reflect the new API return value. The use of the request cancellation API is shown in detail in the Streaming Orderbot sample.
The cancellation API has only been tested on OpenAI, not on any proxied models.
Enjoy the new functionality in the New Year 
