Streaming of completions

[stephansann]

Hello again

I found that the chatbot will not stream the completions of the server.

This is a not-so-nice user experience for the user, since with longer completions it can be quite a while until there will be an answer.

Any chance to include streaming?

Thanks and best regards
Stephan