Maybe this would need to be done in the openai platform.
Has anyone built a pickaxe that streams the answer as it comes in instead of waiting for the entire answer to be sent back as one response?
I feel like there are scenarios where this would be better. It feels faster. I’d personally rather see the text unfolding as it’s coming in instead of waiting.
Any thoughts or ideas about this? Thanks guys!