Any plans to add the ChatGPT o1 preview to the available models that we can select from?
We actually finished the integration. However, the API endpoint for the o1 preview does not support text-streaming (the thing that makes the answers appear in realtime, character by character).
When OpenAI makes the o1 preview model support streaming, we will add it. We aren’t sure when this will be, but expect it to be fairly soon.
I wonder if the streaming isn’t supported because there is sort’ve two sets of outputs produced with 01-preview.
First it goes through and basically tells you it’s thought process; this is hidden by default, but clicking on it will produce the text.
Then it goes ahead and produces a response.
Given this more agent-like experience, do you think it might still work well without text streaming in a Pickaxe environment? Especially something like the smart form functionality.
As of today, o1 doesn’t support streaming, but it also doesn’t support function calling.
We’ve talked about getting it set up, but without function calling it won’t be able to use all our awesome actions quite yet. So we’re waiting for now.
But it can be used as a custom action, right? Maybe if we add it as a custom action for now until they add function calling and text streaming
Also I have used two different platforms where they are getting the o1 preview to do some sort of function calling. One is a text editor called Cursor and the other is Figments
We will do some more research. But you’re right, integrating it as an action itself is a great, fairly easy idea we can absolutely try. I’ll keep you updated.
The idea of 01-preview as a custom action sounds amazing!
I have just added the action @lloydpearsoniv suggested to the community actions. You can use it in the builder, or give it a try here. I took a GPT 3.5 bot and gave it o1 access.