I’m evaluating my application for an academic paper and would like to record the time of the response including the time to first token and time to last token. Is there a way to record these times?
@nettforce great question. I did ask @nathaniel recently if we can have webhooks firing when the chat starts (first token) and when it ends (last token). It is possible to retrieve the information about the chat starting, but unless Pickaxe implements a timeout rule, the chat doesn’t really end. You can always go back and keep asking questions.
How would you define the last token?
Hi @nettforce, cool idea - you should put this in feature requests
1 Like
Hey @nettforce Pickaxe does not currently allow users to collect time stamps at any interval of a chat session. This would be a very useful feature addition. If you add it to features request, you have my vote!