Ability to stop bot's answer
🥚 Idea
113 upvotes 🙌
When we detect a bot is hallucinating or provide erroneous information, we should be able to interrupt the bot's answer to save some tokens in case of long answers.
🥚 Idea
113 upvotes 🙌
Save
contact •
2 years ago
Also, have an API call so we can stop it as well!
info •
2 years ago
That's actually a great idea. There are times where the bot is typing a ton of irrelevant information wasting our tokens.