I've been waiting for this! I'm learning Spanish so I built an app to teach me Spanish, but hyperfocused on scenarios in my life, for example "watching a Barça match in a Barcelona bar". It does FSRS flashcard training, and live conversation practice.
I think education is a very underexplored area for these live conversation models. Yes you can just use ChatGPT Live but that's freeform and unstructured, doesn't have a curriculum or can present supporting visuals, etc. On a grand scale if you can give children their own personal individual tutor rather than relying on group teaching alone, there could be a huge jump in successful education outcomes.
hopefully this come in openrouter api cause I'm not signing up for a specific provider's specific api platform, and have yet another thing that can bill me.
They wont. This is OpenAI specific. They don't even have support for OpenAI realtime models.
However, this open source project https://github.com/chatbotkit/platform/ does and you can plug OpenRouter or OpenAI keys straight in while keeping your integration work generic. The only downside is hosting it yourself but it is just docker compose up.
and yet another showcase of making automated restaurant reservations. It truly is the purpose of AGI, and all software ever, really, to automate that experience.
It baffles me that the labs can't come up with more exciting use cases for voice api.
Client-side reservations are one of those features that looked like the future when Google showed them on Pixel. Years later, I'm still waiting for the iOS ecosystem to catch up
I think education is a very underexplored area for these live conversation models. Yes you can just use ChatGPT Live but that's freeform and unstructured, doesn't have a curriculum or can present supporting visuals, etc. On a grand scale if you can give children their own personal individual tutor rather than relying on group teaching alone, there could be a huge jump in successful education outcomes.
Honestly though they need to hire whoever did those Google ads back in the day.
However, this open source project https://github.com/chatbotkit/platform/ does and you can plug OpenRouter or OpenAI keys straight in while keeping your integration work generic. The only downside is hosting it yourself but it is just docker compose up.
It baffles me that the labs can't come up with more exciting use cases for voice api.