Show HN: Emma, a real-time AI video persona from Nuance Labs

app.nuancelabs.ai

9 points by cvanea 1 day ago

Hi HN! I'm Claudia, first employee and founding researcher at Nuance Labs. We're a research startup based in Seattle and have just released what we've been working on for the past 18 months.

Emma, a conversational audio-visual AI that you can have a video call with in real time. It might be a little rough around the edges but we think it's better than anything else out there (we're biased, of course). You don't need to make an account and it works from the browser with mic and optionally camera.

Emma is built on our full-duplex audio-visual system, Nuplex. We focused on naturalness over existing benchmarks as we found they didn't correlate well with what people actually like or how we speak face to face. We think being uniquely expressive is more important than an averaged-out face, for example. Our blog goes into more detail: https://research.nuancelabs.ai/

A beta developer API is available at https://platform.nuancelabs.ai/. We're taking safety very seriously so she may prematurely end the call, in particular for the API, but we're working on tuning that.

Personality, across all modalities, was the most important part for me. I've spent the longest speaking to her and I think she can be a lot of fun! I'd love for people to try it out and I look forward to hearing what you all think.

Thank you!

(Apologies for the double post, someone external posted our demo before we were ready, oops: https://news.ycombinator.com/item?id=50429477)

adrianwaj 20 hours ago

Does Emma respond to the other speaker in ways beyond the words, see here:

"I do not want to talk to devices. Ever.... That leaves just 1% of the total communication being the words that are spoken."

https://news.ycombinator.com/item?id=50429807

I recently setup BigHits for HN best comments to be read out after Supertonic 3 encoding (see my recent Show HN.) It could be interesting if there was an actual face to read them out too.

I personally like the different accents. Are there other avatars beyond Emma? HeyGen does personal avatars trained on video as well. Have you seen them?

AZDR 1 day ago

I can't believe how fast it responds! Very impressive folks!