Audio Input

WebThings
#1

I’ve started working a skill that would turn my voice assistant into a webthing and I would love to be able to send audio input to it through the UI.

It seems like since the Assistant functionality already had the ability to record and send audio snippets, it might be reasonable to implement.

The use case would be enabling you to talk to your assistant from anywhere using the gateway interface, but if the component were available in the UI, and the type were defined, I could imagine otherwebthings and add-ons using it.

Any thoughts on a way to accomplish that?

#2

You’d essentially want to revert this PR, but pull the relevant UI bits into an extension add-on. We used the speaktome-api node module, which uses MediaRecorder and some other things.

@anatal and @lissyx are actually working on a rewrite of the Voice add-on as well, which may include a browser speech interface.

#3

Awesome, I’ll look into the voice add-on! thanks for the response