How to use Jaco-Assistant STT?

THartmann · January 9, 2021, 9:19pm

Hi,

so I want to get DeepSpeech in German via Jaco-Assistant on my Rasperry Pi 4B, but I’m not quite sure how to download and use it. Should I just execute the Python-Program found at https://gitlab.com/Jaco-Assistant/Jaco-Master/-/blob/master/speech-to-text/download_model.py? Or is there another way of getting it, e.g. via the terminal?
And when I have got the new models, how do I use them? Or in another way: how does the deepspeech --model deepspeech-0.9.3-models.tflite --scorer deepspeech-0.9.3-models.scorer --audio audio/2830-3980-0043.wav command change?
Sorry, if there already is an answer somewhere, I couldn’t find it.

Thank you already.

othiele · January 10, 2021, 1:18am

Jaco is great, but not my strong suit. @dan.bmh should be able to help

dan.bmh · January 10, 2021, 1:58pm

If you’re just interested in the STT features you can download the models (.tflite + .scorer) directly from the DS-Polyglot repo: https://gitlab.com/Jaco-Assistant/deepspeech-polyglot#language-models-and-checkpoints

Jaco also handles NLU interpretation and automatic scorer building from the skill data, but it seems that’s more than you currently need.

THartmann · January 10, 2021, 4:13pm

So I’m just going to get the model via curl -LO https://drive.google.com/file/d/1Chx2n4u8PXTBwxAmDGGem9PKcd8sBhbQ/view?usp=sharing and the scorer via curl -LO https://drive.google.com/file/d/1CMnImO3ucu3j0q63OqoBIyW-09dHUE4p/view?usp=sharing?
But when I’m trying to use it with deepspeech --model output_graph_de.tflite --scorer kenlm_de.scorer --audio audio/2830-3980-0043.wav I get an Error ERROR: Could not open 'output_graph_de.tflite'.
How can I solve this? / What did I do wrong?

dan.bmh · January 10, 2021, 4:52pm

Are you sure the files are not broken?
In the script you linked above I did need a special approach to download the files from google drive.

dan.bmh · January 10, 2021, 6:18pm

With the curl commands above I only get some html files.

THartmann · January 10, 2021, 8:55pm

This is possible. How did you do it in that “special way”?

othiele · January 11, 2021, 7:52am

Please use a search engine (e.g. Google) to find out how to download gdrive files directly. This has nothing to do with Jaco nor DeepSpeech and I remember that you have to use some trick, but don’t remember it.

dan.bmh · January 11, 2021, 1:05pm

Please look at the script you linked in your first post.
With some edits you should be able to use parts of it without installing the rest of Jaco.