Do the Common Voice datasets contain multiple audio samples for the same text in the same language?

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

@txopi

If such a number isn’t affordable for an small language (for example Basque), how many recordings and sentences could give us an usable speech-to-text system? I don’t ask for an exact number, of course, just a very approximated one, to clarify which are our objectives.

The current tests that we have done suggest that English will need around 2000 validated hours for a basic general model to be trained. Different languages will most likely have different numbers, we will only be able to know as we collect data and train models.

For major languages we have been collecting 1-3M sentences to have buffer to avoid repetitions. On the tests that Deep Speech have been doing for English, French, German and Mandarin, the quality of the model was higher when only one recording was done.

There were some math over this topic:

My language is now collecting voice, what do I need to know?

Mozilla Voice Community Playbook: The source of truth for setting up and maintain self-sustainable communities. Hi, I want to open this topic because more and more languages are moving to the voice collection phase (thanks to be able to get the minimum number of sentences!) Now that your language is available for voice collection you might wonder, now what? Keep in mind that in order to properly train Deep Speech algorithm for a general (near-human) recognition model there are …