Dataset downloads Dutch

[sander]

Hi,

To start: thanks for the really great project !

Unfortunately the downloadable datasets don’t have an (visible) publication date.
At the moment I’m wondering how up to date the Dutch dataset is because the download page gives the following stats:
Size 382 MB
Validated Hr. Total 12
Overall Hr. Total 13
Number of Voices 373

However, when I download this dataset i only end up with 366MB.

Apart from that the graph on https://voice.mozilla.org/en shows:
Dutch
Hours Recorded 23h
Hours Validated 18h

So that is a significant difference (1/3 new validated speech !).

So I’m wondering:

• if the current link for downloadable dataset is actually correct (since there is a size difference 382mb versus 366mb)
• when the downloadable dataset will be updated (is there a regular interval ?
• if it would be wise to add a publication date to the dataset stats.

Regards,

Sander

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

Hi and welcome to the Common Voice community!

when the downloadable dataset will be updated (is there a regular interval ?

See this message for clarification

Add Basque to the dataset page

The languages currently available for download are the ones that last year were already launched and had validated hours before we started the dataset creation later last year (Basque or Spanish for example were not even launched by that time) Dataset releases are really time consuming for the team and we are still trying to figure out how to be able to release them more often (I’ve added this as a todo on my list to discuss with the team). You can say with confidence that Basque is fully laun…

For the other two, I’m pinging other team members to check, thanks for reporting.

Cheers.

[sander]

Thanks for the pointer !
It thought it would be an easy feat, but it clearly is not.
I do still have some questions after reading that entry:

• Are the datasets for all languages revisited at the same time, or independent ?
• Is there a way to help for the Dutch one ?

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

Are the datasets for all languages revisited at the same time, or independent ?

We haven’t agreed on a plan yet. I’ll be working on a proposal to deliver to the team so we can have sooner dataset releases based on what’s more helpful for the community. I’ll open a topic about it soon.

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

Today we have released a new version of the dataset and keep improving the automation of the process.

Common Voice mid-year release - more data, more languages!

The Common Voice Team is excited to announce the release of a new dataset that includes 2,366 total hours of contributed voice data! The project has seen a spike in contributions and launches of many new languages over the past six months. We want to make sure to release data for use by the community quickly and efficiently. To do this, we’ve moved forward with a mid-year release including all recorded clips in 28 languages, available on the Datasets page on Common Voice. The new languages bei…