Hello everyone, I’m currently working on a proposal for the project strategy around dataset releases. As you might already know we have done a couple of them already and since then we have had a lot of feedback an questions about it . That’s why I open this topic, to try to understand what would be…

I think Spanish is one of the most spoken languages in the world and the dataset is not yet ready for download. I do not know how odten we need updates, I think i might depende in the changes that the data has received.

I think once a month would be ideal, but I don’t know how hard it is to release a dataset. Maybe each 3 months would be good. About languages I wanna see Portuguese, Japanese and Korean to be launched, even though I don’t speak Japanese and Korean, the dataset could be used for learning. I speak Po…

Hello @nukeador [image] nukeador: How often do you need dataset updates? Why? Not to often, we need a really good amount of data to noticed an improvement. [image] nukeador: Which languages are you most interested in? Why? Spanish, even if it is small amount of data to test and creat…

Not to often, we need a really good amount of data to noticed an improvement. +1. Except maybe for very small datasets where small increases are always better than none, I don’t think it’s worth publishing an update if the data aren’t like 20% bigger¹ than what was previously released. I mean, i…

(feel free to split these off to a separate topic if you feel that’s better) Since most of us are probably “data-hungry” and just for a better understanding: What (steps) does it actually take to do a release ? one could have the impression that it could be nearly automated with the up and downv…

I asked about this before and was told that a lot of manual validation is required. It seems that even with the validation that occurs on the Common Voice site, it’s not enough to prevent bad clips slipping through.

Thanks everyone for your feedback, based on that I’ll be writing a proposal for the team to review and share it back here for a final iteration. Cheers.

For new languages with fewer hours, I suggest a monthly update. Because during this time there can be a significant change in the database (for example, 1 hour was recorded and a month later it was 2-3 hours). I agree that you can make an update only if the changes were more than 20%.

Today we have released a new version of the dataset and keep improving the automation of the process. [image] Common Voice mid-year release - more data, more languages! Common Voice The Common Voice Team is excited to announce the release of a new dataset that includes 2,…

Dataset releases - What's more valuable for you?

Common Voice

nukeador (Rubén Martín [❌ taking a break from Mozilla]) June 12, 2019, 11:15pm 10

Today we have released a new version of the dataset and keep improving the automation of the process.

Topic		Replies	Views
Is there any plan for the next dataset release? Common Voice	1	369	March 25, 2020
Dataset downloads Dutch Common Voice dataset	4	1355	June 12, 2019
Dataset Release Request Common Voice	6	338	August 11, 2021
Are there any plans for the next dataset release? Common Voice	2	568	January 9, 2020
Add Basque to the dataset page Common Voice dataset	6	1117	June 12, 2019

Dataset releases - What's more valuable for you?

Related topics