# Dataset downloads Dutch

**URL:** <https://discourse.mozilla.org/t/dataset-downloads-dutch/37967>\
**Category:** Common Voice\
**Tags:** dataset\
**Created:** [April 9, 2019, 8:47am UTC](https://discourse.mozilla.org/t/dataset-downloads-dutch/37967 "2019-04-09T08:47:56Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![sander](https://avatars.discourse-cdn.com/v4/letter/s/90ced4/32.png) [@sander](https://discourse.mozilla.org/u/sander)\
**Post date:** [April 9, 2019, 8:47am UTC](https://discourse.mozilla.org/t/dataset-downloads-dutch/37967/1 "2019-04-09T08:47:56Z")

</div>

Hi,

To start: thanks for the really great project !

Unfortunately the downloadable datasets don’t have an (visible) publication date.  
At the moment I’m wondering how up to date the Dutch dataset is because the download page gives the following stats:  
Size 382 MB  
Validated Hr. Total 12  
Overall Hr. Total 13  
Number of Voices 373

However, when I download this dataset i only end up with 366MB.

Apart from that the graph on [https://voice.mozilla.org/en](https://voice.mozilla.org/en) shows:  
Dutch  
Hours Recorded 23h  
Hours Validated 18h

So that is a significant difference (1/3 new validated speech !).

So I’m wondering:

- if the current link for downloadable dataset is actually correct (since there is a size difference 382mb versus 366mb)
- when the downloadable dataset will be updated (is there a regular interval ?
- if it would be wise to add a publication date to the dataset stats.

Regards,

Sander

---

<div class="post-metadata">

**Author:** ![nukeador](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/nukeador/32/20533_2.png) [@nukeador](https://discourse.mozilla.org/u/nukeador)\
**Post date:** [April 9, 2019, 10:15am UTC](https://discourse.mozilla.org/t/dataset-downloads-dutch/37967/2 "2019-04-09T10:15:42Z")

</div>

Hi and welcome to the Common Voice community!

> [@sander](#):
>
> when the downloadable dataset will be updated (is there a regular interval ?

See this message for clarification

> [@Add Basque to the dataset page](https://discourse.mozilla.org/t/add-basque-to-the-dataset-page/37609/2):
>
> The languages currently available for download are the ones that last year were already launched and had validated hours before we started the dataset creation later last year (Basque or Spanish for example were not even launched by that time) Dataset releases are really time consuming for the team and we are still trying to figure out how to be able to release them more often (I’ve added this as a todo on my list to discuss with the team). You can say with confidence that Basque is fully laun…

For the other two, I’m pinging other team members to check, thanks for reporting.

Cheers.

---

<div class="post-metadata">

**Author:** ![sander](https://avatars.discourse-cdn.com/v4/letter/s/90ced4/32.png) [@sander](https://discourse.mozilla.org/u/sander)\
**Post date:** [April 9, 2019, 2:28pm UTC](https://discourse.mozilla.org/t/dataset-downloads-dutch/37967/3 "2019-04-09T14:28:35Z")

</div>

Thanks for the pointer !  
It thought it would be an easy feat, but it clearly is not.  
I do still have some questions after reading that entry:

- Are the datasets for all languages revisited at the same time, or independent ?
- Is there a way to help for the Dutch one ?

---

<div class="post-metadata">

**Author:** ![nukeador](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/nukeador/32/20533_2.png) [@nukeador](https://discourse.mozilla.org/u/nukeador)\
**Post date:** [April 9, 2019, 2:58pm UTC](https://discourse.mozilla.org/t/dataset-downloads-dutch/37967/4 "2019-04-09T14:58:57Z")

</div>

> [@sander](#):
>
> Are the datasets for all languages revisited at the same time, or independent ?

We haven’t agreed on a plan yet. I’ll be working on a proposal to deliver to the team so we can have sooner dataset releases based on what’s more helpful for the community. I’ll open a topic about it soon.

---

<div class="post-metadata">

**Author:** ![nukeador](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/nukeador/32/20533_2.png) [@nukeador](https://discourse.mozilla.org/u/nukeador)\
**Post date:** [June 12, 2019, 11:17pm UTC](https://discourse.mozilla.org/t/dataset-downloads-dutch/37967/5 "2019-06-12T23:17:31Z")

</div>

Today we have released a new version of the dataset and keep improving the automation of the process.

> [@Common Voice mid-year release - more data, more languages!](https://discourse.mozilla.org/t/common-voice-mid-year-release-more-data-more-languages/41409/):
>
> The Common Voice Team is excited to announce the release of a new dataset that includes 2,366 total hours of contributed voice data! The project has seen a spike in contributions and launches of many new languages over the past six months. We want to make sure to release data for use by the community quickly and efficiently. To do this, we’ve moved forward with a mid-year release including all recorded clips in 28 languages, available on the [Datasets](https://voice.mozilla.org/datasets) page on [Common Voice](https://voice.mozilla.org). The new languages bei…