# Speaker ID split between train/test/dev

**URL:** <https://discourse.mozilla.org/t/speaker-id-split-between-train-test-dev/34289>\
**Category:** Common Voice\
**Tags:** dataset\
**Created:** [December 14, 2018, 4:23pm UTC](https://discourse.mozilla.org/t/speaker-id-split-between-train-test-dev/34289 "2018-12-14T16:23:55Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![ElChocolatero](https://avatars.discourse-cdn.com/v4/letter/e/a587f6/32.png) [@ElChocolatero](https://discourse.mozilla.org/u/ElChocolatero)\
**Post date:** [December 14, 2018, 4:23pm UTC](https://discourse.mozilla.org/t/speaker-id-split-between-train-test-dev/34289/1 "2018-12-14T16:23:55Z")

</div>

Hello,

there was some discussion earlier this year about whether or not the same speakers appeared in more than one of the training, dev, testing splits. It wasn’t clear whether or not this was the case or not. Could you please confirm what the situation is regarding this if I download the dataset in its current form?

---

<div class="post-metadata">

**Author:** ![sdenton4](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/sdenton4/32/26098_2.png) [@sdenton4](https://discourse.mozilla.org/u/sdenton4)\
**Post date:** [February 12, 2019, 4:53pm UTC](https://discourse.mozilla.org/t/speaker-id-split-between-train-test-dev/34289/2 "2019-02-12T16:53:05Z")

</div>

Hi, I would also like some update on this. The metadata in the current dataset download has last-modified timestamps of Nov 2017, which makes me think that the train/test split is not resolved in the public dataset. I did see some changes in the GitHub in March that looked like they were meant to resolve the issue.

Aside from publishing an entirely new set, it could be nice to just re-bucket the train/test split in the currently available version. I can’t do this myself, since the speaker id’s don’t seem to be available in the metadata. (I’m personally mostly concerned about having the same speakers in train and test.)

---

<div class="post-metadata">

**Author:** ![gregor](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/gregor/32/28922_2.png) [@gregor](https://discourse.mozilla.org/u/gregor)\
**Post date:** [February 12, 2019, 5:15pm UTC](https://discourse.mozilla.org/t/speaker-id-split-between-train-test-dev/34289/3 "2019-02-12T17:15:15Z")

</div>

Hi,

there’s a beta release for the new dataset in this thread:

> [@Multi-language Dataset Beta Release](https://discourse.mozilla.org/t/multi-language-dataset-beta-release/34373):
>
> The multi-language dataset is now available to the Common Voice community as a beta release! This release includes all new, multi-language data that has been collected in 2018. There are two reasons for choosing a community-focused beta release. First, the data in this release is raw. The Common Voice team will continue improving the way the data is bundled across languages, but we also want to get the dataset in the hands of those who want to start using it immediately. Second, before a wider…

The related metadata file can be split up with the linked CorporaCreator tool to make sure that no speaker overlap exists in the train/dev/test sets.

If you don’t want to do that manual work, we’ll also do a full release in less than a month.

---

<div class="post-metadata">

**Author:** ![sdenton4](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/sdenton4/32/26098_2.png) [@sdenton4](https://discourse.mozilla.org/u/sdenton4)\
**Post date:** [February 12, 2019, 5:36pm UTC](https://discourse.mozilla.org/t/speaker-id-split-between-train-test-dev/34289/4 "2019-02-12T17:36:47Z")

</div>

That’s great, thanks!

---

<div class="post-metadata">

**Author:** ![ElChocolatero](https://avatars.discourse-cdn.com/v4/letter/e/a587f6/32.png) [@ElChocolatero](https://discourse.mozilla.org/u/ElChocolatero)\
**Post date:** [February 15, 2019, 12:10pm UTC](https://discourse.mozilla.org/t/speaker-id-split-between-train-test-dev/34289/5 "2019-02-15T12:10:32Z")

</div>

I filled out the form for the beta dataset a few days ago but haven’t received any email. Is there any other way to get hold of it? Thanks