# Help create Common Voice's first target segment

**URL:** <https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587>\
**Category:** Common Voice\
**Tags:** announcements\
**Created:** [May 8, 2020, 3:48pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587 "2020-05-08T15:48:11Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![mbranson](https://avatars.discourse-cdn.com/v4/letter/m/c68b51/32.png) [@mbranson](https://discourse.mozilla.org/u/mbranson)\
**Post date:** [May 8, 2020, 3:48pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/1 "2020-05-08T15:48:11Z")

</div>

_See this post in other languages:_[Español](https://discourse.mozilla.org/t/ayuda-a-crear-el-primer-objetivo-segmentado-de-common-voice/60472) [Français](https://blog.mozfr.org/post/2020/05/aidez-nous-creer-premier-segment-cible-common-voice)

* * *

As of today, Common Voice has the capability to collect voice data for a specific purpose or use-case. We’re putting this ability to the test and kicking off data collection for a single word target segment that will eventually enable 1) _spoken digit_ recognition, 2) _yes_ and _no_ detection and 3) data for _Hey Firefox_ wake word testing.

To make this happen the [Common Voice platform](https://voice.mozilla.org) will collect audio from contributors across various languages speaking the digits _zero_ through _nine_, as well as the words _yes_, _no_, _hey_ and _Firefox_. These 14 (single word) sentences will be prioritized for each contributor when they either [Speak](https://voice.mozilla.org/speak) or [Listen](https://voice.mozilla.org/listen) at Common Voice. In order to ensure a wide range of data in each language, we’ll limit recording of these sentences to just once per person, per language. We also recognize that listening to people say such short terms repeatedly may get boring and be mentally fatiguing. To avoid burnout, and ensure quality of contribution when listening to clips, each person will only receive a maximum of two sets (or 28 total) of these succinct recordings.

 ![speak-target-segment-default](https://us1.discourse-cdn.com/flex001/uploads/mozilla/original/3X/1/0/10a4c60163bcddc7cea1d2c9fbe5ae1cd180ef6a.jpeg)

**Why a target segment?**

This targeted data collection will immediately benefit two collaborations: the first being with Mozilla Fellow, Josh Meyer, and the second being our teammates creating [Firefox Voice](https://github.com/mozilla/firefox-voice/).

Part of Josh’s work is to discover how much data is needed to train a machine learning engine on a new voice recognition application in a new language. For this work, Josh is aiming to benchmark the accuracy of Mozilla’s open source voice recognition engine, [Deep Speech](https://github.com/mozilla/DeepSpeech), in multiple languages for a similar task. Josh and the Deep Speech team have identified that spoken digit recognition, as well as yes and no detection, are great candidates for this type of application testing. The only caveat is that they need data to run those tests and, to quote Josh himself; “That data doesn’t exist…yet.”

Similarly, our Mozilla colleagues in Emerging Technologies are testing and training wake word options for Firefox Voice. They reached out, curious if Common Voice communities could help generate voice data for _Hey Firefox_ in multiple languages.

By [adding your voice](https://voice.mozilla.org/speak) to this target segment, you’re contributing to the work Josh, Deep Speech, Firefox Voice and Common Voice are doing – not to mention the people who will download this target segment and build voice recognition applications in various languages.

**What languages will this be collected in?**

Starting today this targeted data collection is available in 13 languages\*. If it is available in your language(s) you’ll notice 1) a banner announcing it on the Common Voice website and 2) some added context on the sentence cards when contributing. It’s our goal to enable this collection in as many languages as possible. To do so we must first obtain all of the translated or transliterated\*\* words for each language, verified by a native speaker. Once ready they will be merged in and made available for contribution at Common Voice. If you’re interested in helping contribute to the translation of these words in your language(s), visit this [Githhub repository](https://github.com/JRMeyer/common-voice-stats/blob/master/README.md#how-to-contribute-to-numbers--yesno) where you can submit a pull request or an issue for review.

**Why is this important and what’s next?**

As the Common Voice project grows in dataset size, community, and reach, it has become increasingly important for the platform to be able to distinguish the context of its collected data. Providing context, or a vocabulary of what the data relates to via tagging, allows for a more complete picture beyond language, accent, sex and age. This level of detail will allow contributors — both community members submitting recordings and sentences, as well as researchers and developers analyzing the final output — to select the segment that is the most relevant to them. This will enable more detailed feedback on how to continue improving the dataset, while also unlocking more possibilities for usefulness and application.

To further this work, the team will be exploring opportunities this new structure facilitates, including tagging at the clip level during the Listen phase. Our goal is to introduce more targeted data segments based on the content being recorded. Examples of this could be tagging background noise on a recorded clip or confirming that content is related to medicine or geography. By implementing tagging, both for sentences imported and of clips recorded, the data structure populated is more comprehensive and accurate. Stay tuned for that release announcement and [go add your voice](https://voice.mozilla.org/speak) to Common Voice’s first target segment!

Cheers,

Megan + the Common Voice team

* * *

\*Initial 13 languages: Arabic, Catalan, English, German, Spanish, French, Dutch, Polish, Portuguese, Russian, Tamil, Turkish, Tatar.

\*\*For the collection of _Hey_ as part of _Hey Firefox_, the Firefox Voice team wishes to utilize a transliteration approach to capture more natural and comfortable utterances. An example in French is _Hé Firefox_ rather than _Salut Firefox_.

---

<div class="post-metadata">

**Author:** ![mbranson](https://avatars.discourse-cdn.com/v4/letter/m/c68b51/32.png) [@mbranson](https://discourse.mozilla.org/u/mbranson)\
**Post date:** [May 20, 2020, 2:52pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/6 "2020-05-20T14:52:32Z")

</div>

Listed on May 20, 2020, 2:52pm UTC



---

<div class="post-metadata">

**Author:** ![stergro](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/stergro/32/40229_2.png) [@stergro](https://discourse.mozilla.org/u/stergro)\
**Post date:** [May 20, 2020, 5:28pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/7 "2020-05-20T17:28:05Z")

</div>

Hi, nice project,

just two questions about this part:

> [@mbranson](#):
>
> \*\*For the collection of _Hey_ as part of _Hey Firefox_ , the Firefox Voice team wishes to utilize a transliteration approach to capture more natural and comfortable utterances. An example in French is _Hé Firefox_ rather than _Salut Firefox_ .

1. I can’t find a column for the translation of Hey in the repository. How can we add translations?

2. Right now in the German Version of CV the word “Hei” appears, a word that doesn’t exist. **Hei can be pronounced both like Hi and like Hey.** I think just saying Hey Firefox would be the best and most natural way to use it in German. If you really want the literal sound I would go with Hej.

---

<div class="post-metadata">

**Author:** ![isomorph70](https://avatars.discourse-cdn.com/v4/letter/i/7ab992/32.png) [@isomorph70](https://discourse.mozilla.org/u/isomorph70)\
**Post date:** [May 20, 2020, 5:34pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/8 "2020-05-20T17:34:02Z")

</div>

Just added a pull request for the Danish numbers.

---

<div class="post-metadata">

**Author:** ![jofish](https://avatars.discourse-cdn.com/v4/letter/j/a8b319/32.png) [@jofish](https://discourse.mozilla.org/u/jofish)\
**Post date:** [May 20, 2020, 6:37pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/9 "2020-05-20T18:37:43Z")

</div>

Hey all – I’m a Principal Scientist at Mozilla, and the person responsible for bringing Hey Firefox into the mix here. First, thanks everyone for your enthusiasm: it’s great to see.

I want to address two questions that have shown up. The first is around the transliteration vs. translation issue – that is to say, why are we collecting Hey Firefox instead of, say, Salut Firefox or Hola Firefox. That’s pretty easy: as you might expect, we’re interested in a wakeword that anyone can use, as part of the [Firefox Voice](https://github.com/mozilla/firefox-voice) project. For the system we are planning on using, we’re looking for something on the order of 2-4k recordings of Hey Firefox, from perhaps 1k people. That makes recording individualized, language-specific wakewords not viable at this stage. So that means we’re looking to show people something where they will read it out loud and say something that sounds like “Hey Firefox” which we can train from.

Some asked about the particular transliteration in German. For each of the languages we collected I checked with a native speaker about how they’d write it down. I could absolutely see differences of opinion here, and I’m entirely happy to discuss any particular transliteration. We’ll look into the right option for German; thank you for bringing it up.

Thanks again

Jofish

---

<div class="post-metadata">

**Author:** ![stergro](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/stergro/32/40229_2.png) [@stergro](https://discourse.mozilla.org/u/stergro)\
**Post date:** [May 20, 2020, 7:02pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/10 "2020-05-20T19:02:02Z")

</div>

> [@jofish](#):
>
> Some asked about the particular transliteration in German. For each of the languages we collected I checked with a native speaker about how they’d write it down. I could absolutely see differences of opinion here, and I’m entirely happy to discuss any particular transliteration. We’ll look into the right option for German; thank you for bringing it up.

Hi Jofish,  
thanks for the explanation. The thing with Hei is that ei is a tricky compinaton in German. You want us to pronounce e and i separately, but normally these two letters are pronounced like ay. You can try out the different pronounciations [here on google translate](https://translate.google.com/#view=home&op=translate&sl=de&tl=en&text=hei%0Ahej%0AHey) by clicking on the listen icon.

I would just go with Hey, it is a common word in German, and [you can find it in the Duden](https://www.duden.de/rechtschreibung/hey).

EDIT: maybe we just wait a little and see how the people actually pronounce it. I would pronounce it like Hi if I wouldn’t know better.

EDIT: Just had a first woman pronouncing it like “Hi”. I will hit “no” if this happens.

EDIT: I used private tabs to see a little more of this project and I got 1 out of seven donators who pronounced it like Hey, everyone else said Hi.

---

<div class="post-metadata">

**Author:** ![jofish](https://avatars.discourse-cdn.com/v4/letter/j/a8b319/32.png) [@jofish](https://discourse.mozilla.org/u/jofish)\
**Post date:** [May 20, 2020, 8:31pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/11 "2020-05-20T20:31:41Z")

</div>

I like data-driven decision making. If we’re getting only 1/7 pronouncing it like we expected, then I entirely agree; let’s change it to Hey.

---

<div class="post-metadata">

**Author:** ![dabinat](https://avatars.discourse-cdn.com/v4/letter/d/8dc957/32.png) [@dabinat](https://discourse.mozilla.org/u/dabinat)\
**Post date:** [May 21, 2020, 4:26am UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/12 "2020-05-21T04:26:23Z")

</div>

Data tagging is a really great feature that could improve the dataset a lot. I had some questions though:

1. Will this data be mixed into all the other clips in a dataset release or will target segments be considered separate datasets?

2. To clarify, this is just to test the feature and there isn’t a specific intended use-case for gathering numbers?

---

<div class="post-metadata">

**Author:** ![mbranson](https://avatars.discourse-cdn.com/v4/letter/m/c68b51/32.png) [@mbranson](https://discourse.mozilla.org/u/mbranson)\
**Post date:** [May 21, 2020, 9:39pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/13 "2020-05-21T21:39:43Z")

</div>

Thanks @dabinat, great questions.

> [@dabinat](#):
>
> Will this data be mixed into all the other clips in a dataset release or will target segments be considered separate datasets?

We’re aiming to have target segments downloadable as separate dataset segments. So this Single Word target segment would be made available separately from what we refer to as the General Corpus. The intent is for these release cycles to be linked. Meaning, we’re planning to release the Single Word segment data at the same time as the General Corpus data, with a release target of mid-year. (Note that we’ve never done a release under the bandwidth constraints imparted by the current pandemic situation and timelines are not concrete.)

> [@dabinat](#):
>
> To clarify, this is just to test the feature and there isn’t a specific intended use-case for gathering numbers?

Currently spoken digit collection is intended for benchmark testing an application on digit recognition. No other specific use-cases are outlined at the moment.

---

<div class="post-metadata">

**Author:** ![nukeador](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/nukeador/32/20533_2.png) [@nukeador](https://discourse.mozilla.org/u/nukeador)\
**Post date:** [May 22, 2020, 5:49pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/14 "2020-05-22T17:49:25Z")

</div>

Pinned on May 22, 2020, 5:49pm UTC



---

<div class="post-metadata">

**Author:** ![lidyachristina](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/lidyachristina/32/37533_2.png) [@lidyachristina](https://discourse.mozilla.org/u/lidyachristina)\
**Post date:** [May 23, 2020, 6:12am UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/15 "2020-05-23T06:12:24Z")

</div>

Hello 🙂

The pull request of native verification for Indonesian language just merged and I am wondering how long it will takes to be updated in the Common Voice site?

---

<div class="post-metadata">

**Author:** ![nukeador](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/nukeador/32/20533_2.png) [@nukeador](https://discourse.mozilla.org/u/nukeador)\
**Post date:** [May 25, 2020, 10:13am UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/17 "2020-05-25T10:13:35Z")

</div>

We usually do portal releases each 2 weeks, we have one planned tomorrow Tuesday 26th, but I don’t know if the new languages will be merged into the main repo by today.

@Joshua_Meyer how often you merge the new languages into voice-web repo? Can you make a PR today before tomorrow’s release?

---

<div class="post-metadata">

**Author:** ![irvin](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/irvin/32/59482_2.png) [@irvin](https://discourse.mozilla.org/u/irvin)\
**Post date:** [May 25, 2020, 11:36am UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/18 "2020-05-25T11:36:25Z")

</div>

Hi, how should we do if we had multiple different words in correspond to yes/no? should we list them all in P/R?

Such as currently Japanese had listed two type in each words, how will we deal with this in Common Voice?

---

<div class="post-metadata">

**Author:** ![tucan](https://avatars.discourse-cdn.com/v4/letter/t/4bbf92/32.png) [@tucan](https://discourse.mozilla.org/u/tucan)\
**Post date:** [May 26, 2020, 11:14am UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/20 "2020-05-26T11:14:19Z")

</div>

(From another native speaker)  
“Hei” is phonetically wrong if you assume Standard German, and lexically awkward.

If the spoken output you want is the word “Hey”, you should write it this way.

“Häi” or “Hej” would be (more) phonetically correct, but they look awkward and unfamiliar to German speakers, and everybody is familiar with anglicisms.  
Additionally, “Hey” (in this exact form) is used frequently in everyday speech and writing (e.g. chats), making “Hei” look more like a spelling mistake.

To clarify: “Hei” looks like a bad translation, and is alien to written Standard German.

---

<div class="post-metadata">

**Author:** ![mbranson](https://avatars.discourse-cdn.com/v4/letter/m/c68b51/32.png) [@mbranson](https://discourse.mozilla.org/u/mbranson)\
**Post date:** [May 26, 2020, 9:03pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/21 "2020-05-26T21:03:49Z")

</div>

> [@irvin](#):
>
> Hi, how should we do if we had multiple different words in correspond to yes/no? should we list them all in P/R?
> 
> Such as currently Japanese had listed two type in each words, how will we deal with this in Common Voice?

@irvin We’re working with @Joshua\_Meyer to understand if multiple words corresponding to one word is an acceptable way forward for this benchmark test set. At the moment, we’ve only merged languages that have a 1-to-1 translation and it’s my understanding that Josh is validating the best corresponding word in each language. If you have multiples, for now it’s okay to list them all in the PR [here](https://github.com/JRMeyer/common-voice-stats/blob/master/README.md#how-to-contribute-to-numbers--yesno) and work with Josh to determine the best way forward for that language set.

---

<div class="post-metadata">

**Author:** ![mbranson](https://avatars.discourse-cdn.com/v4/letter/m/c68b51/32.png) [@mbranson](https://discourse.mozilla.org/u/mbranson)\
**Post date:** [May 26, 2020, 9:10pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/22 "2020-05-26T21:10:41Z")

</div>

@tucan welcome and thanks for that input. Sounds like you and @stergro are aligned re: the German preference for “Hey” over “Hei”. Appreciate that feedback. We’ll be sure the Firefox Voice team gets this info and work with @jofish to determine best way forward prior to our next release (June 9th). _Update: This [issue](https://github.com/mozilla/voice-web/issues/2747) has been submitted to Common Voice github for transition of Hei to Hey for German collection. This will go out with the June 9th release._

Also @stergro it’s great that you’re taking on validating more via a private tab. For recording, it’s important that we have as many unique voices as possible, so please avoid recording these target segment words more than once.

---

<div class="post-metadata">

**Author:** ![dabinat](https://avatars.discourse-cdn.com/v4/letter/d/8dc957/32.png) [@dabinat](https://discourse.mozilla.org/u/dabinat)\
**Post date:** [May 27, 2020, 6:43pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/23 "2020-05-27T18:43:00Z")

</div>

@mbranson Is there a particular goal or minimum in terms of number of contributors or hours recorded?

Do the progress bars on the Languages page count target segment contributions as part of the total? They shouldn’t if it’s a separate dataset.

---

<div class="post-metadata">

**Author:** ![iveskins](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/iveskins/32/18008_2.png) [@iveskins](https://discourse.mozilla.org/u/iveskins)\
**Post date:** [May 28, 2020, 11:44am UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/24 "2020-05-28T11:44:46Z")

</div>

Just a thought. I say digits a little differently when I am speaking them carefully one at a time, compared to reeling them off in a long multi digit number.

---

<div class="post-metadata">

**Author:** ![nukeador](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/nukeador/32/20533_2.png) [@nukeador](https://discourse.mozilla.org/u/nukeador)\
**Post date:** [May 28, 2020, 5:01pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/25 "2020-05-28T17:01:14Z")

</div>

Are there other languages seeing people reading the footnote?

> <https://github.com/common-voice/common-voice/issues/2743>
>
> People keep reading the “you are contributing to our first target segment” text …as if it was a sentence 🤦‍♂️
> 
> Maybe move it out of the sentence box?

---

<div class="post-metadata">

**Author:** ![mbranson](https://avatars.discourse-cdn.com/v4/letter/m/c68b51/32.png) [@mbranson](https://discourse.mozilla.org/u/mbranson)\
**Post date:** [May 29, 2020, 5:41pm UTC](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587/26 "2020-05-29T17:41:16Z")

</div>

Thanks for the questions and input @dabinat!

> [@dabinat](#):
>
> Is there a particular goal or minimum in terms of number of contributors or hours recorded?

- For single digits, yes and no we’re aiming to collect 4k validated utterances (clips) from at minimum 350 unique speakers

- For hey and Firefox we’re aiming to collect 2-4k validated utterances (clips) from at minimum 350 unique speakers

> [@dabinat](#):
>
> Do the progress bars on the Languages page count target segment contributions as part of the total? They shouldn’t if it’s a separate dataset.

Yes, they do. This Single Word target segment is a part our of Common Voice Dataset and not a separate dataset itself. Therefore it adds to the overall collection numbers for the Common Voice Dataset.

Part of this work is determining how we represent progress toward segments as part of the dataset whole. Breaking this down by language is indeed another factor. Our current priority is collecting these clips, releasing the data and gathering insights before we make any sweeping changes to how progress is conveyed.

[Next page](https://discourse.mozilla.org/t/help-create-common-voices-first-target-segment/59587.md?page=2)