# Major "loss" in demographic data

**URL:** <https://discourse.mozilla.org/t/major-loss-in-demographic-data/92123>\
**Category:** Common Voice\
**Tags:** issue\
**Created:** [January 28, 2022, 4:44am UTC](https://discourse.mozilla.org/t/major-loss-in-demographic-data/92123 "2022-01-28T04:44:54Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![bozden](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/bozden/32/51381_2.png) [@bozden](https://discourse.mozilla.org/u/bozden)\
**Post date:** [January 28, 2022, 4:44am UTC](https://discourse.mozilla.org/t/major-loss-in-demographic-data/92123/1 "2022-01-28T04:44:54Z")

</div>

Now I’ve got your attention, the situation can actually be saved…

Our main goal for v8 (in Turkish) was to balance the dataset - while increasing text & voice corpora. Therefore, in our campaign, we emphasized the importance of demographic data.

This is from v7.0 dataset:

 ![image](https://us1.discourse-cdn.com/flex001/uploads/mozilla/original/3X/c/f/cf59b6ec9ef96ee220cce75bd9d615bcb3c81f96.png)

And this is from the new v8.0:

 ![image](https://us1.discourse-cdn.com/flex001/uploads/mozilla/original/3X/1/b/1bdbf26ee1388aea28d1fa170ef315a91168bfec.png)

These are from validated.tsv record distributions. As you can see records without demographic data increased, despite our efforts (see blank rows/columns).

This is already an issue in CorporaCreator, see:

> <https://github.com/common-voice/CorporaCreator/issues/117>
>
> In some cases a given \`client\_id\` might have more than one demographic datapoint… (e.g. gender or age) linked to it. Often this is \`blank\` vs. \`male\`/\`female\` or \`blank\` vs. some age. 
> 
> This is probably because people recorded some clips then made a profile, or because they became logged out. 
> 
> In any case it would be good (and probably safe) to replace \`blank\` in the field with the more specific datapoint if and only if there are no other datapoints associated with the \`client\_id\`.
> 
> Some examples from Turkish, with thanks to @harikalarkutusu! 
> 
> !\[image\](https://user-images.githubusercontent.com/449545/137339341-a30595db-be51-45f1-b467-cc04245cfa0e.png)

In v7.0 Turkish dataset we had 26 such persons affecting 1,327 recordings, in v8.0 this increased to 79 persons and 10,577 recordings !!!

Two possible causes:

1. The following bug caused deletion of demographic data, I was alert on that and it happened:  
[[Bug] Changing leaderboard visiblity result in removed age and gender in profile settings (smartphone) · Issue #3353 · common-voice/common-voice · GitHub](https://github.com/common-voice/common-voice/issues/3353)

2. CV kicked people out many times a day after the server upgrades in late October. People might be tired of logging in and kept recording without logging.

I calculated 16.73% of the above 32.36% in the v8.0 dataset can be corrected, leaving only 15.63% without actual demographics (these numbers are for gender, but should be similar for age).

Please be aware of this if you are using demographic info in your own splits/trainings.

To remedy:

1. Issue in CorporaCreator should be resolved (it’s effect is cumulative).
2. Less automatic logouts
3. Easier login system (see: [[req] Passwordless Login And Two-Factor Authentication for CV website · Issue #3393 · common-voice/common-voice · GitHub](https://github.com/common-voice/common-voice/issues/3393))
4. Warn your community to re-check/re-fill their demographics info.

---

<div class="post-metadata">

**Author:** ![daniel.abzakh](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/daniel.abzakh/32/66466_2.png) [@daniel.abzakh](https://discourse.mozilla.org/u/daniel.abzakh)\
**Post date:** [January 30, 2022, 9:15pm UTC](https://discourse.mozilla.org/t/major-loss-in-demographic-data/92123/2 "2022-01-30T21:15:23Z")

</div>

> [@bozden](#):
>
> I calculated 16.73% of the above 32.36% in the v8.0 dataset can be corrected,

Can you elaborate on this? How did you correct it?

Regarding the remedies, our team is having similar problems! I did relate the message to Hillary @heyhillary , I have been told that around September or earlier, a person can fill up the demographic data and contribute without having to login (as a guest).

---

<div class="post-metadata">

**Author:** ![bozden](https://sea1.discourse-cdn.com/flex001/user_avatar/discourse.mozilla.org/bozden/32/51381_2.png) [@bozden](https://discourse.mozilla.org/u/bozden)\
**Post date:** [January 30, 2022, 9:26pm UTC](https://discourse.mozilla.org/t/major-loss-in-demographic-data/92123/3 "2022-01-30T21:26:10Z")

</div>

> [@daniel.abzakh](#):
>
> Can you elaborate on this? How did you correct it?

I did not correct anything, I calculated how many can be corrected by analyzing the data.

It should be corrected globally in datasets as indicated here:

> <https://github.com/common-voice/CorporaCreator/issues/117>
>
> In some cases a given \`client\_id\` might have more than one demographic datapoint… (e.g. gender or age) linked to it. Often this is \`blank\` vs. \`male\`/\`female\` or \`blank\` vs. some age. 
> 
> This is probably because people recorded some clips then made a profile, or because they became logged out. 
> 
> In any case it would be good (and probably safe) to replace \`blank\` in the field with the more specific datapoint if and only if there are no other datapoints associated with the \`client\_id\`.
> 
> Some examples from Turkish, with thanks to @harikalarkutusu! 
> 
> !\[image\](https://user-images.githubusercontent.com/449545/137339341-a30595db-be51-45f1-b467-cc04245cfa0e.png)