Spanish dataset

[mar_martinez]

Hi,

I would like to contribute to start collecting spanish voices, how can I do it?.
How could I contribute, for example, with sentences (0/5000)?.

Best regards,
Mar

[carlfm01]

I was about to ask the same, how do we enable Spanish in the portal, I can can contribute too

[carlfm01]

Readme: How to see my language on Common Voice

Hello everyone, I would like to open this topic to summarize some of the most asked question we are getting: How do I get my language in Common Voice. There are 3 steps to have your language ready: Have the website localized over pontoon. Gather sentences under public domain Validate and review them to be incorporated into the database. Once we have enough validated and reviewed sentences (usually over 5000), we can move a language to accept voice recording on the site. Important: Current…

[mar_martinez]

Yes, thanks Carlos.
The step 3, the one I am concerned about, is… still blocked?

How did the other languages in use managed? are there alternatives?

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

Hi,

We are still finishing the sentence collection tool:

Sentence collection tool development topic

Continuing the discussion from We want your feedback: Improving the sentence collection: Hi all, As promised I’ve been documenting all pending issues to have the tool functional, this topic is aimed just to developers who would like to help (react and kinto skills required) Source code Testing site What do we need? Fork the project and test that you can run the environment locally following the instructions. Is everything working as expected? If not, submit a new issue. Review the pending…

Ideally we would have a beta version to test before the end of the year, if the QA of that beta is satisfactory we can start using it to collect and review sentences.

And I have to say I understand it’s frustrating but please, keep collecting sentences so we can submit them through the tool as soon as it’s ready.

Gracias por vuestras paciencia

[fatimaig]

And where do we contribute with spanish sentences?
Me and some colleges from the University would like to colaborate in the Spanish part of this project.
Ty

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

And where do we contribute with spanish sentences?
Me and some colleges from the University would like to colaborate in the Spanish part of this project.

You can start collecting sentences with public domain license anytime and use any form to store them in the meantime. As soon as the tool is ready you will be able to submit them for peer-review and approval.

Please, note that we want the sentence collection tool to enforce some hard requirements that are necessary for sentences to be useful for the machine learning algorithm:

• Numbers. There should be no digits in the source text because they can cause problems when read aloud. The way a number is read depends on context and might introduce confusion in the dataset. For example, the number “2409” could be accurately read as both “twenty-four zero nine” and “two thousand four hundred nine”.
• Abbreviations and Acronyms. Abbreviations and acronyms like “USA” or “ICE” should be avoided in the source text because they may be read in a way that does not coincide with their spelling. Additionally, there may be multiple accurate readings for a single abbreviation. For example, the acronym “ICE” could be pronounced “I-C-E” or as a single word.
• Punctuation. Special symbols and punctuation should only be included when absolutely necessary. For example, an apostrophe is included in English words like “don’t” and “we’re” and should be included in the source text, but it’s unlikely you’ll ever need a special symbol like “@” or “#.”
• Foreign letters. Letters must be valid in the language being spoken. For example, “ж” is a letter in the Russian alphabet but is never used in English and so should never appear in any English source text.

[mar_martinez]

Hi,

Any update about the sentence collection tool availability for Spanish?

Thanks,
Mar

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

We plan to launch the beta version of the tool next week.

You can follow the development in Sentence collection tool development topic

[mar_martinez]

Hi,

The sentence collection tool is ready and now I am adding and reviewing sentences in Spanish. Great.

But the Common Voice site localization in Spanish is never ending, but indeed it is getting worse (from 95% completion in December to 75% now). Where can I fix this?. Directly with a github pull request or any other tool?.

Tanks,
Mar

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

But the Common Voice site localization in Spanish is never ending, but indeed it is getting worse (from 95% completion in December to 75% now). Where can I fix this?. Directly with a github pull request or any other tool?.

Website localization is handled via pontoon:

https://pontoon.mozilla.org/es/common-voice/

You can ping people with reviewer rights in this telegram channel or this forum.

[mar_martinez]

Thanks a lot,

On the other hand, to fulfill the accent list, I assume that is required a github pull request, the required list will be roughly by countries (e.g. Español de México, Español de Guatemala, Español de España…) or with local accents inside each country?.

Regards,
Mar

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

On the other hand, to fulfill the accent list, I assume that is required a github pull request, the required list will be roughly by countries (e.g. Español de México, Español de Guatemala, Español de España…) or with local accents inside each country?.

We should probably follow and official list of accents. @josh_meyer how did we get the English one?

[josh_meyer]

I dont know how we got English accents, but I’ll ask around.

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

@mar_martinez @carlfm01 @fatimaig I see a lot of activity for Spanish today

Just noticed an old book with weird old language and some subtitles that have incomplete sentences, I hope community vote negative but we should probably warn people before uploading thousands of sentences without even checking them.

I’ve added a few tips on how to get a lot of valid sentences reusing Catalan previous work here

Nueva herramienta para mandar frases a Common Voice

[daniel.cruzado]

Hi, I have seen that Spanish already has 14 hours, that is far more than for example than Breton or Irish, but Spanish dataset is not available for download.

Do we know when will it be ready?

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

Please read this explanation about the current dataset release process:

Add Basque to the dataset page

The languages currently available for download are the ones that last year were already launched and had validated hours before we started the dataset creation later last year (Basque or Spanish for example were not even launched by that time) Dataset releases are really time consuming for the team and we are still trying to figure out how to be able to release them more often (I’ve added this as a todo on my list to discuss with the team). You can say with confidence that Basque is fully laun…

[daniel.cruzado]

Ok, thanks a lot for your answer and for all of your work!!