Spanish dataset

sentence-collection
(Mar Martinez) #1

Hi,

I would like to contribute to start collecting spanish voices, how can I do it?.
How could I contribute, for example, with sentences (0/5000)?.

Best regards,
Mar

0 Likes

(Carlos Fonseca) #2

I was about to ask the same, how do we enable Spanish in the portal, I can can contribute too :slight_smile:

0 Likes

(Carlos Fonseca) #3
0 Likes

(Mar Martinez) #4

Yes, thanks Carlos.
The step 3, the one I am concerned about, is… still blocked?

How did the other languages in use managed? are there alternatives?

0 Likes

(Rubén Martín [away until April 24th]) #5

Hi,

We are still finishing the sentence collection tool:

Ideally we would have a beta version to test before the end of the year, if the QA of that beta is satisfactory we can start using it to collect and review sentences.

And I have to say I understand it’s frustrating but please, keep collecting sentences so we can submit them through the tool as soon as it’s ready.

Gracias por vuestras paciencia :wink:

0 Likes

(Fatimaig) #6

And where do we contribute with spanish sentences?
Me and some colleges from the University would like to colaborate in the Spanish part of this project.
Ty :wink:

0 Likes

(Rubén Martín [away until April 24th]) #7

You can start collecting sentences with public domain license anytime and use any form to store them in the meantime. As soon as the tool is ready you will be able to submit them for peer-review and approval.

Please, note that we want the sentence collection tool to enforce some hard requirements that are necessary for sentences to be useful for the machine learning algorithm:

  • Numbers. There should be no digits in the source text because they can cause problems when read aloud. The way a number is read depends on context and might introduce confusion in the dataset. For example, the number “2409” could be accurately read as both “twenty-four zero nine” and “two thousand four hundred nine”.
  • Abbreviations and Acronyms. Abbreviations and acronyms like “USA” or “ICE” should be avoided in the source text because they may be read in a way that does not coincide with their spelling. Additionally, there may be multiple accurate readings for a single abbreviation. For example, the acronym “ICE” could be pronounced “I-C-E” or as a single word.
  • Punctuation. Special symbols and punctuation should only be included when absolutely necessary. For example, an apostrophe is included in English words like “don’t” and “we’re” and should be included in the source text, but it’s unlikely you’ll ever need a special symbol like “@” or “#.”
  • Foreign letters. Letters must be valid in the language being spoken. For example, “ж” is a letter in the Russian alphabet but is never used in English and so should never appear in any English source text.
0 Likes

(Mar Martinez) #8

Hi,

Any update about the sentence collection tool availability for Spanish?

Thanks,
Mar

0 Likes

(Rubén Martín [away until April 24th]) #9

We plan to launch the beta version of the tool next week.

You can follow the development in Sentence collection tool development topic

0 Likes

(Mar Martinez) #10

Hi,

The sentence collection tool is ready and now I am adding and reviewing sentences in Spanish. Great.

But the Common Voice site localization in Spanish is never ending, but indeed it is getting worse (from 95% completion in December to 75% now). Where can I fix this?. Directly with a github pull request or any other tool?.

Tanks,
Mar

1 Like

(Rubén Martín [away until April 24th]) #11

Website localization is handled via pontoon:

https://pontoon.mozilla.org/es/common-voice/

You can ping people with reviewer rights in this telegram channel or this forum.

2 Likes

(Mar Martinez) #12

Thanks a lot,

On the other hand, to fulfill the accent list, I assume that is required a github pull request, the required list will be roughly by countries (e.g. Español de México, Español de Guatemala, Español de España…) or with local accents inside each country?.

Regards,
Mar

1 Like

(Rubén Martín [away until April 24th]) #13

We should probably follow and official list of accents. @josh_meyer how did we get the English one?

0 Likes

#14

I dont know how we got English accents, but I’ll ask around.

1 Like

(Rubén Martín [away until April 24th]) #15

@mar_martinez @carlfm01 @fatimaig I see a lot of activity for Spanish today :smiley:

Just noticed an old book with weird old language and some subtitles that have incomplete sentences, I hope community vote negative but we should probably warn people before uploading thousands of sentences without even checking them.

I’ve added a few tips on how to get a lot of valid sentences reusing Catalan previous work here

2 Likes

(Daniel Cruzado) #16

Hi, I have seen that Spanish already has 14 hours, that is far more than for example than Breton or Irish, but Spanish dataset is not available for download.

Do we know when will it be ready?

0 Likes

(Rubén Martín [away until April 24th]) #17

Please read this explanation about the current dataset release process:

0 Likes

(Daniel Cruzado) #18

Ok, thanks a lot for your answer and for all of your work!!

1 Like