We’re the Cantonese Computational Linguistics Infrastructure Development Workgroup (CanCLID), a team of volunteers from Guangdong, Guangxi, Hong Kong, Macau, and the United States. We want to add the Cantonese language to Common Voice. Which language code should be used? yue Which script s…

Common Voice has already been collecting Cantonese data for a while, the code is zh-HK : https://commonvoice.mozilla.org/zh-HK/speak There are 60 hours of data available (37 validated) in this past summer’s data release. I believe the prompts I’ve seen are all in Traditional characters. I’m sure th…

Yes, I’m aware of the zh-HK corpus, but a lot of Cantonese users do not reside in Hong Kong, and tagging the language under a specific region is putting off at best and down-right offensive to other non-Hong Kong Cantonese speakers. Using zh-hk for Cantonese is also like calling Portugese as “Romanc…

I’m aware of the language situation. I don’t know how the decision was made to use the zh-HK designation on Common Voice, especially since it is not an ISO 639-2 code. I agree that the yue code would be more appropriate. However Mozilla currently seems to have very little bandwidth for Common Voice …

We currently intend the yue to be vernacular only. How the ‘literary’ version should be tagged is unknown to us, and also not something our team can invest in at this point. There are tons of (proprietary, unfortunately) data sets of Cantonese users reciting paragraphs written in the ‘literary’ stra…

The project sounds very interesting to me, but I’m still concerned about the relationship with the existing dataset. Have you looked at the text prompts in the zh-HK dataset? I believe the prompts are primarily vernacular Cantonese, even if some of them have Mandarin-influenced grammar or vocabulary…

Thanks for your suggestions! Yes, we checked out the existing corpus on Github and we think the constructions generally are not very vernacular. “何老師問現正在” isn’t vernacular, the natural vernacular form would be “何老師問而家喺”. Also I’ve noted there are at least thirty sentences that start with the same p…

Thanks for the explanations. My Cantonese teacher taught us 而家 but often used 正在 and other Mandarin words as well, so I don’t have a very clear picture of when or where these switches occur. It doesn’t sound to me like a different language, but perhaps you’ll get some response from Mozilla. Unfortu…

Contributors at zh-hk team had aware of the issue. We mostly agree and support to add yue as a new language on Common Voice, and leave the current “zh-hk” for Cantonese in Hong Kong specifically. One reason is that the Cantonese had transformed much in Hong Kong a lot. It’s not just a dialect or ac…

Please allow me to give my two cents here. What we are proposing here is to add Cantonese as an independent language. The essential issue that Mozilla is currently having, is not treating a language as a language, but rather a dialect or variant. Mozilla is mistaking a macro-language -> language rel…

Requesting the Cantonese language (yue)

Common Voice

hfhchan (Henry Chan) November 2, 2020, 6:32pm 6

The guide at 📖 Readme: How to see my language on Common Voice pointed me here, and I believe the yue tag is much more in-line with the strategy outlined in that document.

Topic		Replies	Views
Adding Cantonese/ zh-hk Common Voice l10n	6	1951	October 10, 2018
📖 Readme: How to see my language on Common Voice Common Voice announcements	35	14503	May 10, 2022
Progress of launch zh-HK voice collecting Common Voice	7	1069	November 27, 2019
:speaking_head: Feedback needed: Languages and accents strategy Common Voice participation , feedback	50	7674	March 25, 2020
Help create Common Voice's first target segment Common Voice announcements	31	16746	November 14, 2020

Requesting the Cantonese language (yue)

Related topics