Updated Process for Submitting Bulk Sentence Requests

Common Voice
1

Hello Community

We have finally reached the end of reviewing the bulk sentence request process. Thank you for your patience while the team worked on it. The new process will consist of the following steps after submitting a request:

  1. Community coordinator will review the request to make sure that all the fields are completed and send the file to legal for review.
  2. If legal approves, the community coordinator will communicate with the communities for quality assurance checks. This process involves the following:

  • Random selection of 50 sentences marked on the submitted file to be quality checked. Quality assurance comments should be provided in the ā€œSentence quality assurance feedbackā€ column.

  • If the reviewed sentences meet the quality assurance criteria, the bulk sentences will be merged.

  • If the review reveals that some sentences are not sufficiently high quality and do not meet the criteria - eg. poor spelling or grammar, dubious open source provenance, violation of community guidelines. The reviewer should inform the community coordinator and the submitter to resolve the identified issues and resubmit.

  1. If legal does not approve, the community coordinator will communicate with the submitter and provide reasons for rejection. The submitter will work with the community coordinator for resubmission.

Community members must only submit sentences that fall within the public domain. Alternatively, they should sign the CC0 waiver form to prevent any delays in the updated process.

Thank you for your cooperation, this is to ensure the continued high quality of the sentences.

Thanks

1 Like
Discussion: Best practices/steps for increased recording duration?
2

Hey @gina, thank you for the update. Just some quick questions:

  1. What is the medium of the initial and final request/submission? File upload via web form? Github? Is there a sample
  2. Not all submissions are equal wrt sources. They can be books which dropped into public domain or self/community generated, etc. In the latter case, where they are already quality checked, most of these steps seem to be unnecessary.
  3. In case of ā€œquestionableā€ legal status, wouldnā€™t it be logical to check with legal before preparing the resource file?

Iā€™m asking these because in our workflow our community aims for 0 (zero) errors, multiple people read ALL sentences before submitting. I had several rejections in the past after such hard workā€¦

3 Likes
3

Hi @gina, thanks for the updates. Do we need to reupload the sentences we uploaded before this policy?

1 Like
4

Hi @neouyghur yes please, kindly use the updated template.

1 Like
5

Hey @bozden, thank you for the questions.

  1. The process is still the same, files are uploaded via the MCV website using the updated template.
  2. Yes, that is indicated in the ā€œSourceā€ column of the template.
  3. Given the steps involved in quality assurance, we prefer legal approves first.
    Weā€™ve had community members complain about bad sentences in the corpus, this is to ensure that we accept only high quality sentences.
1 Like
6

Hi @gina, I uploaded the sentences with the new template through the MCV website. What is the next step?

7

Is the CC BY-SA 3.0 license valid for bulk submissions?

8

No @Reverend, only CC-0 / Public Domainā€¦

2 Likes
9

How do we know the progress of legal checking? I have submitted bulk sentences, but I have not got any updates.

10

Hi @neouyghur, the file has been sent to legal for copyright license review, a process that may require some time. I will update you on the subsequent steps as soon as I receive feedback.

11

Hi @neouyghur this process may take some time, I will email you the next steps as soon as I receive feedback. Kindly note that after legal review, I need to find a quality assurance person to check the file, this may take more time, kindly be patient as we go through this process. I will keep you updated.

12

Yes, only CC-0 or sentences in the public domain

13

Hi @gina thanks for your reply. I am one of the members of the Uyghur community who is actively contributing to the CV Uyghur dataset. I can assist you in finding the right person to evaluate the sentences written in Uyghur.

14

@gina, Iā€™m adapting our collaborative Google Sheet template to the new style, but I have a question about the template:

In your examples, you used real names as the source. Is this mandatory?

We are working as a community and we switched to use nicknames after the TTS hit. Iā€™m more or less a public figure, but I donā€™t want to expose any other people with their real namesā€¦ ā€œCommunity member, copyright waivedā€ would suffice Iā€™d like to presumeā€¦

15

Hi @bozden, yes that would suffice.

1 Like
16

I assume, at the final stage the import script will be triggered manually, like it is now.

But with so many fields in free-form, especially the ā€œDomainā€ column, you will have a hard time handling these.

This is what is inserted into the DB:

  await db.runSql(`
    INSERT INTO sentence_domains (domain)
    VALUES ('general'),
      ('agriculture'),
      ('automotive'),
      ('finance'),
      ('food_service_retail'),
      ('healthcare'),
      ('history_law_government'),
      ('media_entertainment'),
      ('nature_environment'),
      ('news_current_affairs'),
      ('technology_robotics'),
      ('language_fundamentals')
  `)
}

But you might get anything there, even in localized language. I think a more strict rule for that would be much better.