I tested it with a scentence that is already part of the colection and I could review it and it looked like there would be no test for doublicates. Is this the case? I guess a lot of people try to add scentences from similar sources that are public domain, so this should defenetely be tested.

Yes, maybe I added a space at one end of the scentence. EDIT: strange, I just retested it and it now says “The sentences you submitted already exist.” Does it also test for scentences from the early phase of the project? The scentence I used was defenetly added via github, not via the frontend. Now…

Once sentencee get exported, we also check against existing sentences in the voice-web GitHub repo. Great, thanks. So I don’t have to fear to create duplicates when I propose a new sentence.

Does the sentence collector test for duplicates?

Common Voice

mkohler (Michael Kohler) August 28, 2019, 3:09pm 4

We only test against the Sentence Collector database. Once sentencee get exported, we also check against existing sentences in the voice-web GitHub repo.

Topic		Replies	Views
Duplicate sentences during validation Common Voice issue	4	679	September 27, 2019
Outdated Mass Submissions Common Voice sentence-collection	6	505	March 6, 2019
Grammatically poor sample sentences Common Voice sentence-collection	23	2029	April 29, 2019
Mass import sentences into Sentence Collector Common Voice sentence-collection	5	693	February 7, 2019
Sentences analysis on main languages - Action needed for the ones with deficit Common Voice sentence-collection	14	2048	August 6, 2019

Does the sentence collector test for duplicates?

Related topics