Sentence collector copyright issues

ftyers · September 11, 2021, 2:45pm

If it is “public domain”, then it counts as CC0, so that is ok. But in any case if the sentences are poorly segmented, I think probably we’d want to delete them anyway and just re-import them.

As for poetry, I think this is not the ideal text… we want stuff that is dialoguey as far as possible. Think software with voice interaction. As much fun as it might be to talk in Turkish or Ottoman poetry with my GPS assistant, perhaps we should start with more day-to-day texts

Having a Turkish community subforum sounds like an excellent idea. We could do it with a Matrix chat, or perhaps ask for a subforum on Discourse?

ftyers · September 11, 2021, 2:46pm

Oops sorry ! Belay that suggestion!

bozden · September 11, 2021, 2:57pm

If you can delete the existing ones, I’ll be happy to re-add them correctly…

Matrix flows away, discourse is best. As many natives do not know English good enough and information is very scattered, I would like to collect guidelines in Turkish in there.

Sorry for hacking the thread…

mkohler · September 11, 2021, 3:06pm

So, to get it right, I should delete all sentences coming from the sources mentioned in your original post here? Sentence collector copyright issues

Anything else?

bozden · September 11, 2021, 5:36pm

Sorry for the late reply. I checked sources I could access and suggest deletion of the list below. Probably these are all of them. All are incomplete sentences or verses of poetry…

(the links got malformed in discourse thou)

Thank you @mkohler …

mkohler · September 12, 2021, 10:57am

Thanks for the list @bozden. This has now been taken care of!

bozden · September 12, 2021, 11:36am

Thank you @mkohler, I reposted allowable sentences from the first link.

takfox · November 6, 2021, 11:11pm

There are a lot of sentences from Tatoeba in the Norwegian Bokmal collection. As noted for Swedish, this collection is mostly CC-BY, and there are only two Bokmal sentences in the entire collection marked CC0. Bit of a shame since it looks like it might be most of the sentences

takfox · November 6, 2021, 11:30pm

Incidentally, https://www.nb.no/sprakbanken/en/resource-catalogue/oai-nb-no-sbr-47/ appears to be a high quality source of thousands of CC0 sentences. I’m happy to import them if appropriate

mkohler · November 7, 2021, 12:56am

Unfortunately quite a few sentences, but it is what it is. I’ve taken care of those.

“In total, the material consists of approximately 700,000 translation pairs/sentence pairs.” sounds very promising indeed. License seems fine as well. I think importing those would be great. You might want to have a look at the bulk import process though, as going through Sentence Collector with that many sentences is not really efficient. See “Bulk submission” at https://common-voice.github.io/community-playbook/sub_pages/text.html.

jakub.wrobel7 · November 10, 2021, 9:11pm

I did a quick scan through polish sentences and found some unwanted sources from opensubtitles:

“source”: “Open Subtitles: https://www.opensubtitles.org/pl/subtitles/7665545/z-nation-at-all-cost-pl”,
“source”: “https://www.opensubtitles.org/pl/subtitles/7716578/the-100-sanctum-pl”,
“source”: “https://www.opensubtitles.org/pl/subtitles/7719533/guava-island-pl”,
“source”: “https://www.opensubtitles.org/pl/subtitles/7723395/the-orville-sanctuary-pl”,
“source”: “https://www.opensubtitles.org/pl/subtitles/7724670/brooklyn-nine-nine-he-said-she-said-pl”,
“source”: “open subtitles”,
“source”: “opensubtitles and project gutenberg”,
“source”: “opensubtitles.org”,

mkohler · November 11, 2021, 7:27pm

Thanks. I’ve taken care of this.

Sobsz · February 17, 2022, 11:15pm

In Toki Pona (tok), there are some sentences credited to http://tokisoweli.blogspot.com/, which doesn’t mention any specific rights other than “mi pana e sitelen ali mi tawa jan ale.” (“I give all my writings to everyone.”).

mkohler · February 18, 2022, 4:18pm

Thanks for reporting.

@heyhillary is this enough for us or should I remove those sentences?

heyhillary · February 18, 2022, 5:07pm

Based on the CC0 waiver process, this wouldn’t be enough.

By any chance @Sobsz are you in contact with the author ? So they could formally dedicate their works under cc0 ?

Sobsz · February 19, 2022, 10:48pm

The author hasn’t posted publicly on the internet since 2019, so contact is unlikely. We’re doing well in terms of sentence count, though, so it’s not a big loss.

mkohler · February 20, 2022, 2:58pm

This now has been taken care of by deleting these sentences.

sftblw · March 29, 2022, 6:50am

language: korean
source: https://www.studylight.org/bible/kor/kor/proverbs/31.html
owner: korean bible society (afaik this is copyrightened sentences)

Please consider removing with other sentences by searching root path “https://www.studylight.org/bible/kor”, since I can see many more.
Thank you.

mkohler · March 29, 2022, 7:48pm

Thanks. I’m sceptical whether those really are copyrighted. Before I delete those, I would like to know more. @heyhillary can you have a look at this please? Thanks!

sftblw · March 30, 2022, 12:52am

Oh sorry, I checked it again and It looks like fine, these look like copyright-expired version of translation.

I misunderstood because these sentence look like most recent version of bible translation (which is still covered by copyright), since these sentences are weird like it. These translations are not expressed in every-day expressions, which makes very difficult to read and understand it.

korean bible society - copyright notice (korean) - this translation, “성경전서 개역한글판” is listed as expired at 2011-12-31.
Most used edition by Presbyterianism in S. Korea is revised translation of it, “성경전서 개역개정판”, 4th edition, which is still covered by copyright (1st edition: 1998-08-31~, 70 years from it).

This translation is almost same, at least to me (side-by-side view - press “읽기”), since these share same property - nonnatural and old expressions. Sentences like these are never used in everyday speaking and writing, even in books.