Problems finding public domain sentences

Hi all, I understand the requirement for CC0 so that no licensing restrictions may limit future outcomes of the DeepSpeech models. I do wonder though if this isn’t unncessarily holding back more rapid progress of this great project.

FB’s LASER project has just reached a major milestone for rapidly translating phrases from 93 languages (see this detailed post and this full paper). All code is released on https://github.com/facebookresearch/LASER under CC-BY-NC. This leverages the huge Tatoeba corpus, some of which is CC0 but most of it is under CC-BY. FB’s advances wouldn’t have been possible without this great resource.

Given that CC-BY places no restrictions other than needing to attribute that some source material may have come from tatoeba.org, what are the arguments against allowing this kind of source/license? It would certainly allow jump-starting some languages where collected sentences are still at 0 (e.g., Arabic). For example, Tatoeba has 31,481 sentences available in Arabic, but none of them are CC0, all are CC-BY. I ran a quick summary on the sentences.csv that can be downloaded; here are the number of sentences by language.

I’d love to understand better what the hard arguments are for excluding CC-BY given such great resources.

cc @nukeador @mhenretty