📖 Necesitamos más frases en español

[nukeador (Rubén Martín [❌ taking a break from Mozilla])]

@carlfm01

Pensando un poco más como solucionar este problema de las frases y la importancia de frases actuales se me ocurrió crear un generador de frases.

Aquí creo que hablaban de algo similar en inglés

How unique should a sentence be?

There are lots of sentences like the following in the Wikipedia dump: All songs written by Trey Anastasio, except as noted. The artist name in each sentence is unique, but all surrounding words are either almost or exactly identical each time. While the sentences are technically unique, is the similar/identical wording overly biasing the model and they should therefore be removed? cc @kdavis