I would like to ask for clarification as to when something is good (answer ‘yes’) and when not (answer ‘no’).
My current approach is as follows:
I listen to the recording, and if I hear what is spoken in the recording (and no additional words, and of course no words missing), then it is okay for me. I do not care about accents, background noise, etc.
Examples where I would give “no”:
“I am going to” vs. “I’m gonna”
“the farmer” vs. “the farmers”
“He told me not to.” vs. “He told me not.”
Does that make sense?
What are your thoughts?
Overall, I have the impression there is no crap content in the recordings, only small slips from time to time.
I tend to do the same. If it’s not literally the same, I pick no.
I must admit that I also press no sometimes when the accent is really too bad. When I hear that the syllables are stressed in the wrong way, or confusion can occur due to bad pronunciation (e.g. share versus chair), I also press no.
What difference do you mean with your second point about the farmer?
I read the github issue and it’s still not clear to me how I should rate pronunciation. For example in: “Operating on dynamic data sets is difficult.” someone pronounce “data” as /data/ instead of /ˈdeɪ.tə/ – should I accept it?