What dataset error rate is acceptable?

Is there any information on what the error rate of a corpus should be in order for the model to improve? I guess CER of the model will never be lower than CER of the corpus, which is almost never a factor, but is there any other limitation? By dataset errors I mean things like typos or abbreviations in the transcription and mispronunciations in the audio.