Maybe a long shot, but I remember some people dealing with air trafic control data which could be close in term of poor quality, and in their case, simply applying some low-pass filtering would help a lot. Have you tried that kind of cleanup? That might be easier to achieve better WER than retraining from scratch, which might be tricky to get working with a few hundreds of hours.