Let’s say I’m trying to use transfer learning to calibrate a model to a specific person’s voice. However, I only have a total of 20 people to train my model off of, so I want to train more generally for them and then calibrate my model to work specifically for this one person.
What would be a good learning rate for the general 20-person population and the specific person I’m calibrating to?
I see that the default rate is 0.001 for DeepSpeech.py.
Check validation loss vs. training loss. Closer they are the better. If so, you have found good learning rate, which is not overfitting or underfitting the model…