Trying to train DeepSpeech with multi GPU using horovod causing RAM(out of memory) error

I am trying to train DeepSpeech using horovod on 4gpu machine. The cause of failure might be too many threads of DeepSpeech is there any way I can control the number of threads while training deepspeech any suggestion will be helpful.