Thanks Dominik, good point. I think lazyguy has loads of smaller audios and therefore loading takes up more time than processing. Right?
And how do you multiprocess for CPUs?
Changing the current solution will be hard. Have you thought about merging audios and splitting results afterwards? Not the best solution, but better than wasting GPU-Power.