Scaling DeepSpeech to deal with many concurrent requests

[lissyx ((slow to reply) [NOT PROVIDING SUPPORT])]

@Paul_Raine

the time it takes for DeepSpeech to generate a response when there are multiple concurrent requests

there’s no batching support in libdeepspeech.so, so I don’t see how you can run anything concurrently.